2024-05-07T11:01:41.857 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-07T11:01:41.857 DEBUG:teuthology.run:Teuthology command: teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} --archive /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861 --name teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi --verbose --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/orig.config.yaml 2024-05-07T11:01:41.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-07T11:01:41.970 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7694861' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: b05eb2754514c6559f7c34d831877d418ea3a9c7 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: b05eb2754514c6559f7c34d831877d418ea3a9c7 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 510b35d4b766757579df5fd9efd2f892309f09e1 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 466 sha1: b05eb2754514c6559f7c34d831877d418ea3a9c7 sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_510b35d4b766757579df5fd9efd2f892309f09e1/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 510b35d4b766757579df5fd9efd2f892309f09e1 targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNe3riJAovr1mD7EZKsLr2BKG9M1rS7AtGi+8aZBwYveI+vn3NhpWprR0chamwPBTEsJQcKyBJUr/sQhDjtQUw= smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIXu0uzxb/cVcJHa8ICjt2brwa2gNIApw8TJIEPlNy5ehzJvSE1eoUGiDMs5DYxwxAqekV+dUpw0uB4bWwRo630= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAEKd7xti3tEPj+/xoerh7OXC0gHE7S7LVt3AyqJmmzQncEBiREZzUHFxUmyWeP5Uda8n+RPGcD/wJb+n0Bpk0k= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkFJFZyYxW4WjMXovFMeaXL96Rttq7VuZkBBGQHAnUf3QT0VN4iH5OhhxhGWJ+y+VakYTlIelr/k5Pij3Y3T9A= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsx.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-06_21:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-07T11:01:41.970 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_510b35d4b766757579df5fd9efd2f892309f09e1/qa; will attempt to use it 2024-05-07T11:01:41.971 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_510b35d4b766757579df5fd9efd2f892309f09e1/qa/tasks 2024-05-07T11:01:41.971 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-07T11:01:41.973 INFO:teuthology.task.internal:Checking packages... 2024-05-07T11:01:41.996 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b05eb2754514c6559f7c34d831877d418ea3a9c7' 2024-05-07T11:01:41.996 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-07T11:01:41.996 INFO:teuthology.packaging:ref: None 2024-05-07T11:01:41.996 INFO:teuthology.packaging:tag: None 2024-05-07T11:01:41.996 INFO:teuthology.packaging:branch: squid 2024-05-07T11:01:41.996 INFO:teuthology.packaging:sha1: b05eb2754514c6559f7c34d831877d418ea3a9c7 2024-05-07T11:01:41.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-05-07T11:01:42.218 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2513.g510b35d4 2024-05-07T11:01:42.219 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-07T11:01:42.226 INFO:teuthology.task.internal:no buildpackages task found 2024-05-07T11:01:42.226 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-07T11:01:42.268 INFO:teuthology.task.internal:Saving configuration 2024-05-07T11:01:42.280 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-07T11:01:42.302 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-07T11:01:42.328 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 10:56:09.086024', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNe3riJAovr1mD7EZKsLr2BKG9M1rS7AtGi+8aZBwYveI+vn3NhpWprR0chamwPBTEsJQcKyBJUr/sQhDjtQUw='} 2024-05-07T11:01:42.351 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 10:56:09.088375', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIXu0uzxb/cVcJHa8ICjt2brwa2gNIApw8TJIEPlNy5ehzJvSE1eoUGiDMs5DYxwxAqekV+dUpw0uB4bWwRo630='} 2024-05-07T11:01:42.375 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 10:56:09.084449', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAEKd7xti3tEPj+/xoerh7OXC0gHE7S7LVt3AyqJmmzQncEBiREZzUHFxUmyWeP5Uda8n+RPGcD/wJb+n0Bpk0k='} 2024-05-07T11:01:42.396 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 10:56:09.087215', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkFJFZyYxW4WjMXovFMeaXL96Rttq7VuZkBBGQHAnUf3QT0VN4iH5OhhxhGWJ+y+VakYTlIelr/k5Pij3Y3T9A='} 2024-05-07T11:01:42.396 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-07T11:01:42.401 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-05-07T11:01:42.401 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['osd.0'] 2024-05-07T11:01:42.401 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['osd.1'] 2024-05-07T11:01:42.401 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['osd.2'] 2024-05-07T11:01:42.401 INFO:teuthology.run_tasks:Running task console_log... 2024-05-07T11:01:42.558 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad7dec60d0>, signals=[15]) 2024-05-07T11:01:42.558 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-07T11:01:42.564 INFO:teuthology.task.internal:Opening connections... 2024-05-07T11:01:42.564 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-05-07T11:01:42.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:01:42.646 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-05-07T11:01:42.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:01:42.719 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-05-07T11:01:42.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:01:42.797 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-05-07T11:01:42.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:01:42.874 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-07T11:01:42.880 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-05-07T11:01:42.899 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-05-07T11:01:42.899 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-05-07T11:01:42.957 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-05-07T11:01:42.957 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-07T11:01:42.958 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-07T11:01:42.959 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-05-07T11:01:42.982 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-05-07T11:01:43.000 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-05-07T11:01:43.000 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-05-07T11:01:43.057 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-05-07T11:01:43.057 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-07T11:01:43.058 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-07T11:01:43.059 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-05-07T11:01:43.080 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-05-07T11:01:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-05-07T11:01:43.099 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-05-07T11:01:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-07T11:01:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-07T11:01:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-07T11:01:43.157 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-05-07T11:01:43.182 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-05-07T11:01:43.200 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-05-07T11:01:43.200 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-05-07T11:01:43.257 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-05-07T11:01:43.257 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-05-07T11:01:43.257 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-05-07T11:01:43.257 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-05-07T11:01:43.257 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-05-07T11:01:43.257 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-05-07T11:01:43.257 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-07T11:01:43.257 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-05-07T11:01:43.257 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-05-07T11:01:43.257 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-07T11:01:43.258 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-05-07T11:01:43.258 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-07T11:01:43.258 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-07T11:01:43.258 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-07T11:01:43.258 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-05-07T11:01:43.281 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-07T11:01:43.290 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-07T11:01:43.335 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-07T11:01:43.335 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-05-07T11:01:43.338 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-05-07T11:01:43.340 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-05-07T11:01:43.342 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-05-07T11:01:43.359 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-07T11:01:43.364 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-07T11:01:43.364 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-05-07T11:01:43.395 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-05-07T11:01:43.397 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-05-07T11:01:43.399 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-05-07T11:01:43.670 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-07T11:01:43.775 INFO:teuthology.run_tasks:Running task kernel... 2024-05-07T11:01:43.789 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-07T11:01:43.789 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-07T11:01:43.790 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-07T11:01:43.790 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-07T11:01:43.793 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-07T11:01:43.794 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-07T11:01:43.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:01:43.810 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-05-07T11:01:43.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:01:43.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:01:43.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:01:43.812 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-05-07T11:01:43.813 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-05-07T11:01:43.813 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-05-07T11:01:43.869 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-437.el9.x86_64 2024-05-07T11:01:43.869 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.14.0-437.el9.x86_64 2024-05-07T11:01:43.869 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2024-05-07T11:01:43.871 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-437.el9.x86_64 2024-05-07T11:01:43.871 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-437.el9.x86_64 2024-05-07T11:01:43.871 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.14.0-437.el9.x86_64 2024-05-07T11:01:43.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2024-05-07T11:01:43.871 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.14.0-437.el9.x86_64 2024-05-07T11:01:43.872 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2024-05-07T11:01:43.872 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-437.el9.x86_64 2024-05-07T11:01:43.873 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.14.0-437.el9.x86_64 2024-05-07T11:01:43.873 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2024-05-07T11:01:46.093 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.1 MB 00:00 2024-05-07T11:01:48.851 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.1 MB 00:03 2024-05-07T11:01:49.498 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.1 MB 00:03 2024-05-07T11:01:50.660 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-05-07T11:01:50.933 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 8.1 MB 00:05 2024-05-07T11:01:53.001 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-05-07T11:01:56.269 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.2 MB 00:01 2024-05-07T11:01:57.877 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 16 kB 00:00 2024-05-07T11:01:59.043 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.2 MB 00:02 2024-05-07T11:02:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 16 kB 00:00 2024-05-07T11:02:00.578 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 21 MB 00:02 2024-05-07T11:02:02.381 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-07T11:02:03.748 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-05-07T11:02:04.905 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 19 MB 00:14 2024-05-07T11:02:05.753 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-07T11:02:07.778 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-07T11:02:07.809 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-07T11:02:07.810 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-07T11:02:07.908 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-05-07T11:02:07.920 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-05-07T11:02:07.920 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-05-07T11:02:07.920 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-05-07T11:02:07.920 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-05-07T11:02:07.921 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-07T11:02:07.921 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-05-07T11:02:07.921 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-07T11:02:07.921 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-07T11:02:07.921 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-07T11:02:07.921 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:02:07.921 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-05-07T11:02:07.921 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-05-07T11:02:07.921 INFO:teuthology.orchestra.run.smithi088.stdout:Install 4 Packages 2024-05-07T11:02:07.921 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:02:07.922 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 78 M 2024-05-07T11:02:07.922 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 123 M 2024-05-07T11:02:07.922 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-05-07T11:02:08.771 INFO:teuthology.orchestra.run.smithi088.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 598 kB/s | 484 kB 00:00 2024-05-07T11:02:09.876 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-07T11:02:09.876 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-07T11:02:09.973 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-07T11:02:09.982 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-07T11:02:09.982 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-05-07T11:02:09.982 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-07T11:02:09.982 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-07T11:02:09.982 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 78 M 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 123 M 2024-05-07T11:02:09.983 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-07T11:02:10.173 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.2 MB 00:02 2024-05-07T11:02:10.813 INFO:teuthology.orchestra.run.smithi062.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 705 kB/s | 484 kB 00:00 2024-05-07T11:02:11.172 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.2 MB 00:02 2024-05-07T11:02:11.757 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 16 kB 00:00 2024-05-07T11:02:12.681 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-05-07T11:02:14.268 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-07T11:02:15.216 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 21 MB 00:03 2024-05-07T11:02:18.702 INFO:teuthology.orchestra.run.smithi088.stdout:(2/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 3.2 MB/s | 34 MB 00:10 2024-05-07T11:02:19.498 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-05-07T11:02:20.375 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-07T11:02:21.546 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-07T11:02:21.546 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-07T11:02:21.644 INFO:teuthology.orchestra.run.smithi088.stdout:(3/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.1 MB/s | 15 MB 00:13 2024-05-07T11:02:21.645 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-05-07T11:02:21.652 INFO:teuthology.orchestra.run.smithi175.stdout:Install 4 Packages 2024-05-07T11:02:21.653 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:02:21.653 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 78 M 2024-05-07T11:02:21.653 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 123 M 2024-05-07T11:02:21.653 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-05-07T11:02:22.407 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-07T11:02:22.407 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-07T11:02:22.433 INFO:teuthology.orchestra.run.smithi175.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 666 kB/s | 484 kB 00:00 2024-05-07T11:02:22.490 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-05-07T11:02:22.508 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-05-07T11:02:22.508 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-05-07T11:02:22.508 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-05-07T11:02:22.508 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-05-07T11:02:22.508 INFO:teuthology.orchestra.run.smithi149.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-07T11:02:22.508 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-05-07T11:02:22.508 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-07T11:02:22.508 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-07T11:02:22.508 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-07T11:02:22.509 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:02:22.509 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-05-07T11:02:22.509 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-05-07T11:02:22.509 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-05-07T11:02:22.509 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:02:22.509 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 78 M 2024-05-07T11:02:22.509 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 123 M 2024-05-07T11:02:22.510 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-05-07T11:02:23.187 INFO:teuthology.orchestra.run.smithi062.stdout:(2/4): kernel-modules-core-5.14.0-444.el9.x86_6 2.3 MB/s | 28 MB 00:12 2024-05-07T11:02:23.335 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 618 kB/s | 484 kB 00:00 2024-05-07T11:02:23.837 INFO:teuthology.orchestra.run.smithi062.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 2.5 MB/s | 34 MB 00:13 2024-05-07T11:02:23.968 INFO:teuthology.orchestra.run.smithi088.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 1.8 MB/s | 28 MB 00:15 2024-05-07T11:02:23.969 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-05-07T11:02:23.969 INFO:teuthology.orchestra.run.smithi088.stdout:Total 4.8 MB/s | 78 MB 00:16 2024-05-07T11:02:24.653 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-05-07T11:02:24.994 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-05-07T11:02:24.994 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-05-07T11:02:25.487 INFO:teuthology.orchestra.run.smithi062.stdout:(4/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.0 MB/s | 15 MB 00:15 2024-05-07T11:02:25.487 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-07T11:02:25.487 INFO:teuthology.orchestra.run.smithi062.stdout:Total 5.0 MB/s | 78 MB 00:15 2024-05-07T11:02:25.909 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-05-07T11:02:25.909 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-05-07T11:02:26.199 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-07T11:02:26.608 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-07T11:02:26.608 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-07T11:02:27.550 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-07T11:02:27.551 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-07T11:02:27.660 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 3.0 MB/s | 15 MB 00:05 2024-05-07T11:02:28.336 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-05-07T11:02:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-07T11:02:29.043 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:02:29.974 INFO:teuthology.orchestra.run.smithi175.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.9 MB/s | 15 MB 00:08 2024-05-07T11:02:30.138 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-07T11:02:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-07T11:02:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:02:31.733 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:02:31.870 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:02:33.665 INFO:teuthology.orchestra.run.smithi175.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 2.8 MB/s | 34 MB 00:11 2024-05-07T11:02:33.733 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:02:33.887 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:02:36.558 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:02:36.721 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:02:36.815 INFO:teuthology.orchestra.run.smithi175.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 1.9 MB/s | 28 MB 00:14 2024-05-07T11:02:36.815 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-05-07T11:02:36.815 INFO:teuthology.orchestra.run.smithi175.stdout:Total 5.1 MB/s | 78 MB 00:15 2024-05-07T11:02:37.500 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-05-07T11:02:37.844 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-05-07T11:02:37.845 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-05-07T11:02:38.767 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-05-07T11:02:38.767 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-05-07T11:02:38.977 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:02:38.992 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 1.8 MB/s | 28 MB 00:15 2024-05-07T11:02:39.023 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:02:39.658 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 2.0 MB/s | 34 MB 00:17 2024-05-07T11:02:39.659 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-05-07T11:02:39.659 INFO:teuthology.orchestra.run.smithi149.stdout:Total 4.5 MB/s | 78 MB 00:17 2024-05-07T11:02:40.344 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-05-07T11:02:40.687 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-05-07T11:02:40.687 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-05-07T11:02:41.156 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-05-07T11:02:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:02:41.628 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-05-07T11:02:41.628 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-05-07T11:02:41.804 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-07T11:02:41.889 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:02:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-05-07T11:02:44.118 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:02:44.578 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:02:44.707 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-07T11:02:44.714 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:02:44.800 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:02:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:02:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:02:49.437 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:02:49.474 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:02:52.384 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:02:52.496 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:02:54.221 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:02:57.241 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:10.465 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:10.503 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:10.876 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:10.876 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-07T11:03:10.876 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:03:10.876 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:03:11.655 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:11.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:03:11.655 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-05-07T11:03:11.655 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:11.655 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-07T11:03:11.655 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-07T11:03:11.655 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-07T11:03:11.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:03:11.655 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-05-07T11:03:12.012 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T11:03:12.099 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:12.100 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T11:03:12.100 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-07T11:03:12.100 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-07T11:03:12.100 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-07T11:03:12.100 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-05-07T11:03:12.100 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2024-05-07T11:03:12.100 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T11:03:12.150 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:12.151 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T11:03:12.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2024-05-07T11:03:12.190 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.06 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 68.el9 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Group : Unspecified 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 8264254 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-07T11:03:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : builder@centos.org 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:03:12.192 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2024-05-07T11:03:12.193 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-07T11:03:12.193 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 5.14.0-444.el9.x86_64 2024-05-07T11:03:12.193 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-07T11:03:12.813 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-05-07T11:03:14.253 INFO:teuthology.orchestra.run.smithi088.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-07T11:03:14.283 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-05-07T11:03:14.286 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-05-07T11:03:14.307 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.SGs3NtGhmH 2024-05-07T11:03:14.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SGs3NtGhmH 2024-05-07T11:03:14.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.SGs3NtGhmH 2024-05-07T11:03:14.505 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.SGs3NtGhmH is 6KB 2024-05-07T11:03:14.552 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.SGs3NtGhmH 2024-05-07T11:03:14.566 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2024-05-07T11:03:14.628 INFO:teuthology.orchestra.run.smithi088.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-07T11:03:14.628 INFO:teuthology.orchestra.run.smithi088.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-07T11:03:14.628 INFO:teuthology.orchestra.run.smithi088.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-07T11:03:14.628 INFO:teuthology.orchestra.run.smithi088.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-07T11:03:14.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-07T11:03:14.788 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2024-05-07T11:03:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-07T11:03:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:03:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:03:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:03:16.335 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-07T11:03:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-07T11:03:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-07T11:03:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-07T11:03:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:03:16.335 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-07T11:03:16.674 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T11:03:16.748 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:16.748 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T11:03:16.748 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-07T11:03:16.749 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-07T11:03:16.749 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-07T11:03:16.749 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-07T11:03:16.749 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-05-07T11:03:16.749 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T11:03:16.798 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:16.799 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T11:03:16.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.06 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 68.el9 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:Group : Unspecified 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 8264254 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-07T11:03:16.837 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : builder@centos.org 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-07T11:03:16.838 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2024-05-07T11:03:16.839 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:03:16.839 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2024-05-07T11:03:16.839 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-07T11:03:16.840 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 5.14.0-444.el9.x86_64 2024-05-07T11:03:16.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-07T11:03:17.506 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-05-07T11:03:18.894 INFO:teuthology.orchestra.run.smithi062.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-07T11:03:18.912 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-05-07T11:03:18.914 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-05-07T11:03:18.929 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.imSNWOrnSO 2024-05-07T11:03:18.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.imSNWOrnSO 2024-05-07T11:03:19.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.imSNWOrnSO 2024-05-07T11:03:19.154 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.imSNWOrnSO is 6KB 2024-05-07T11:03:19.202 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.imSNWOrnSO 2024-05-07T11:03:19.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2024-05-07T11:03:19.279 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-07T11:03:19.280 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-07T11:03:19.280 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-07T11:03:19.280 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-07T11:03:19.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-07T11:03:19.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-05-07T11:03:23.529 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:23.568 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:23.986 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:23.987 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-07T11:03:23.987 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:03:23.987 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:03:24.814 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:24.814 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:03:24.814 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-05-07T11:03:24.814 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:24.815 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-07T11:03:24.815 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-07T11:03:24.815 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-07T11:03:24.815 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:03:24.815 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-05-07T11:03:25.185 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T11:03:25.253 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:25.254 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T11:03:25.254 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-07T11:03:25.254 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-07T11:03:25.254 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-07T11:03:25.254 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-05-07T11:03:25.254 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=None, version=distro) 2024-05-07T11:03:25.254 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T11:03:25.304 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:25.304 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T11:03:25.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -qi grub2-tools 2024-05-07T11:03:25.346 INFO:teuthology.orchestra.run.smithi175.stdout:Name : grub2-tools 2024-05-07T11:03:25.347 INFO:teuthology.orchestra.run.smithi175.stdout:Epoch : 1 2024-05-07T11:03:25.347 INFO:teuthology.orchestra.run.smithi175.stdout:Version : 2.06 2024-05-07T11:03:25.348 INFO:teuthology.orchestra.run.smithi175.stdout:Release : 68.el9 2024-05-07T11:03:25.348 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: x86_64 2024-05-07T11:03:25.348 INFO:teuthology.orchestra.run.smithi175.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-07T11:03:25.348 INFO:teuthology.orchestra.run.smithi175.stdout:Group : Unspecified 2024-05-07T11:03:25.348 INFO:teuthology.orchestra.run.smithi175.stdout:Size : 8264254 2024-05-07T11:03:25.348 INFO:teuthology.orchestra.run.smithi175.stdout:License : GPLv3+ 2024-05-07T11:03:25.348 INFO:teuthology.orchestra.run.smithi175.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-07T11:03:25.348 INFO:teuthology.orchestra.run.smithi175.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-07T11:03:25.348 INFO:teuthology.orchestra.run.smithi175.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-07T11:03:25.349 INFO:teuthology.orchestra.run.smithi175.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-07T11:03:25.349 INFO:teuthology.orchestra.run.smithi175.stdout:Packager : builder@centos.org 2024-05-07T11:03:25.349 INFO:teuthology.orchestra.run.smithi175.stdout:Vendor : CentOS 2024-05-07T11:03:25.349 INFO:teuthology.orchestra.run.smithi175.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-07T11:03:25.349 INFO:teuthology.orchestra.run.smithi175.stdout:Summary : Support tools for GRUB. 2024-05-07T11:03:25.349 INFO:teuthology.orchestra.run.smithi175.stdout:Description : 2024-05-07T11:03:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:03:25.349 INFO:teuthology.orchestra.run.smithi175.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-07T11:03:25.350 INFO:teuthology.orchestra.run.smithi175.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-07T11:03:25.350 INFO:teuthology.orchestra.run.smithi175.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-07T11:03:25.350 INFO:teuthology.orchestra.run.smithi175.stdout:hardware devices. 2024-05-07T11:03:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:03:25.351 INFO:teuthology.orchestra.run.smithi175.stdout:This subpackage provides tools for support of all platforms. 2024-05-07T11:03:25.351 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-07T11:03:25.351 INFO:teuthology.task.kernel:Updating grub on smithi175 to boot 5.14.0-444.el9.x86_64 2024-05-07T11:03:25.351 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-07T11:03:25.987 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-05-07T11:03:26.721 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:26.759 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:27.118 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:27.118 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-07T11:03:27.118 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T11:03:27.118 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T11:03:27.438 INFO:teuthology.orchestra.run.smithi175.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-07T11:03:27.469 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-05-07T11:03:27.471 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-05-07T11:03:27.486 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.PQe51DlJt4 2024-05-07T11:03:27.486 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PQe51DlJt4 2024-05-07T11:03:27.553 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.PQe51DlJt4 2024-05-07T11:03:27.697 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.PQe51DlJt4 is 6KB 2024-05-07T11:03:27.745 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.PQe51DlJt4 2024-05-07T11:03:27.760 DEBUG:teuthology.orchestra.run.smithi175:> sudo /bin/ls /boot/loader/entries || true 2024-05-07T11:03:27.821 INFO:teuthology.orchestra.run.smithi175.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-07T11:03:27.821 INFO:teuthology.orchestra.run.smithi175.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-07T11:03:27.821 INFO:teuthology.orchestra.run.smithi175.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-07T11:03:27.821 INFO:teuthology.orchestra.run.smithi175.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-07T11:03:27.822 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-07T11:03:27.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T11:03:27.843 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:03:27.843 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-05-07T11:03:27.843 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:27.843 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-07T11:03:27.843 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-07T11:03:27.843 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-07T11:03:27.843 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:03:27.843 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-05-07T11:03:27.967 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-05-07T11:03:28.185 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T11:03:28.261 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:28.262 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T11:03:28.262 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-07T11:03:28.262 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-07T11:03:28.262 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-07T11:03:28.262 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-05-07T11:03:28.262 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2024-05-07T11:03:28.262 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T11:03:28.313 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T11:03:28.313 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T11:03:28.313 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-05-07T11:03:28.353 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-05-07T11:03:28.353 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-05-07T11:03:28.353 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 68.el9 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8264254 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-07T11:03:28.354 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-05-07T11:03:28.355 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-05-07T11:03:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:03:28.355 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-07T11:03:28.355 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-07T11:03:28.355 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-07T11:03:28.355 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-05-07T11:03:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:03:28.355 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-05-07T11:03:28.356 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-07T11:03:28.356 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 5.14.0-444.el9.x86_64 2024-05-07T11:03:28.356 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-07T11:03:28.973 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-05-07T11:03:30.408 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-07T11:03:30.441 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-05-07T11:03:30.443 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-05-07T11:03:30.459 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.A9dfybzGG2 2024-05-07T11:03:30.459 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.A9dfybzGG2 2024-05-07T11:03:30.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.A9dfybzGG2 2024-05-07T11:03:30.676 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.A9dfybzGG2 is 6KB 2024-05-07T11:03:30.724 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.A9dfybzGG2 2024-05-07T11:03:30.738 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-05-07T11:03:30.799 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-07T11:03:30.799 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-07T11:03:30.800 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-07T11:03:30.800 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-07T11:03:30.801 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-07T11:03:30.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-05-07T11:03:44.802 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-05-07T11:03:44.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-07T11:03:44.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:03:49.441 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-07T11:03:49.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-07T11:03:49.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:03:57.978 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-05-07T11:03:57.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-07T11:03:57.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:00.954 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-05-07T11:04:00.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-07T11:04:00.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:03.359 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-05-07T11:04:07.970 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-05-07T11:04:12.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-07T11:04:12.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:15.422 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-05-07T11:04:16.414 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-05-07T11:04:16.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-07T11:04:16.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:19.486 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-05-07T11:04:20.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-05-07T11:04:25.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-07T11:04:25.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:27.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-07T11:04:27.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:28.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-05-07T11:04:28.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-07T11:04:28.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:30.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-05-07T11:04:31.554 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-05-07T11:04:32.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-07T11:04:32.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:40.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-07T11:04:40.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:43.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-07T11:04:43.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:45.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-07T11:04:45.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:04:48.574 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-05-07T11:04:58.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-05-07T11:05:03.936 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-05-07T11:05:04.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-07T11:05:04.466 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-07T11:05:04.466 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-05-07T11:05:04.491 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-444.el9.x86_64 2024-05-07T11:05:04.491 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-07T11:05:04.491 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-07T11:05:04.492 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-07T11:05:05.493 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-07T11:05:05.493 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-07T11:05:05.556 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-05-07T11:05:05.754 DEBUG:teuthology.parallel:result is None 2024-05-07T11:05:06.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-07T11:05:06.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:05:09.630 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-05-07T11:05:13.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-07T11:05:13.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:05:14.327 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-05-07T11:05:14.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-07T11:05:14.698 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-444.el9.x86_64"... 2024-05-07T11:05:14.698 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-05-07T11:05:14.713 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-444.el9.x86_64 2024-05-07T11:05:14.713 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-07T11:05:14.713 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-07T11:05:14.713 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-07T11:05:15.395 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-05-07T11:05:15.714 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-05-07T11:05:15.714 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-07T11:05:15.792 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-05-07T11:05:15.825 DEBUG:teuthology.parallel:result is None 2024-05-07T11:05:15.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-07T11:05:15.985 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.14.0-444.el9.x86_64"... 2024-05-07T11:05:15.985 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-05-07T11:05:16.000 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-444.el9.x86_64 2024-05-07T11:05:16.001 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-07T11:05:16.001 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-07T11:05:16.001 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-07T11:05:17.001 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-05-07T11:05:17.002 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-07T11:05:17.086 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2024-05-07T11:05:17.119 DEBUG:teuthology.parallel:result is None 2024-05-07T11:05:30.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-07T11:05:30.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:05:31.076 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-05-07T11:05:31.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-07T11:05:31.475 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.14.0-444.el9.x86_64"... 2024-05-07T11:05:31.476 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-05-07T11:05:31.494 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-444.el9.x86_64 2024-05-07T11:05:31.494 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-07T11:05:31.494 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-07T11:05:31.494 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-07T11:05:32.495 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-05-07T11:05:32.495 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-07T11:05:32.573 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2024-05-07T11:05:32.603 DEBUG:teuthology.parallel:result is None 2024-05-07T11:05:32.603 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-07T11:05:32.611 INFO:teuthology.task.internal:Creating test directory... 2024-05-07T11:05:32.611 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-07T11:05:32.614 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-07T11:05:32.617 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-07T11:05:32.620 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-07T11:05:32.641 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-07T11:05:32.659 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-07T11:05:32.709 INFO:teuthology.task.internal:Creating archive directory... 2024-05-07T11:05:32.710 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-07T11:05:32.712 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-07T11:05:32.714 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-07T11:05:32.717 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-07T11:05:32.991 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-07T11:05:33.000 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-07T11:05:33.000 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-07T11:05:33.002 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-07T11:05:33.005 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-07T11:05:33.007 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-07T11:05:33.037 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T11:05:33.037 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T11:05:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T11:05:33.038 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T11:05:33.049 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T11:05:33.049 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T11:05:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T11:05:33.050 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T11:05:33.053 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-07T11:05:33.060 INFO:teuthology.task.internal:Configuring sudo... 2024-05-07T11:05:33.060 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-07T11:05:33.095 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-07T11:05:33.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-07T11:05:33.100 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-07T11:05:33.128 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-07T11:05:33.137 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-07T11:05:33.138 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-07T11:05:33.165 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-07T11:05:33.168 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-07T11:05:33.170 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-07T11:05:33.187 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T11:05:33.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T11:05:33.315 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T11:05:33.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T11:05:33.442 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:05:33.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-07T11:05:33.510 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T11:05:33.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T11:05:33.607 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T11:05:33.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T11:05:33.738 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:05:33.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-07T11:05:33.808 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T11:05:33.853 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T11:05:33.919 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T11:05:33.963 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T11:05:34.006 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:05:34.006 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-07T11:05:34.073 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T11:05:34.120 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T11:05:34.181 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T11:05:34.226 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T11:05:34.269 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:05:34.269 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-07T11:05:34.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-05-07T11:05:34.339 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-05-07T11:05:34.341 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-05-07T11:05:34.344 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-05-07T11:05:34.384 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T11:05:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T11:05:34.390 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T11:05:34.424 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T11:05:34.903 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-07T11:05:34.910 INFO:teuthology.task.internal:Starting timer... 2024-05-07T11:05:34.910 INFO:teuthology.run_tasks:Running task pcp... 2024-05-07T11:05:34.947 INFO:teuthology.run_tasks:Running task selinux... 2024-05-07T11:05:34.994 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-07T11:05:34.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-05-07T11:05:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-05-07T11:05:35.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2024-05-07T11:05:35.103 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2024-05-07T11:05:35.105 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-05-07T11:05:35.173 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-05-07T11:05:35.175 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-05-07T11:05:35.253 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-05-07T11:05:35.255 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-07T11:05:35.256 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-05-07T11:05:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-05-07T11:05:35.280 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2024-05-07T11:05:35.304 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2024-05-07T11:05:35.304 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-05-07T11:05:35.334 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-05-07T11:05:35.334 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-05-07T11:05:35.371 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-05-07T11:05:35.371 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-05-07T11:05:35.371 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T11:05:35.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:05:35.404 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T11:05:35.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:05:35.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T11:05:35.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:05:35.465 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T11:05:35.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:05:35.494 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-07T11:05:35.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-05-07T11:05:35.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2024-05-07T11:05:35.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-05-07T11:05:35.587 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-05-07T11:05:35.614 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-07T11:05:35.623 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-07T11:05:35.630 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-07T11:05:35.762 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-07T11:05:35.778 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-07T11:05:35.779 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi088.front.sepia.ceph.com,smithi149.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-07T11:09:48.002 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-05-07T11:09:48.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-07T11:09:48.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:09:48.083 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-05-07T11:09:48.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-07T11:09:48.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-07T11:09:48.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:09:48.239 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-05-07T11:09:48.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-07T11:09:48.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-07T11:09:48.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:09:48.397 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-05-07T11:09:48.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-07T11:09:48.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-07T11:09:48.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:09:48.554 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-05-07T11:09:48.639 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-07T11:09:48.640 INFO:teuthology.run_tasks:Running task clock... 2024-05-07T11:09:48.649 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-07T11:09:48.650 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-07T11:09:48.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T11:09:48.653 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-07T11:09:48.653 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T11:09:48.655 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-07T11:09:48.655 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T11:09:48.657 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-07T11:09:48.657 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T11:09:48.685 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-07T11:09:48.686 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-07T11:09:48.687 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-07T11:09:48.702 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-07T11:09:48.702 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-07T11:09:48.702 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-07T11:09:48.713 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-07T11:09:48.726 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-05-07T11:09:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2024-05-07T11:09:48.729 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-07T11:09:48.729 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-05-07T11:09:48.738 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-05-07T11:09:48.738 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2024-05-07T11:09:48.741 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-05-07T11:09:48.752 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-07T11:09:48.753 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-07T11:09:48.755 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-05-07T11:09:48.756 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-07T11:09:48.766 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-05-07T11:09:48.766 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-07T11:09:48.767 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-07T11:09:48.771 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-07T11:09:48.781 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-07T11:09:48.795 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-07T11:09:48.828 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-05-07T11:09:48.828 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-05-07T11:09:48.830 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-05-07T11:09:48.831 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T11:09:48.831 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-05-07T11:09:48.831 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.831 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.832 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.832 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.833 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T11:09:48.833 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-05-07T11:09:48.833 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.833 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.833 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.833 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.835 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T11:09:48.835 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-05-07T11:09:48.835 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.835 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.835 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.835 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.854 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-05-07T11:09:48.858 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T11:09:48.858 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-05-07T11:09:48.858 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.858 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.858 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.859 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:09:48.859 INFO:teuthology.run_tasks:Running task install... 2024-05-07T11:09:48.867 DEBUG:teuthology.task.install:project ceph 2024-05-07T11:09:48.867 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7'}} 2024-05-07T11:09:48.867 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7'} 2024-05-07T11:09:48.867 INFO:teuthology.task.install:Using flavor: default 2024-05-07T11:09:48.873 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-07T11:09:48.873 INFO:teuthology.task.install:extra packages: [] 2024-05-07T11:09:48.874 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7', 'tag': None, 'wait_for_package': False} 2024-05-07T11:09:48.874 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b05eb2754514c6559f7c34d831877d418ea3a9c7 2024-05-07T11:09:48.876 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7', 'tag': None, 'wait_for_package': False} 2024-05-07T11:09:48.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b05eb2754514c6559f7c34d831877d418ea3a9c7 2024-05-07T11:09:48.877 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7', 'tag': None, 'wait_for_package': False} 2024-05-07T11:09:48.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b05eb2754514c6559f7c34d831877d418ea3a9c7 2024-05-07T11:09:48.878 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7', 'tag': None, 'wait_for_package': False} 2024-05-07T11:09:48.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b05eb2754514c6559f7c34d831877d418ea3a9c7 2024-05-07T11:09:49.032 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/ 2024-05-07T11:09:49.032 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2504.gb05eb275 2024-05-07T11:09:49.037 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/ 2024-05-07T11:09:49.037 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2504.gb05eb275 2024-05-07T11:09:49.103 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/ 2024-05-07T11:09:49.103 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2504.gb05eb275 2024-05-07T11:09:49.136 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/ 2024-05-07T11:09:49.136 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2504.gb05eb275 2024-05-07T11:09:49.144 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-07T11:09:49.144 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:09:49.144 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-07T11:09:49.155 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-07T11:09:49.155 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:09:49.155 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-07T11:09:49.171 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-05-07T11:09:49.172 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b05eb2754514c6559f7c34d831877d418ea3a9c7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-07T11:09:49.187 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-05-07T11:09:49.187 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b05eb2754514c6559f7c34d831877d418ea3a9c7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-07T11:09:49.212 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-07T11:09:49.212 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:09:49.212 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-07T11:09:49.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-07T11:09:49.240 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-05-07T11:09:49.240 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b05eb2754514c6559f7c34d831877d418ea3a9c7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-07T11:09:49.252 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-07T11:09:49.308 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-07T11:09:49.311 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/b05eb2754514c6559f7c34d831877d418ea3a9c7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-07T11:09:49.311 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:09:49.311 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-07T11:09:49.315 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-07T11:09:49.327 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-07T11:09:49.337 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-05-07T11:09:49.338 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b05eb2754514c6559f7c34d831877d418ea3a9c7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-07T11:09:49.380 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-05-07T11:09:49.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-05-07T11:09:49.385 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-07T11:09:49.391 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-05-07T11:09:49.393 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-05-07T11:09:49.403 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-07T11:09:49.450 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-05-07T11:09:49.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-05-07T11:09:49.478 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-07T11:09:49.543 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2024-05-07T11:09:49.544 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2024-05-07T11:09:49.628 INFO:teuthology.orchestra.run.smithi062.stdout:54 files removed 2024-05-07T11:09:49.648 INFO:teuthology.orchestra.run.smithi175.stdout:54 files removed 2024-05-07T11:09:49.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-05-07T11:09:49.675 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-05-07T11:09:49.687 INFO:teuthology.orchestra.run.smithi149.stdout:54 files removed 2024-05-07T11:09:49.716 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-05-07T11:09:49.775 INFO:teuthology.orchestra.run.smithi088.stdout:54 files removed 2024-05-07T11:09:49.802 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-05-07T11:09:50.364 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 201 kB/s | 83 kB 00:00 2024-05-07T11:09:50.364 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 199 kB/s | 83 kB 00:00 2024-05-07T11:09:50.415 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 198 kB/s | 83 kB 00:00 2024-05-07T11:09:50.573 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 167 kB/s | 83 kB 00:00 2024-05-07T11:09:50.756 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-05-07T11:09:50.756 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-05-07T11:09:50.849 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-05-07T11:09:51.099 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 6.4 kB/s | 1.9 kB 00:00 2024-05-07T11:09:51.115 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-05-07T11:09:51.232 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-05-07T11:09:52.140 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 7.6 kB/s | 11 kB 00:01 2024-05-07T11:09:52.690 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-05-07T11:09:52.891 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.1 MB 00:01 2024-05-07T11:09:55.590 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.1 MB 00:02 2024-05-07T11:09:57.540 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.1 MB 00:06 2024-05-07T11:10:00.088 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 924 kB/s | 8.1 MB 00:08 2024-05-07T11:10:05.508 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 1.7 MB/s | 19 MB 00:11 2024-05-07T11:10:07.006 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 1.8 MB/s | 19 MB 00:10 2024-05-07T11:10:09.049 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 1.8 MB/s | 19 MB 00:10 2024-05-07T11:10:09.655 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 19 MB 00:08 2024-05-07T11:10:11.384 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.2 MB 00:02 2024-05-07T11:10:12.926 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-05-07T11:10:13.672 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.2 MB 00:03 2024-05-07T11:10:14.269 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-05-07T11:10:14.608 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.2 MB 00:01 2024-05-07T11:10:15.273 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 16 kB 00:00 2024-05-07T11:10:15.746 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.2 MB 00:02 2024-05-07T11:10:16.033 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 16 kB 00:00 2024-05-07T11:10:16.835 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-07T11:10:17.397 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-07T11:10:18.110 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-07T11:10:19.057 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-07T11:10:19.678 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-05-07T11:10:21.966 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-07T11:10:22.114 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-07T11:10:22.115 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-07T11:10:22.186 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-07T11:10:22.203 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-05-07T11:10:22.203 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-07T11:10:22.203 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-05-07T11:10:22.203 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-07T11:10:22.203 INFO:teuthology.orchestra.run.smithi062.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 6.6 k 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 5.4 M 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 889 k 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 145 k 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 1.5 M 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 142 k 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 3.5 M 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 7.4 M 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 49 k 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 10 M 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 48 M 2024-05-07T11:10:22.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 264 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 762 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 32 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 745 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 127 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 162 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 320 k 2024-05-07T11:10:22.205 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 299 k 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 99 k 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 85 k 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.1 M 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 171 k 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.4 M 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.1 M 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-07T11:10:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 21 M 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 32 k 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 2.4 M 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 249 k 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 4.7 M 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 17 M 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 15 k 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 25 k 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-07T11:10:22.207 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 164 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 501 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 5.3 M 2024-05-07T11:10:22.208 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-07T11:10:22.209 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 45 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 135 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-07T11:10:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-07T11:10:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-07T11:10:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-07T11:10:22.213 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout:Install 135 Packages 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 4 Packages 2024-05-07T11:10:22.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:10:22.215 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 211 M 2024-05-07T11:10:22.215 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-07T11:10:22.780 INFO:teuthology.orchestra.run.smithi062.stdout:(1/139): ceph-19.0.0-2504.gb05eb275.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-05-07T11:10:23.119 INFO:teuthology.orchestra.run.smithi062.stdout:(2/139): ceph-base-19.0.0-2504.gb05eb275.el9.x8 9.3 MB/s | 5.4 MB 00:00 2024-05-07T11:10:23.181 INFO:teuthology.orchestra.run.smithi062.stdout:(3/139): ceph-immutable-object-cache-19.0.0-250 2.3 MB/s | 145 kB 00:00 2024-05-07T11:10:23.344 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-05-07T11:10:23.400 INFO:teuthology.orchestra.run.smithi062.stdout:(4/139): ceph-mds-19.0.0-2504.gb05eb275.el9.x86 11 MB/s | 2.4 MB 00:00 2024-05-07T11:10:23.539 INFO:teuthology.orchestra.run.smithi062.stdout:(5/139): ceph-mgr-19.0.0-2504.gb05eb275.el9.x86 11 MB/s | 1.5 MB 00:00 2024-05-07T11:10:23.648 INFO:teuthology.orchestra.run.smithi062.stdout:(6/139): ceph-fuse-19.0.0-2504.gb05eb275.el9.x8 1.0 MB/s | 889 kB 00:00 2024-05-07T11:10:23.939 INFO:teuthology.orchestra.run.smithi062.stdout:(7/139): ceph-mon-19.0.0-2504.gb05eb275.el9.x86 12 MB/s | 4.7 MB 00:00 2024-05-07T11:10:24.274 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-05-07T11:10:24.292 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-07T11:10:24.292 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-07T11:10:24.357 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-05-07T11:10:24.379 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2024-05-07T11:10:24.379 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-05-07T11:10:24.379 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2024-05-07T11:10:24.379 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-05-07T11:10:24.379 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-07T11:10:24.379 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 6.6 k 2024-05-07T11:10:24.379 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 5.4 M 2024-05-07T11:10:24.379 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 889 k 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 145 k 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 1.5 M 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 142 k 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 3.5 M 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 7.4 M 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 49 k 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 10 M 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 48 M 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 264 k 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 762 k 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-07T11:10:24.380 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 32 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 745 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 127 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 162 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 320 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 299 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 99 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 85 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.1 M 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 171 k 2024-05-07T11:10:24.381 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.4 M 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.1 M 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 21 M 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 32 k 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 2.4 M 2024-05-07T11:10:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 249 k 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 4.7 M 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 17 M 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 15 k 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 25 k 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 164 k 2024-05-07T11:10:24.383 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 501 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 5.3 M 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-07T11:10:24.384 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 45 k 2024-05-07T11:10:24.385 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 135 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-07T11:10:24.386 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-07T11:10:24.387 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-07T11:10:24.388 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-07T11:10:24.389 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-07T11:10:24.390 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-07T11:10:24.390 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-07T11:10:24.390 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2024-05-07T11:10:24.390 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-07T11:10:24.390 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:10:24.390 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-05-07T11:10:24.390 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2024-05-07T11:10:24.390 INFO:teuthology.orchestra.run.smithi088.stdout:Install 135 Packages 2024-05-07T11:10:24.390 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 4 Packages 2024-05-07T11:10:24.390 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:10:24.391 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 211 M 2024-05-07T11:10:24.391 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-05-07T11:10:24.539 INFO:teuthology.orchestra.run.smithi062.stdout:(8/139): ceph-common-19.0.0-2504.gb05eb275.el9. 11 MB/s | 21 MB 00:01 2024-05-07T11:10:24.590 INFO:teuthology.orchestra.run.smithi062.stdout:(9/139): ceph-selinux-19.0.0-2504.gb05eb275.el9 506 kB/s | 25 kB 00:00 2024-05-07T11:10:24.815 INFO:teuthology.orchestra.run.smithi062.stdout:(10/139): ceph-radosgw-19.0.0-2504.gb05eb275.el 12 MB/s | 10 MB 00:00 2024-05-07T11:10:24.865 INFO:teuthology.orchestra.run.smithi062.stdout:(11/139): libcephfs-devel-19.0.0-2504.gb05eb275 637 kB/s | 32 kB 00:00 2024-05-07T11:10:24.957 INFO:teuthology.orchestra.run.smithi062.stdout:(12/139): libcephfs2-19.0.0-2504.gb05eb275.el9. 8.0 MB/s | 745 kB 00:00 2024-05-07T11:10:25.024 INFO:teuthology.orchestra.run.smithi062.stdout:(13/139): libcephsqlite-19.0.0-2504.gb05eb275.e 2.4 MB/s | 164 kB 00:00 2024-05-07T11:10:25.091 INFO:teuthology.orchestra.run.smithi062.stdout:(14/139): librados-devel-19.0.0-2504.gb05eb275. 1.9 MB/s | 127 kB 00:00 2024-05-07T11:10:25.201 INFO:teuthology.orchestra.run.smithi088.stdout:(1/139): ceph-19.0.0-2504.gb05eb275.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-07T11:10:25.217 INFO:teuthology.orchestra.run.smithi062.stdout:(15/139): libradosstriper1-19.0.0-2504.gb05eb27 3.9 MB/s | 501 kB 00:00 2024-05-07T11:10:25.711 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-07T11:10:25.712 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-07T11:10:25.777 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-05-07T11:10:25.802 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-05-07T11:10:25.802 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-05-07T11:10:25.803 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-05-07T11:10:25.803 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-05-07T11:10:25.803 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-07T11:10:25.803 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 6.6 k 2024-05-07T11:10:25.803 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 5.4 M 2024-05-07T11:10:25.803 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 889 k 2024-05-07T11:10:25.803 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 145 k 2024-05-07T11:10:25.803 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 1.5 M 2024-05-07T11:10:25.803 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 142 k 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 3.5 M 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 7.4 M 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 49 k 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 10 M 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 48 M 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 264 k 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 762 k 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 32 k 2024-05-07T11:10:25.804 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 745 k 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 127 k 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 162 k 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 320 k 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 299 k 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 99 k 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 85 k 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.1 M 2024-05-07T11:10:25.805 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 171 k 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.4 M 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.1 M 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-07T11:10:25.806 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 21 M 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 32 k 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 2.4 M 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 249 k 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 4.7 M 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 17 M 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 15 k 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 25 k 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-07T11:10:25.807 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 164 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 501 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-07T11:10:25.808 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 5.3 M 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-07T11:10:25.809 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 45 k 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 135 k 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-07T11:10:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-07T11:10:25.811 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-07T11:10:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-07T11:10:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-07T11:10:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-07T11:10:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-07T11:10:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-07T11:10:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-07T11:10:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-07T11:10:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-07T11:10:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-07T11:10:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-05-07T11:10:25.815 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-05-07T11:10:25.816 INFO:teuthology.orchestra.run.smithi149.stdout:Install 135 Packages 2024-05-07T11:10:25.816 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 4 Packages 2024-05-07T11:10:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:10:25.816 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 211 M 2024-05-07T11:10:25.816 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-05-07T11:10:25.901 INFO:teuthology.orchestra.run.smithi062.stdout:(16/139): librgw2-19.0.0-2504.gb05eb275.el9.x86 7.8 MB/s | 5.3 MB 00:00 2024-05-07T11:10:26.209 INFO:teuthology.orchestra.run.smithi062.stdout:(17/139): python3-ceph-argparse-19.0.0-2504.gb0 146 kB/s | 45 kB 00:00 2024-05-07T11:10:26.284 INFO:teuthology.orchestra.run.smithi062.stdout:(18/139): python3-ceph-common-19.0.0-2504.gb05e 1.8 MB/s | 135 kB 00:00 2024-05-07T11:10:26.368 INFO:teuthology.orchestra.run.smithi062.stdout:(19/139): python3-cephfs-19.0.0-2504.gb05eb275. 1.9 MB/s | 162 kB 00:00 2024-05-07T11:10:26.461 INFO:teuthology.orchestra.run.smithi062.stdout:(20/139): python3-rados-19.0.0-2504.gb05eb275.e 3.4 MB/s | 320 kB 00:00 2024-05-07T11:10:26.552 INFO:teuthology.orchestra.run.smithi062.stdout:(21/139): python3-rbd-19.0.0-2504.gb05eb275.el9 3.2 MB/s | 299 kB 00:00 2024-05-07T11:10:26.562 INFO:teuthology.orchestra.run.smithi149.stdout:(1/139): ceph-19.0.0-2504.gb05eb275.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-05-07T11:10:26.600 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-07T11:10:26.601 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-07T11:10:26.627 INFO:teuthology.orchestra.run.smithi062.stdout:(22/139): python3-rgw-19.0.0-2504.gb05eb275.el9 1.3 MB/s | 99 kB 00:00 2024-05-07T11:10:26.666 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-05-07T11:10:26.695 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-05-07T11:10:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-05-07T11:10:26.695 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 6.6 k 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 5.4 M 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 889 k 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 145 k 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 1.5 M 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 142 k 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 3.5 M 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 7.4 M 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 49 k 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 10 M 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 48 M 2024-05-07T11:10:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 264 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 762 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 32 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 745 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 127 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 162 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 320 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 299 k 2024-05-07T11:10:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 99 k 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 85 k 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.1 M 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 171 k 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.4 M 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 3.1 M 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-07T11:10:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 21 M 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 32 k 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 2.4 M 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 249 k 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 4.7 M 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 17 M 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2504.gb05eb275.el9 ceph-noarch 15 k 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 25 k 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-07T11:10:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 164 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 501 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 5.3 M 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-07T11:10:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 45 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.0.0-2504.gb05eb275.el9 ceph 135 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-07T11:10:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-07T11:10:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-07T11:10:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-07T11:10:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-07T11:10:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-07T11:10:26.706 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-05-07T11:10:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-07T11:10:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:10:26.706 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-05-07T11:10:26.706 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-05-07T11:10:26.706 INFO:teuthology.orchestra.run.smithi175.stdout:Install 135 Packages 2024-05-07T11:10:26.706 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 4 Packages 2024-05-07T11:10:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:10:26.707 INFO:teuthology.orchestra.run.smithi062.stdout:(23/139): rbd-fuse-19.0.0-2504.gb05eb275.el9.x8 1.1 MB/s | 85 kB 00:00 2024-05-07T11:10:26.707 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 211 M 2024-05-07T11:10:26.707 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-05-07T11:10:27.269 INFO:teuthology.orchestra.run.smithi062.stdout:(24/139): rbd-mirror-19.0.0-2504.gb05eb275.el9. 5.5 MB/s | 3.1 MB 00:00 2024-05-07T11:10:27.317 INFO:teuthology.orchestra.run.smithi175.stdout:(1/139): ceph-19.0.0-2504.gb05eb275.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-07T11:10:27.361 INFO:teuthology.orchestra.run.smithi062.stdout:(25/139): rbd-nbd-19.0.0-2504.gb05eb275.el9.x86 1.8 MB/s | 171 kB 00:00 2024-05-07T11:10:27.445 INFO:teuthology.orchestra.run.smithi062.stdout:(26/139): ceph-grafana-dashboards-19.0.0-2504.g 380 kB/s | 32 kB 00:00 2024-05-07T11:10:27.459 INFO:teuthology.orchestra.run.smithi088.stdout:(2/139): ceph-fuse-19.0.0-2504.gb05eb275.el9.x8 394 kB/s | 889 kB 00:02 2024-05-07T11:10:27.504 INFO:teuthology.orchestra.run.smithi149.stdout:(2/139): ceph-fuse-19.0.0-2504.gb05eb275.el9.x8 944 kB/s | 889 kB 00:00 2024-05-07T11:10:27.520 INFO:teuthology.orchestra.run.smithi062.stdout:(27/139): ceph-mgr-cephadm-19.0.0-2504.gb05eb27 1.8 MB/s | 142 kB 00:00 2024-05-07T11:10:27.679 INFO:teuthology.orchestra.run.smithi149.stdout:(3/139): ceph-immutable-object-cache-19.0.0-250 829 kB/s | 145 kB 00:00 2024-05-07T11:10:27.892 INFO:teuthology.orchestra.run.smithi088.stdout:(3/139): ceph-immutable-object-cache-19.0.0-250 334 kB/s | 145 kB 00:00 2024-05-07T11:10:27.951 INFO:teuthology.orchestra.run.smithi175.stdout:(2/139): ceph-fuse-19.0.0-2504.gb05eb275.el9.x8 1.4 MB/s | 889 kB 00:00 2024-05-07T11:10:28.134 INFO:teuthology.orchestra.run.smithi175.stdout:(3/139): ceph-immutable-object-cache-19.0.0-250 791 kB/s | 145 kB 00:00 2024-05-07T11:10:28.493 INFO:teuthology.orchestra.run.smithi088.stdout:(4/139): ceph-common-19.0.0-2504.gb05eb275.el9. 5.8 MB/s | 21 MB 00:03 2024-05-07T11:10:28.529 INFO:teuthology.orchestra.run.smithi062.stdout:(28/139): ceph-mgr-dashboard-19.0.0-2504.gb05eb 3.5 MB/s | 3.5 MB 00:01 2024-05-07T11:10:28.868 INFO:teuthology.orchestra.run.smithi088.stdout:(5/139): ceph-mgr-19.0.0-2504.gb05eb275.el9.x86 4.0 MB/s | 1.5 MB 00:00 2024-05-07T11:10:29.071 INFO:teuthology.orchestra.run.smithi149.stdout:(4/139): ceph-mds-19.0.0-2504.gb05eb275.el9.x86 1.7 MB/s | 2.4 MB 00:01 2024-05-07T11:10:29.223 INFO:teuthology.orchestra.run.smithi062.stdout:(29/139): ceph-test-19.0.0-2504.gb05eb275.el9.x 10 MB/s | 48 MB 00:04 2024-05-07T11:10:29.363 INFO:teuthology.orchestra.run.smithi062.stdout:(30/139): ceph-mgr-modules-core-19.0.0-2504.gb0 1.7 MB/s | 249 kB 00:00 2024-05-07T11:10:29.518 INFO:teuthology.orchestra.run.smithi088.stdout:(6/139): ceph-base-19.0.0-2504.gb05eb275.el9.x8 1.2 MB/s | 5.4 MB 00:04 2024-05-07T11:10:29.526 INFO:teuthology.orchestra.run.smithi175.stdout:(4/139): ceph-mds-19.0.0-2504.gb05eb275.el9.x86 1.7 MB/s | 2.4 MB 00:01 2024-05-07T11:10:29.537 INFO:teuthology.orchestra.run.smithi149.stdout:(5/139): ceph-mgr-19.0.0-2504.gb05eb275.el9.x86 3.2 MB/s | 1.5 MB 00:00 2024-05-07T11:10:29.577 INFO:teuthology.orchestra.run.smithi088.stdout:(7/139): ceph-mon-19.0.0-2504.gb05eb275.el9.x86 6.6 MB/s | 4.7 MB 00:00 2024-05-07T11:10:29.663 INFO:teuthology.orchestra.run.smithi062.stdout:(31/139): ceph-mgr-rook-19.0.0-2504.gb05eb275.e 164 kB/s | 49 kB 00:00 2024-05-07T11:10:29.679 INFO:teuthology.orchestra.run.smithi149.stdout:(6/139): ceph-base-19.0.0-2504.gb05eb275.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-05-07T11:10:29.772 INFO:teuthology.orchestra.run.smithi062.stdout:(32/139): ceph-prometheus-alerts-19.0.0-2504.gb 141 kB/s | 15 kB 00:00 2024-05-07T11:10:29.910 INFO:teuthology.orchestra.run.smithi175.stdout:(5/139): ceph-base-19.0.0-2504.gb05eb275.el9.x8 1.8 MB/s | 5.4 MB 00:02 2024-05-07T11:10:29.922 INFO:teuthology.orchestra.run.smithi062.stdout:(33/139): ceph-volume-19.0.0-2504.gb05eb275.el9 1.7 MB/s | 264 kB 00:00 2024-05-07T11:10:30.339 INFO:teuthology.orchestra.run.smithi062.stdout:(34/139): cephadm-19.0.0-2504.gb05eb275.el9.noa 1.8 MB/s | 762 kB 00:00 2024-05-07T11:10:30.451 INFO:teuthology.orchestra.run.smithi175.stdout:(6/139): ceph-mgr-19.0.0-2504.gb05eb275.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-05-07T11:10:30.573 INFO:teuthology.orchestra.run.smithi062.stdout:(35/139): ceph-mgr-diskprediction-local-19.0.0- 3.6 MB/s | 7.4 MB 00:02 2024-05-07T11:10:30.746 INFO:teuthology.orchestra.run.smithi149.stdout:(7/139): ceph-mon-19.0.0-2504.gb05eb275.el9.x86 3.9 MB/s | 4.7 MB 00:01 2024-05-07T11:10:30.764 INFO:teuthology.orchestra.run.smithi062.stdout:(36/139): fuse-2.9.9-15.el9.x86_64.rpm 189 kB/s | 80 kB 00:00 2024-05-07T11:10:30.818 INFO:teuthology.orchestra.run.smithi175.stdout:(7/139): ceph-mon-19.0.0-2504.gb05eb275.el9.x86 5.2 MB/s | 4.7 MB 00:00 2024-05-07T11:10:30.948 INFO:teuthology.orchestra.run.smithi062.stdout:(37/139): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-05-07T11:10:31.056 INFO:teuthology.orchestra.run.smithi062.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-05-07T11:10:31.340 INFO:teuthology.orchestra.run.smithi062.stdout:(39/139): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-05-07T11:10:31.407 INFO:teuthology.orchestra.run.smithi062.stdout:(40/139): libgfortran-11.4.1-3.el9.x86_64.rpm 963 kB/s | 803 kB 00:00 2024-05-07T11:10:31.449 INFO:teuthology.orchestra.run.smithi062.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 982 kB/s | 106 kB 00:00 2024-05-07T11:10:31.507 INFO:teuthology.orchestra.run.smithi062.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-05-07T11:10:31.558 INFO:teuthology.orchestra.run.smithi062.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-05-07T11:10:31.616 INFO:teuthology.orchestra.run.smithi062.stdout:(44/139): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-05-07T11:10:31.733 INFO:teuthology.orchestra.run.smithi062.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-05-07T11:10:31.775 INFO:teuthology.orchestra.run.smithi062.stdout:(46/139): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-05-07T11:10:31.826 INFO:teuthology.orchestra.run.smithi062.stdout:(47/139): elfutils-libelf-devel-0.190-2.el9.x86 431 kB/s | 21 kB 00:00 2024-05-07T11:10:31.868 INFO:teuthology.orchestra.run.smithi062.stdout:(48/139): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-05-07T11:10:31.885 INFO:teuthology.orchestra.run.smithi088.stdout:(8/139): ceph-radosgw-19.0.0-2504.gb05eb275.el9 4.4 MB/s | 10 MB 00:02 2024-05-07T11:10:31.892 INFO:teuthology.orchestra.run.smithi062.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-05-07T11:10:31.918 INFO:teuthology.orchestra.run.smithi062.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-05-07T11:10:31.952 INFO:teuthology.orchestra.run.smithi088.stdout:(9/139): ceph-selinux-19.0.0-2504.gb05eb275.el9 379 kB/s | 25 kB 00:00 2024-05-07T11:10:31.960 INFO:teuthology.orchestra.run.smithi062.stdout:(51/139): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-05-07T11:10:32.027 INFO:teuthology.orchestra.run.smithi062.stdout:(52/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-05-07T11:10:32.052 INFO:teuthology.orchestra.run.smithi062.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-05-07T11:10:32.078 INFO:teuthology.orchestra.run.smithi062.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-05-07T11:10:32.103 INFO:teuthology.orchestra.run.smithi062.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-05-07T11:10:32.137 INFO:teuthology.orchestra.run.smithi062.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-05-07T11:10:32.160 INFO:teuthology.orchestra.run.smithi088.stdout:(10/139): ceph-mds-19.0.0-2504.gb05eb275.el9.x8 567 kB/s | 2.4 MB 00:04 2024-05-07T11:10:32.162 INFO:teuthology.orchestra.run.smithi062.stdout:(57/139): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 582 kB 00:00 2024-05-07T11:10:32.187 INFO:teuthology.orchestra.run.smithi062.stdout:(58/139): libuuid-devel-2.37.4-18.el9.x86_64.rp 508 kB/s | 25 kB 00:00 2024-05-07T11:10:32.212 INFO:teuthology.orchestra.run.smithi062.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-05-07T11:10:32.238 INFO:teuthology.orchestra.run.smithi062.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-05-07T11:10:32.263 INFO:teuthology.orchestra.run.smithi062.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-05-07T11:10:32.268 INFO:teuthology.orchestra.run.smithi175.stdout:(8/139): ceph-radosgw-19.0.0-2504.gb05eb275.el9 7.1 MB/s | 10 MB 00:01 2024-05-07T11:10:32.288 INFO:teuthology.orchestra.run.smithi062.stdout:(62/139): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-05-07T11:10:32.394 INFO:teuthology.orchestra.run.smithi175.stdout:(9/139): ceph-selinux-19.0.0-2504.gb05eb275.el9 202 kB/s | 25 kB 00:00 2024-05-07T11:10:32.472 INFO:teuthology.orchestra.run.smithi062.stdout:(63/139): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-05-07T11:10:32.531 INFO:teuthology.orchestra.run.smithi062.stdout:(64/139): openssl-devel-3.2.1-1.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-05-07T11:10:32.535 INFO:teuthology.orchestra.run.smithi088.stdout:(11/139): libcephfs-devel-19.0.0-2504.gb05eb275 85 kB/s | 32 kB 00:00 2024-05-07T11:10:32.572 INFO:teuthology.orchestra.run.smithi062.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-05-07T11:10:32.623 INFO:teuthology.orchestra.run.smithi062.stdout:(66/139): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-05-07T11:10:32.715 INFO:teuthology.orchestra.run.smithi062.stdout:(67/139): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 6.0 MB 00:00 2024-05-07T11:10:32.730 INFO:teuthology.orchestra.run.smithi149.stdout:(8/139): ceph-radosgw-19.0.0-2504.gb05eb275.el9 5.2 MB/s | 10 MB 00:01 2024-05-07T11:10:32.740 INFO:teuthology.orchestra.run.smithi062.stdout:(68/139): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-05-07T11:10:32.757 INFO:teuthology.orchestra.run.smithi062.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 612 kB/s | 26 kB 00:00 2024-05-07T11:10:32.774 INFO:teuthology.orchestra.run.smithi062.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 571 kB/s | 19 kB 00:00 2024-05-07T11:10:32.807 INFO:teuthology.orchestra.run.smithi062.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-05-07T11:10:32.824 INFO:teuthology.orchestra.run.smithi062.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 689 kB/s | 35 kB 00:00 2024-05-07T11:10:32.838 INFO:teuthology.orchestra.run.smithi149.stdout:(9/139): ceph-selinux-19.0.0-2504.gb05eb275.el9 233 kB/s | 25 kB 00:00 2024-05-07T11:10:32.875 INFO:teuthology.orchestra.run.smithi062.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-05-07T11:10:32.942 INFO:teuthology.orchestra.run.smithi062.stdout:(74/139): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-07T11:10:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:(75/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-05-07T11:10:33.034 INFO:teuthology.orchestra.run.smithi062.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 839 kB/s | 77 kB 00:00 2024-05-07T11:10:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-05-07T11:10:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-05-07T11:10:33.143 INFO:teuthology.orchestra.run.smithi062.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-05-07T11:10:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-07T11:10:33.202 INFO:teuthology.orchestra.run.smithi062.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-05-07T11:10:33.218 INFO:teuthology.orchestra.run.smithi062.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-05-07T11:10:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:(83/139): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-05-07T11:10:33.311 INFO:teuthology.orchestra.run.smithi062.stdout:(84/139): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-07T11:10:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:(85/139): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-05-07T11:10:33.445 INFO:teuthology.orchestra.run.smithi062.stdout:(86/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-05-07T11:10:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:(87/139): ceph-osd-19.0.0-2504.gb05eb275.el9.x8 1.7 MB/s | 17 MB 00:09 2024-05-07T11:10:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:(88/139): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-05-07T11:10:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:(89/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-07T11:10:33.754 INFO:teuthology.orchestra.run.smithi062.stdout:(90/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 769 kB/s | 45 kB 00:00 2024-05-07T11:10:33.794 INFO:teuthology.orchestra.run.smithi175.stdout:(10/139): ceph-common-19.0.0-2504.gb05eb275.el9 3.1 MB/s | 21 MB 00:06 2024-05-07T11:10:33.819 INFO:teuthology.orchestra.run.smithi088.stdout:(12/139): libcephfs2-19.0.0-2504.gb05eb275.el9. 581 kB/s | 745 kB 00:01 2024-05-07T11:10:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:(11/139): libcephfs-devel-19.0.0-2504.gb05eb275 547 kB/s | 32 kB 00:00 2024-05-07T11:10:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:(91/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-05-07T11:10:33.997 INFO:teuthology.orchestra.run.smithi062.stdout:(92/139): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 239 kB/s | 94 kB 00:00 2024-05-07T11:10:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:(93/139): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-05-07T11:10:34.061 INFO:teuthology.orchestra.run.smithi175.stdout:(12/139): libcephfs2-19.0.0-2504.gb05eb275.el9. 3.5 MB/s | 745 kB 00:00 2024-05-07T11:10:34.119 INFO:teuthology.orchestra.run.smithi088.stdout:(13/139): libcephsqlite-19.0.0-2504.gb05eb275.e 546 kB/s | 164 kB 00:00 2024-05-07T11:10:34.128 INFO:teuthology.orchestra.run.smithi175.stdout:(13/139): libcephsqlite-19.0.0-2504.gb05eb275.e 2.4 MB/s | 164 kB 00:00 2024-05-07T11:10:34.187 INFO:teuthology.orchestra.run.smithi175.stdout:(14/139): librados-devel-19.0.0-2504.gb05eb275. 2.1 MB/s | 127 kB 00:00 2024-05-07T11:10:34.289 INFO:teuthology.orchestra.run.smithi062.stdout:(94/139): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.1 MB/s | 309 kB 00:00 2024-05-07T11:10:34.295 INFO:teuthology.orchestra.run.smithi175.stdout:(15/139): libradosstriper1-19.0.0-2504.gb05eb27 4.5 MB/s | 501 kB 00:00 2024-05-07T11:10:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:(95/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 1.6 MB/s | 548 kB 00:00 2024-05-07T11:10:34.373 INFO:teuthology.orchestra.run.smithi062.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 234 kB/s | 19 kB 00:00 2024-05-07T11:10:34.378 INFO:teuthology.orchestra.run.smithi088.stdout:(14/139): librados-devel-19.0.0-2504.gb05eb275. 491 kB/s | 127 kB 00:00 2024-05-07T11:10:35.040 INFO:teuthology.orchestra.run.smithi062.stdout:(97/139): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-05-07T11:10:35.065 INFO:teuthology.orchestra.run.smithi062.stdout:(98/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 38 kB/s | 26 kB 00:00 2024-05-07T11:10:35.079 INFO:teuthology.orchestra.run.smithi175.stdout:(16/139): librgw2-19.0.0-2504.gb05eb275.el9.x86 6.8 MB/s | 5.3 MB 00:00 2024-05-07T11:10:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:(99/139): liboath-2.6.7-2.el9.x86_64.rpm 833 kB/s | 49 kB 00:00 2024-05-07T11:10:35.121 INFO:teuthology.orchestra.run.smithi175.stdout:(17/139): python3-ceph-argparse-19.0.0-2504.gb0 1.1 MB/s | 45 kB 00:00 2024-05-07T11:10:35.124 INFO:teuthology.orchestra.run.smithi062.stdout:(100/139): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-07T11:10:35.172 INFO:teuthology.orchestra.run.smithi175.stdout:(18/139): python3-ceph-common-19.0.0-2504.gb05e 2.6 MB/s | 135 kB 00:00 2024-05-07T11:10:35.190 INFO:teuthology.orchestra.run.smithi062.stdout:(101/139): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-05-07T11:10:35.230 INFO:teuthology.orchestra.run.smithi175.stdout:(19/139): python3-cephfs-19.0.0-2504.gb05eb275. 2.7 MB/s | 162 kB 00:00 2024-05-07T11:10:35.266 INFO:teuthology.orchestra.run.smithi062.stdout:(102/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-05-07T11:10:35.321 INFO:teuthology.orchestra.run.smithi175.stdout:(20/139): python3-rados-19.0.0-2504.gb05eb275.e 3.4 MB/s | 320 kB 00:00 2024-05-07T11:10:35.324 INFO:teuthology.orchestra.run.smithi062.stdout:(103/139): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-05-07T11:10:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:(104/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-05-07T11:10:35.376 INFO:teuthology.orchestra.run.smithi062.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-05-07T11:10:35.380 INFO:teuthology.orchestra.run.smithi175.stdout:(21/139): python3-rbd-19.0.0-2504.gb05eb275.el9 5.0 MB/s | 299 kB 00:00 2024-05-07T11:10:35.425 INFO:teuthology.orchestra.run.smithi062.stdout:(106/139): python3-certifi-2021.10.8-2.el9.noar 200 kB/s | 15 kB 00:00 2024-05-07T11:10:35.430 INFO:teuthology.orchestra.run.smithi175.stdout:(22/139): python3-rgw-19.0.0-2504.gb05eb275.el9 1.9 MB/s | 99 kB 00:00 2024-05-07T11:10:35.450 INFO:teuthology.orchestra.run.smithi062.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 2.3 MB/s | 172 kB 00:00 2024-05-07T11:10:35.473 INFO:teuthology.orchestra.run.smithi175.stdout:(23/139): rbd-fuse-19.0.0-2504.gb05eb275.el9.x8 2.0 MB/s | 85 kB 00:00 2024-05-07T11:10:35.475 INFO:teuthology.orchestra.run.smithi062.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 7.1 MB/s | 358 kB 00:00 2024-05-07T11:10:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:(109/139): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-05-07T11:10:35.768 INFO:teuthology.orchestra.run.smithi062.stdout:(110/139): python3-grpcio-1.46.7-10.el9.x86_64. 7.0 MB/s | 2.0 MB 00:00 2024-05-07T11:10:35.769 INFO:teuthology.orchestra.run.smithi088.stdout:(15/139): libradosstriper1-19.0.0-2504.gb05eb27 360 kB/s | 501 kB 00:01 2024-05-07T11:10:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:(111/139): python3-grpcio-tools-1.46.7-10.el9.x 495 kB/s | 144 kB 00:00 2024-05-07T11:10:35.818 INFO:teuthology.orchestra.run.smithi062.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-05-07T11:10:35.848 INFO:teuthology.orchestra.run.smithi175.stdout:(24/139): rbd-mirror-19.0.0-2504.gb05eb275.el9. 8.2 MB/s | 3.1 MB 00:00 2024-05-07T11:10:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 301 kB/s | 18 kB 00:00 2024-05-07T11:10:35.869 INFO:teuthology.orchestra.run.smithi062.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-05-07T11:10:35.889 INFO:teuthology.orchestra.run.smithi175.stdout:(25/139): rbd-nbd-19.0.0-2504.gb05eb275.el9.x86 4.0 MB/s | 171 kB 00:00 2024-05-07T11:10:35.894 INFO:teuthology.orchestra.run.smithi062.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 464 kB/s | 19 kB 00:00 2024-05-07T11:10:35.912 INFO:teuthology.orchestra.run.smithi062.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 467 kB/s | 20 kB 00:00 2024-05-07T11:10:36.037 INFO:teuthology.orchestra.run.smithi062.stdout:(117/139): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-05-07T11:10:36.048 INFO:teuthology.orchestra.run.smithi175.stdout:(26/139): ceph-osd-19.0.0-2504.gb05eb275.el9.x8 3.0 MB/s | 17 MB 00:05 2024-05-07T11:10:36.053 INFO:teuthology.orchestra.run.smithi062.stdout:(118/139): python3-logutils-0.3.5-21.el9.noarch 326 kB/s | 46 kB 00:00 2024-05-07T11:10:36.065 INFO:teuthology.orchestra.run.smithi175.stdout:(27/139): ceph-grafana-dashboards-19.0.0-2504.g 181 kB/s | 32 kB 00:00 2024-05-07T11:10:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:(119/139): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-05-07T11:10:36.099 INFO:teuthology.orchestra.run.smithi175.stdout:(28/139): ceph-mgr-cephadm-19.0.0-2504.gb05eb27 2.8 MB/s | 142 kB 00:00 2024-05-07T11:10:36.104 INFO:teuthology.orchestra.run.smithi062.stdout:(120/139): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-07T11:10:36.188 INFO:teuthology.orchestra.run.smithi062.stdout:(121/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-05-07T11:10:36.204 INFO:teuthology.orchestra.run.smithi062.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-05-07T11:10:36.246 INFO:teuthology.orchestra.run.smithi062.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-07T11:10:36.264 INFO:teuthology.orchestra.run.smithi062.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2024-05-07T11:10:36.297 INFO:teuthology.orchestra.run.smithi062.stdout:(125/139): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-05-07T11:10:36.314 INFO:teuthology.orchestra.run.smithi062.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-05-07T11:10:36.339 INFO:teuthology.orchestra.run.smithi062.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 856 kB/s | 36 kB 00:00 2024-05-07T11:10:36.356 INFO:teuthology.orchestra.run.smithi062.stdout:(128/139): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2024-05-07T11:10:36.423 INFO:teuthology.orchestra.run.smithi062.stdout:(129/139): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-07T11:10:36.448 INFO:teuthology.orchestra.run.smithi062.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 976 kB/s | 90 kB 00:00 2024-05-07T11:10:36.482 INFO:teuthology.orchestra.run.smithi062.stdout:(131/139): python3-werkzeug-2.0.3-3.el9.1.noarc 7.2 MB/s | 427 kB 00:00 2024-05-07T11:10:36.499 INFO:teuthology.orchestra.run.smithi062.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-05-07T11:10:36.541 INFO:teuthology.orchestra.run.smithi175.stdout:(29/139): ceph-mgr-dashboard-19.0.0-2504.gb05eb 7.4 MB/s | 3.5 MB 00:00 2024-05-07T11:10:36.549 INFO:teuthology.orchestra.run.smithi062.stdout:(133/139): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-05-07T11:10:36.599 INFO:teuthology.orchestra.run.smithi175.stdout:(30/139): ceph-mgr-modules-core-19.0.0-2504.gb0 4.2 MB/s | 249 kB 00:00 2024-05-07T11:10:36.616 INFO:teuthology.orchestra.run.smithi062.stdout:(134/139): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-05-07T11:10:36.650 INFO:teuthology.orchestra.run.smithi175.stdout:(31/139): ceph-mgr-rook-19.0.0-2504.gb05eb275.e 988 kB/s | 49 kB 00:00 2024-05-07T11:10:36.941 INFO:teuthology.orchestra.run.smithi175.stdout:(32/139): ceph-prometheus-alerts-19.0.0-2504.gb 53 kB/s | 15 kB 00:00 2024-05-07T11:10:37.042 INFO:teuthology.orchestra.run.smithi175.stdout:(33/139): ceph-volume-19.0.0-2504.gb05eb275.el9 2.6 MB/s | 264 kB 00:00 2024-05-07T11:10:37.217 INFO:teuthology.orchestra.run.smithi175.stdout:(34/139): cephadm-19.0.0-2504.gb05eb275.el9.noa 4.3 MB/s | 762 kB 00:00 2024-05-07T11:10:37.526 INFO:teuthology.orchestra.run.smithi175.stdout:(35/139): ceph-mgr-diskprediction-local-19.0.0- 5.2 MB/s | 7.4 MB 00:01 2024-05-07T11:10:37.533 INFO:teuthology.orchestra.run.smithi062.stdout:(135/139): librbd1-19.0.0-2504.gb05eb275.el9.x8 3.4 MB/s | 3.1 MB 00:00 2024-05-07T11:10:37.802 INFO:teuthology.orchestra.run.smithi175.stdout:(36/139): fuse-2.9.9-15.el9.x86_64.rpm 138 kB/s | 80 kB 00:00 2024-05-07T11:10:38.076 INFO:teuthology.orchestra.run.smithi175.stdout:(37/139): libquadmath-11.4.1-3.el9.x86_64.rpm 710 kB/s | 195 kB 00:00 2024-05-07T11:10:38.442 INFO:teuthology.orchestra.run.smithi062.stdout:(136/139): openssl-3.2.1-1.el9.x86_64.rpm 1.5 MB/s | 1.3 MB 00:00 2024-05-07T11:10:38.696 INFO:teuthology.orchestra.run.smithi149.stdout:(10/139): ceph-test-19.0.0-2504.gb05eb275.el9.x 8.2 MB/s | 48 MB 00:05 2024-05-07T11:10:38.738 INFO:teuthology.orchestra.run.smithi149.stdout:(11/139): libcephfs-devel-19.0.0-2504.gb05eb275 770 kB/s | 32 kB 00:00 2024-05-07T11:10:38.830 INFO:teuthology.orchestra.run.smithi149.stdout:(12/139): libcephfs2-19.0.0-2504.gb05eb275.el9. 7.9 MB/s | 745 kB 00:00 2024-05-07T11:10:38.872 INFO:teuthology.orchestra.run.smithi149.stdout:(13/139): libcephsqlite-19.0.0-2504.gb05eb275.e 3.8 MB/s | 164 kB 00:00 2024-05-07T11:10:38.893 INFO:teuthology.orchestra.run.smithi175.stdout:(38/139): libgfortran-11.4.1-3.el9.x86_64.rpm 587 kB/s | 803 kB 00:01 2024-05-07T11:10:38.914 INFO:teuthology.orchestra.run.smithi149.stdout:(14/139): librados-devel-19.0.0-2504.gb05eb275. 3.0 MB/s | 127 kB 00:00 2024-05-07T11:10:38.952 INFO:teuthology.orchestra.run.smithi175.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 289 kB/s | 253 kB 00:00 2024-05-07T11:10:38.981 INFO:teuthology.orchestra.run.smithi149.stdout:(15/139): libradosstriper1-19.0.0-2504.gb05eb27 7.4 MB/s | 501 kB 00:00 2024-05-07T11:10:39.094 INFO:teuthology.orchestra.run.smithi175.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 752 kB/s | 106 kB 00:00 2024-05-07T11:10:39.227 INFO:teuthology.orchestra.run.smithi175.stdout:(41/139): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-05-07T11:10:39.353 INFO:teuthology.orchestra.run.smithi088.stdout:(16/139): ceph-test-19.0.0-2504.gb05eb275.el9.x 6.5 MB/s | 48 MB 00:07 2024-05-07T11:10:39.369 INFO:teuthology.orchestra.run.smithi175.stdout:(42/139): python3-requests-2.25.1-8.el9.noarch. 882 kB/s | 125 kB 00:00 2024-05-07T11:10:39.381 INFO:teuthology.orchestra.run.smithi149.stdout:(16/139): librgw2-19.0.0-2504.gb05eb275.el9.x86 13 MB/s | 5.3 MB 00:00 2024-05-07T11:10:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:(17/139): python3-ceph-argparse-19.0.0-2504.gb0 911 kB/s | 45 kB 00:00 2024-05-07T11:10:39.423 INFO:teuthology.orchestra.run.smithi149.stdout:(17/139): python3-ceph-argparse-19.0.0-2504.gb0 1.1 MB/s | 45 kB 00:00 2024-05-07T11:10:39.470 INFO:teuthology.orchestra.run.smithi088.stdout:(18/139): python3-ceph-common-19.0.0-2504.gb05e 2.0 MB/s | 135 kB 00:00 2024-05-07T11:10:39.473 INFO:teuthology.orchestra.run.smithi149.stdout:(18/139): python3-ceph-common-19.0.0-2504.gb05e 2.6 MB/s | 135 kB 00:00 2024-05-07T11:10:39.503 INFO:teuthology.orchestra.run.smithi175.stdout:(43/139): python3-urllib3-1.26.5-5.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-05-07T11:10:39.515 INFO:teuthology.orchestra.run.smithi149.stdout:(19/139): python3-cephfs-19.0.0-2504.gb05eb275. 3.8 MB/s | 162 kB 00:00 2024-05-07T11:10:39.520 INFO:teuthology.orchestra.run.smithi088.stdout:(19/139): python3-cephfs-19.0.0-2504.gb05eb275. 3.2 MB/s | 162 kB 00:00 2024-05-07T11:10:39.574 INFO:teuthology.orchestra.run.smithi149.stdout:(20/139): python3-rados-19.0.0-2504.gb05eb275.e 5.4 MB/s | 320 kB 00:00 2024-05-07T11:10:39.587 INFO:teuthology.orchestra.run.smithi088.stdout:(20/139): python3-rados-19.0.0-2504.gb05eb275.e 4.7 MB/s | 320 kB 00:00 2024-05-07T11:10:39.624 INFO:teuthology.orchestra.run.smithi149.stdout:(21/139): python3-rbd-19.0.0-2504.gb05eb275.el9 5.9 MB/s | 299 kB 00:00 2024-05-07T11:10:39.654 INFO:teuthology.orchestra.run.smithi088.stdout:(21/139): python3-rbd-19.0.0-2504.gb05eb275.el9 4.4 MB/s | 299 kB 00:00 2024-05-07T11:10:39.666 INFO:teuthology.orchestra.run.smithi149.stdout:(22/139): python3-rgw-19.0.0-2504.gb05eb275.el9 2.3 MB/s | 99 kB 00:00 2024-05-07T11:10:39.716 INFO:teuthology.orchestra.run.smithi149.stdout:(23/139): rbd-fuse-19.0.0-2504.gb05eb275.el9.x8 1.7 MB/s | 85 kB 00:00 2024-05-07T11:10:39.792 INFO:teuthology.orchestra.run.smithi062.stdout:(137/139): librados2-19.0.0-2504.gb05eb275.el9. 1.0 MB/s | 3.4 MB 00:03 2024-05-07T11:10:39.937 INFO:teuthology.orchestra.run.smithi088.stdout:(22/139): python3-rgw-19.0.0-2504.gb05eb275.el9 351 kB/s | 99 kB 00:00 2024-05-07T11:10:39.950 INFO:teuthology.orchestra.run.smithi149.stdout:(24/139): rbd-mirror-19.0.0-2504.gb05eb275.el9. 13 MB/s | 3.1 MB 00:00 2024-05-07T11:10:39.979 INFO:teuthology.orchestra.run.smithi088.stdout:(23/139): rbd-fuse-19.0.0-2504.gb05eb275.el9.x8 2.0 MB/s | 85 kB 00:00 2024-05-07T11:10:40.000 INFO:teuthology.orchestra.run.smithi149.stdout:(25/139): rbd-nbd-19.0.0-2504.gb05eb275.el9.x86 3.3 MB/s | 171 kB 00:00 2024-05-07T11:10:40.034 INFO:teuthology.orchestra.run.smithi149.stdout:(26/139): ceph-grafana-dashboards-19.0.0-2504.g 955 kB/s | 32 kB 00:00 2024-05-07T11:10:40.084 INFO:teuthology.orchestra.run.smithi149.stdout:(27/139): ceph-mgr-cephadm-19.0.0-2504.gb05eb27 2.8 MB/s | 142 kB 00:00 2024-05-07T11:10:40.271 INFO:teuthology.orchestra.run.smithi088.stdout:(24/139): rbd-mirror-19.0.0-2504.gb05eb275.el9. 11 MB/s | 3.1 MB 00:00 2024-05-07T11:10:40.322 INFO:teuthology.orchestra.run.smithi088.stdout:(25/139): rbd-nbd-19.0.0-2504.gb05eb275.el9.x86 3.4 MB/s | 171 kB 00:00 2024-05-07T11:10:40.372 INFO:teuthology.orchestra.run.smithi088.stdout:(26/139): ceph-grafana-dashboards-19.0.0-2504.g 638 kB/s | 32 kB 00:00 2024-05-07T11:10:40.376 INFO:teuthology.orchestra.run.smithi149.stdout:(28/139): ceph-mgr-dashboard-19.0.0-2504.gb05eb 12 MB/s | 3.5 MB 00:00 2024-05-07T11:10:40.414 INFO:teuthology.orchestra.run.smithi088.stdout:(27/139): ceph-mgr-cephadm-19.0.0-2504.gb05eb27 3.3 MB/s | 142 kB 00:00 2024-05-07T11:10:40.461 INFO:teuthology.orchestra.run.smithi175.stdout:(44/139): automake-1.16.2-8.el9.noarch.rpm 719 kB/s | 689 kB 00:00 2024-05-07T11:10:40.722 INFO:teuthology.orchestra.run.smithi088.stdout:(28/139): ceph-mgr-dashboard-19.0.0-2504.gb05eb 11 MB/s | 3.5 MB 00:00 2024-05-07T11:10:41.095 INFO:teuthology.orchestra.run.smithi175.stdout:(45/139): python3-cryptography-36.0.1-4.el9.x86 570 kB/s | 1.2 MB 00:02 2024-05-07T11:10:41.233 INFO:teuthology.orchestra.run.smithi062.stdout:(138/139): protobuf-compiler-3.14.0-13.el9.x86_ 119 kB/s | 863 kB 00:07 2024-05-07T11:10:41.412 INFO:teuthology.orchestra.run.smithi175.stdout:(46/139): boost-program-options-1.75.0-8.el9.x8 337 kB/s | 107 kB 00:00 2024-05-07T11:10:41.445 INFO:teuthology.orchestra.run.smithi175.stdout:(47/139): bison-3.7.4-5.el9.x86_64.rpm 959 kB/s | 943 kB 00:00 2024-05-07T11:10:41.485 INFO:teuthology.orchestra.run.smithi149.stdout:(29/139): ceph-mgr-diskprediction-local-19.0.0- 6.7 MB/s | 7.4 MB 00:01 2024-05-07T11:10:41.512 INFO:teuthology.orchestra.run.smithi175.stdout:(48/139): elfutils-libelf-devel-0.190-2.el9.x86 215 kB/s | 21 kB 00:00 2024-05-07T11:10:41.535 INFO:teuthology.orchestra.run.smithi149.stdout:(30/139): ceph-mgr-modules-core-19.0.0-2504.gb0 4.9 MB/s | 249 kB 00:00 2024-05-07T11:10:41.577 INFO:teuthology.orchestra.run.smithi149.stdout:(31/139): ceph-mgr-rook-19.0.0-2504.gb05eb275.e 1.2 MB/s | 49 kB 00:00 2024-05-07T11:10:41.619 INFO:teuthology.orchestra.run.smithi149.stdout:(32/139): ceph-prometheus-alerts-19.0.0-2504.gb 367 kB/s | 15 kB 00:00 2024-05-07T11:10:41.629 INFO:teuthology.orchestra.run.smithi175.stdout:(49/139): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-05-07T11:10:41.664 INFO:teuthology.orchestra.run.smithi088.stdout:(29/139): ceph-mgr-diskprediction-local-19.0.0- 7.9 MB/s | 7.4 MB 00:00 2024-05-07T11:10:41.714 INFO:teuthology.orchestra.run.smithi088.stdout:(30/139): ceph-mgr-modules-core-19.0.0-2504.gb0 4.9 MB/s | 249 kB 00:00 2024-05-07T11:10:41.756 INFO:teuthology.orchestra.run.smithi088.stdout:(31/139): ceph-mgr-rook-19.0.0-2504.gb05eb275.e 1.2 MB/s | 49 kB 00:00 2024-05-07T11:10:41.779 INFO:teuthology.orchestra.run.smithi175.stdout:(50/139): flex-2.6.4-9.el9.x86_64.rpm 940 kB/s | 313 kB 00:00 2024-05-07T11:10:41.807 INFO:teuthology.orchestra.run.smithi088.stdout:(32/139): ceph-prometheus-alerts-19.0.0-2504.gb 308 kB/s | 15 kB 00:00 2024-05-07T11:10:41.865 INFO:teuthology.orchestra.run.smithi088.stdout:(33/139): ceph-volume-19.0.0-2504.gb05eb275.el9 4.4 MB/s | 264 kB 00:00 2024-05-07T11:10:41.911 INFO:teuthology.orchestra.run.smithi149.stdout:(33/139): ceph-volume-19.0.0-2504.gb05eb275.el9 904 kB/s | 264 kB 00:00 2024-05-07T11:10:41.913 INFO:teuthology.orchestra.run.smithi175.stdout:(51/139): flexiblas-openblas-openmp-3.0.4-8.el9 136 kB/s | 18 kB 00:00 2024-05-07T11:10:41.966 INFO:teuthology.orchestra.run.smithi088.stdout:(34/139): cephadm-19.0.0-2504.gb05eb275.el9.noa 7.5 MB/s | 762 kB 00:00 2024-05-07T11:10:42.011 INFO:teuthology.orchestra.run.smithi149.stdout:(34/139): cephadm-19.0.0-2504.gb05eb275.el9.noa 7.5 MB/s | 762 kB 00:00 2024-05-07T11:10:42.038 INFO:teuthology.orchestra.run.smithi175.stdout:(52/139): libaio-devel-0.3.111-13.el9.x86_64.rp 89 kB/s | 11 kB 00:00 2024-05-07T11:10:42.416 INFO:teuthology.orchestra.run.smithi088.stdout:(35/139): fuse-2.9.9-15.el9.x86_64.rpm 179 kB/s | 80 kB 00:00 2024-05-07T11:10:42.480 INFO:teuthology.orchestra.run.smithi175.stdout:(53/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 363 kB/s | 160 kB 00:00 2024-05-07T11:10:42.578 INFO:teuthology.orchestra.run.smithi149.stdout:(35/139): fuse-2.9.9-15.el9.x86_64.rpm 142 kB/s | 80 kB 00:00 2024-05-07T11:10:42.605 INFO:teuthology.orchestra.run.smithi175.stdout:(54/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 362 kB/s | 45 kB 00:00 2024-05-07T11:10:42.991 INFO:teuthology.orchestra.run.smithi088.stdout:(36/139): libgfortran-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 803 kB 00:00 2024-05-07T11:10:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:(36/139): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 803 kB 00:00 2024-05-07T11:10:43.099 INFO:teuthology.orchestra.run.smithi088.stdout:(37/139): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-05-07T11:10:43.204 INFO:teuthology.orchestra.run.smithi149.stdout:(37/139): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-05-07T11:10:43.208 INFO:teuthology.orchestra.run.smithi088.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-05-07T11:10:43.312 INFO:teuthology.orchestra.run.smithi149.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-05-07T11:10:43.492 INFO:teuthology.orchestra.run.smithi088.stdout:(39/139): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-05-07T11:10:43.531 INFO:teuthology.orchestra.run.smithi175.stdout:(55/139): librdkafka-1.6.1-102.el9.x86_64.rpm 716 kB/s | 662 kB 00:00 2024-05-07T11:10:43.601 INFO:teuthology.orchestra.run.smithi088.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 985 kB/s | 106 kB 00:00 2024-05-07T11:10:43.709 INFO:teuthology.orchestra.run.smithi088.stdout:(41/139): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-05-07T11:10:43.813 INFO:teuthology.orchestra.run.smithi149.stdout:(39/139): python3-cryptography-36.0.1-4.el9.x86 2.5 MB/s | 1.2 MB 00:00 2024-05-07T11:10:43.818 INFO:teuthology.orchestra.run.smithi088.stdout:(42/139): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-05-07T11:10:43.875 INFO:teuthology.orchestra.run.smithi062.stdout:(139/139): openssl-libs-3.2.1-1.el9.x86_64.rpm 451 kB/s | 2.4 MB 00:05 2024-05-07T11:10:43.881 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-07T11:10:43.881 INFO:teuthology.orchestra.run.smithi062.stdout:Total 9.7 MB/s | 211 MB 00:21 2024-05-07T11:10:43.922 INFO:teuthology.orchestra.run.smithi149.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 985 kB/s | 106 kB 00:00 2024-05-07T11:10:43.927 INFO:teuthology.orchestra.run.smithi088.stdout:(43/139): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-05-07T11:10:44.022 INFO:teuthology.orchestra.run.smithi149.stdout:(41/139): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-05-07T11:10:44.119 INFO:teuthology.orchestra.run.smithi088.stdout:(44/139): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-05-07T11:10:44.131 INFO:teuthology.orchestra.run.smithi149.stdout:(42/139): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-05-07T11:10:44.247 INFO:teuthology.orchestra.run.smithi149.stdout:(43/139): python3-urllib3-1.26.5-5.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-05-07T11:10:44.252 INFO:teuthology.orchestra.run.smithi088.stdout:(45/139): bison-3.7.4-5.el9.x86_64.rpm 6.9 MB/s | 943 kB 00:00 2024-05-07T11:10:44.369 INFO:teuthology.orchestra.run.smithi088.stdout:(46/139): boost-program-options-1.75.0-8.el9.x8 917 kB/s | 107 kB 00:00 2024-05-07T11:10:44.456 INFO:teuthology.orchestra.run.smithi175.stdout:(56/139): libtool-2.4.6-45.el9.x86_64.rpm 629 kB/s | 582 kB 00:00 2024-05-07T11:10:44.486 INFO:teuthology.orchestra.run.smithi088.stdout:(47/139): elfutils-libelf-devel-0.190-2.el9.x86 184 kB/s | 21 kB 00:00 2024-05-07T11:10:44.539 INFO:teuthology.orchestra.run.smithi149.stdout:(44/139): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-05-07T11:10:44.556 INFO:teuthology.orchestra.run.smithi175.stdout:(57/139): libuuid-devel-2.37.4-18.el9.x86_64.rp 255 kB/s | 25 kB 00:00 2024-05-07T11:10:44.648 INFO:teuthology.orchestra.run.smithi175.stdout:(58/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 518 kB/s | 47 kB 00:00 2024-05-07T11:10:44.728 INFO:teuthology.orchestra.run.smithi088.stdout:(48/139): ceph-osd-19.0.0-2504.gb05eb275.el9.x8 1.1 MB/s | 17 MB 00:15 2024-05-07T11:10:44.753 INFO:teuthology.orchestra.run.smithi088.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-05-07T11:10:44.814 INFO:teuthology.orchestra.run.smithi149.stdout:(45/139): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-05-07T11:10:44.915 INFO:teuthology.orchestra.run.smithi149.stdout:(46/139): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-05-07T11:10:44.919 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-07T11:10:44.990 INFO:teuthology.orchestra.run.smithi175.stdout:(59/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 856 kB/s | 292 kB 00:00 2024-05-07T11:10:44.996 INFO:teuthology.orchestra.run.smithi088.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 122 kB/s | 33 kB 00:00 2024-05-07T11:10:45.023 INFO:teuthology.orchestra.run.smithi149.stdout:(47/139): elfutils-libelf-devel-0.190-2.el9.x86 199 kB/s | 21 kB 00:00 2024-05-07T11:10:45.063 INFO:teuthology.orchestra.run.smithi088.stdout:(51/139): librgw2-19.0.0-2504.gb05eb275.el9.x86 586 kB/s | 5.3 MB 00:09 2024-05-07T11:10:45.072 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-07T11:10:45.073 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-07T11:10:45.096 INFO:teuthology.orchestra.run.smithi088.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-05-07T11:10:45.140 INFO:teuthology.orchestra.run.smithi149.stdout:(48/139): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-05-07T11:10:45.207 INFO:teuthology.orchestra.run.smithi175.stdout:(60/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 856 kB/s | 3.0 MB 00:03 2024-05-07T11:10:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 61 kB/s | 11 kB 00:00 2024-05-07T11:10:45.248 INFO:teuthology.orchestra.run.smithi175.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 729 kB/s | 188 kB 00:00 2024-05-07T11:10:45.249 INFO:teuthology.orchestra.run.smithi149.stdout:(49/139): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-05-07T11:10:45.299 INFO:teuthology.orchestra.run.smithi175.stdout:(62/139): openblas-0.3.21-2.el9.x86_64.rpm 383 kB/s | 35 kB 00:00 2024-05-07T11:10:45.372 INFO:teuthology.orchestra.run.smithi088.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 581 kB/s | 160 kB 00:00 2024-05-07T11:10:45.430 INFO:teuthology.orchestra.run.smithi088.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 246 kB/s | 45 kB 00:00 2024-05-07T11:10:45.722 INFO:teuthology.orchestra.run.smithi088.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-05-07T11:10:45.831 INFO:teuthology.orchestra.run.smithi088.stdout:(57/139): libuuid-devel-2.37.4-18.el9.x86_64.rp 235 kB/s | 25 kB 00:00 2024-05-07T11:10:45.940 INFO:teuthology.orchestra.run.smithi088.stdout:(58/139): libtool-2.4.6-45.el9.x86_64.rpm 1.1 MB/s | 582 kB 00:00 2024-05-07T11:10:45.965 INFO:teuthology.orchestra.run.smithi088.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 354 kB/s | 47 kB 00:00 2024-05-07T11:10:46.074 INFO:teuthology.orchestra.run.smithi088.stdout:(60/139): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-07T11:10:46.132 INFO:teuthology.orchestra.run.smithi088.stdout:(61/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2024-05-07T11:10:46.141 INFO:teuthology.orchestra.run.smithi149.stdout:(50/139): ceph-osd-19.0.0-2504.gb05eb275.el9.x8 1.0 MB/s | 17 MB 00:16 2024-05-07T11:10:46.174 INFO:teuthology.orchestra.run.smithi088.stdout:(62/139): openblas-0.3.21-2.el9.x86_64.rpm 351 kB/s | 35 kB 00:00 2024-05-07T11:10:46.408 INFO:teuthology.orchestra.run.smithi149.stdout:(51/139): ceph-common-19.0.0-2504.gb05eb275.el9 1.0 MB/s | 21 MB 00:20 2024-05-07T11:10:46.458 INFO:teuthology.orchestra.run.smithi149.stdout:(52/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-05-07T11:10:46.550 INFO:teuthology.orchestra.run.smithi088.stdout:(63/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.7 MB/s | 3.0 MB 00:01 2024-05-07T11:10:46.567 INFO:teuthology.orchestra.run.smithi149.stdout:(53/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-07T11:10:46.584 INFO:teuthology.orchestra.run.smithi149.stdout:(54/139): flexiblas-openblas-openmp-3.0.4-8.el9 41 kB/s | 18 kB 00:00 2024-05-07T11:10:46.601 INFO:teuthology.orchestra.run.smithi149.stdout:(55/139): libaio-devel-0.3.111-13.el9.x86_64.rp 58 kB/s | 11 kB 00:00 2024-05-07T11:10:46.668 INFO:teuthology.orchestra.run.smithi149.stdout:(56/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 448 kB/s | 45 kB 00:00 2024-05-07T11:10:46.768 INFO:teuthology.orchestra.run.smithi149.stdout:(57/139): libuuid-devel-2.37.4-18.el9.x86_64.rp 255 kB/s | 25 kB 00:00 2024-05-07T11:10:46.868 INFO:teuthology.orchestra.run.smithi149.stdout:(58/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 475 kB/s | 47 kB 00:00 2024-05-07T11:10:46.977 INFO:teuthology.orchestra.run.smithi149.stdout:(59/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-05-07T11:10:47.086 INFO:teuthology.orchestra.run.smithi149.stdout:(60/139): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-07T11:10:47.176 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-07T11:10:47.176 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-07T11:10:47.186 INFO:teuthology.orchestra.run.smithi149.stdout:(61/139): libtool-2.4.6-45.el9.x86_64.rpm 996 kB/s | 582 kB 00:00 2024-05-07T11:10:47.211 INFO:teuthology.orchestra.run.smithi149.stdout:(62/139): librdkafka-1.6.1-102.el9.x86_64.rpm 1.0 MB/s | 662 kB 00:00 2024-05-07T11:10:47.236 INFO:teuthology.orchestra.run.smithi149.stdout:(63/139): openblas-0.3.21-2.el9.x86_64.rpm 234 kB/s | 35 kB 00:00 2024-05-07T11:10:47.325 INFO:teuthology.orchestra.run.smithi088.stdout:(64/139): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-05-07T11:10:47.437 INFO:teuthology.orchestra.run.smithi149.stdout:(64/139): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-05-07T11:10:47.599 INFO:teuthology.orchestra.run.smithi175.stdout:(63/139): openssl-devel-3.2.1-1.el9.x86_64.rpm 1.9 MB/s | 4.4 MB 00:02 2024-05-07T11:10:47.845 INFO:teuthology.orchestra.run.smithi149.stdout:(65/139): openblas-openmp-0.3.21-2.el9.x86_64.r 7.2 MB/s | 4.7 MB 00:00 2024-05-07T11:10:47.954 INFO:teuthology.orchestra.run.smithi149.stdout:(66/139): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-05-07T11:10:48.066 INFO:teuthology.orchestra.run.smithi088.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 681 kB/s | 1.0 MB 00:01 2024-05-07T11:10:48.099 INFO:teuthology.orchestra.run.smithi175.stdout:(64/139): openblas-openmp-0.3.21-2.el9.x86_64.r 1.7 MB/s | 4.7 MB 00:02 2024-05-07T11:10:48.133 INFO:teuthology.orchestra.run.smithi175.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-05-07T11:10:48.241 INFO:teuthology.orchestra.run.smithi175.stdout:(66/139): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-05-07T11:10:48.304 INFO:teuthology.orchestra.run.smithi149.stdout:(67/139): python3-jinja2-2.11.3-5.el9.noarch.rp 708 kB/s | 248 kB 00:00 2024-05-07T11:10:48.350 INFO:teuthology.orchestra.run.smithi175.stdout:(67/139): python3-jinja2-2.11.3-5.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-05-07T11:10:48.412 INFO:teuthology.orchestra.run.smithi149.stdout:(68/139): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-05-07T11:10:48.425 INFO:teuthology.orchestra.run.smithi088.stdout:(66/139): python3-devel-3.9.18-3.el9.x86_64.rpm 682 kB/s | 244 kB 00:00 2024-05-07T11:10:48.467 INFO:teuthology.orchestra.run.smithi175.stdout:(68/139): python3-jsonpatch-1.21-16.el9.noarch. 220 kB/s | 26 kB 00:00 2024-05-07T11:10:48.479 INFO:teuthology.orchestra.run.smithi149.stdout:(69/139): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-05-07T11:10:48.523 INFO:teuthology.orchestra.run.smithi149.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 174 kB/s | 19 kB 00:00 2024-05-07T11:10:48.584 INFO:teuthology.orchestra.run.smithi175.stdout:(69/139): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-05-07T11:10:48.588 INFO:teuthology.orchestra.run.smithi149.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-05-07T11:10:48.625 INFO:teuthology.orchestra.run.smithi088.stdout:(67/139): openblas-openmp-0.3.21-2.el9.x86_64.r 1.9 MB/s | 4.7 MB 00:02 2024-05-07T11:10:48.630 INFO:teuthology.orchestra.run.smithi149.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 323 kB/s | 35 kB 00:00 2024-05-07T11:10:48.709 INFO:teuthology.orchestra.run.smithi175.stdout:(70/139): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-05-07T11:10:48.725 INFO:teuthology.orchestra.run.smithi088.stdout:(68/139): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-05-07T11:10:48.826 INFO:teuthology.orchestra.run.smithi175.stdout:(71/139): python3-markupsafe-1.1.1-12.el9.x86_6 298 kB/s | 35 kB 00:00 2024-05-07T11:10:48.842 INFO:teuthology.orchestra.run.smithi088.stdout:(69/139): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-05-07T11:10:48.867 INFO:teuthology.orchestra.run.smithi088.stdout:(70/139): python3-jinja2-2.11.3-5.el9.noarch.rp 560 kB/s | 248 kB 00:00 2024-05-07T11:10:48.984 INFO:teuthology.orchestra.run.smithi088.stdout:(71/139): python3-markupsafe-1.1.1-12.el9.x86_6 298 kB/s | 35 kB 00:00 2024-05-07T11:10:49.006 INFO:teuthology.orchestra.run.smithi149.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 668 kB/s | 250 kB 00:00 2024-05-07T11:10:49.135 INFO:teuthology.orchestra.run.smithi088.stdout:(72/139): python3-mako-1.1.4-6.el9.noarch.rpm 589 kB/s | 172 kB 00:00 2024-05-07T11:10:49.181 INFO:teuthology.orchestra.run.smithi149.stdout:(74/139): python3-babel-2.9.1-2.el9.noarch.rpm 3.4 MB/s | 6.0 MB 00:01 2024-05-07T11:10:49.365 INFO:teuthology.orchestra.run.smithi149.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 619 kB/s | 222 kB 00:00 2024-05-07T11:10:49.390 INFO:teuthology.orchestra.run.smithi149.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 370 kB/s | 77 kB 00:00 2024-05-07T11:10:49.474 INFO:teuthology.orchestra.run.smithi149.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-05-07T11:10:49.477 INFO:teuthology.orchestra.run.smithi088.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 733 kB/s | 250 kB 00:00 2024-05-07T11:10:49.741 INFO:teuthology.orchestra.run.smithi149.stdout:(78/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 596 kB/s | 159 kB 00:00 2024-05-07T11:10:49.808 INFO:teuthology.orchestra.run.smithi149.stdout:(79/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-05-07T11:10:49.827 INFO:teuthology.orchestra.run.smithi088.stdout:(74/139): python3-oauthlib-3.1.1-5.el9.noarch.r 635 kB/s | 222 kB 00:00 2024-05-07T11:10:49.833 INFO:teuthology.orchestra.run.smithi149.stdout:(80/139): python3-protobuf-3.14.0-13.el9.noarch 609 kB/s | 269 kB 00:00 2024-05-07T11:10:49.868 INFO:teuthology.orchestra.run.smithi175.stdout:(72/139): python3-babel-2.9.1-2.el9.noarch.rpm 3.4 MB/s | 6.0 MB 00:01 2024-05-07T11:10:49.908 INFO:teuthology.orchestra.run.smithi149.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-05-07T11:10:49.942 INFO:teuthology.orchestra.run.smithi149.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 493 kB/s | 54 kB 00:00 2024-05-07T11:10:49.977 INFO:teuthology.orchestra.run.smithi175.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-05-07T11:10:50.019 INFO:teuthology.orchestra.run.smithi088.stdout:(75/139): python3-packaging-20.9-5.el9.noarch.r 403 kB/s | 77 kB 00:00 2024-05-07T11:10:50.042 INFO:teuthology.orchestra.run.smithi149.stdout:(83/139): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-05-07T11:10:50.085 INFO:teuthology.orchestra.run.smithi175.stdout:(74/139): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-05-07T11:10:50.153 INFO:teuthology.orchestra.run.smithi088.stdout:(76/139): python3-prettytable-0.7.2-27.el9.noar 317 kB/s | 42 kB 00:00 2024-05-07T11:10:50.192 INFO:teuthology.orchestra.run.smithi149.stdout:(84/139): python3-pyasn1-modules-0.4.8-6.el9.no 617 kB/s | 279 kB 00:00 2024-05-07T11:10:50.194 INFO:teuthology.orchestra.run.smithi175.stdout:(75/139): python3-packaging-20.9-5.el9.noarch.r 712 kB/s | 77 kB 00:00 2024-05-07T11:10:50.285 INFO:teuthology.orchestra.run.smithi149.stdout:(85/139): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-05-07T11:10:50.294 INFO:teuthology.orchestra.run.smithi175.stdout:(76/139): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-05-07T11:10:50.361 INFO:teuthology.orchestra.run.smithi175.stdout:(77/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 5.1 MB 00:01 2024-05-07T11:10:50.385 INFO:teuthology.orchestra.run.smithi149.stdout:(86/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 475 kB/s | 47 kB 00:00 2024-05-07T11:10:50.403 INFO:teuthology.orchestra.run.smithi175.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-05-07T11:10:50.410 INFO:teuthology.orchestra.run.smithi149.stdout:(87/139): qatlib-24.02.0-1.el9.x86_64.rpm 600 kB/s | 221 kB 00:00 2024-05-07T11:10:50.470 INFO:teuthology.orchestra.run.smithi175.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-05-07T11:10:50.512 INFO:teuthology.orchestra.run.smithi175.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-05-07T11:10:50.578 INFO:teuthology.orchestra.run.smithi088.stdout:(77/139): python3-protobuf-3.14.0-13.el9.noarch 634 kB/s | 269 kB 00:00 2024-05-07T11:10:50.579 INFO:teuthology.orchestra.run.smithi175.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-05-07T11:10:50.602 INFO:teuthology.orchestra.run.smithi149.stdout:(88/139): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 489 kB/s | 94 kB 00:00 2024-05-07T11:10:50.612 INFO:teuthology.orchestra.run.smithi175.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 535 kB/s | 54 kB 00:00 2024-05-07T11:10:50.713 INFO:teuthology.orchestra.run.smithi175.stdout:(83/139): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-05-07T11:10:50.785 INFO:teuthology.orchestra.run.smithi149.stdout:(89/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 348 kB/s | 64 kB 00:00 2024-05-07T11:10:50.811 INFO:teuthology.orchestra.run.smithi149.stdout:(90/139): socat-1.7.4.1-5.el9.x86_64.rpm 715 kB/s | 305 kB 00:00 2024-05-07T11:10:50.822 INFO:teuthology.orchestra.run.smithi175.stdout:(84/139): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-05-07T11:10:50.837 INFO:teuthology.orchestra.run.smithi088.stdout:(78/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 614 kB/s | 159 kB 00:00 2024-05-07T11:10:50.886 INFO:teuthology.orchestra.run.smithi149.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2024-05-07T11:10:50.920 INFO:teuthology.orchestra.run.smithi149.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-05-07T11:10:50.922 INFO:teuthology.orchestra.run.smithi175.stdout:(85/139): qatlib-service-24.02.0-1.el9.x86_64.r 359 kB/s | 36 kB 00:00 2024-05-07T11:10:51.022 INFO:teuthology.orchestra.run.smithi175.stdout:(86/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 475 kB/s | 47 kB 00:00 2024-05-07T11:10:51.131 INFO:teuthology.orchestra.run.smithi175.stdout:(87/139): socat-1.7.4.1-5.el9.x86_64.rpm 2.8 MB/s | 305 kB 00:00 2024-05-07T11:10:51.145 INFO:teuthology.orchestra.run.smithi149.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 2.4 MB/s | 548 kB 00:00 2024-05-07T11:10:51.195 INFO:teuthology.orchestra.run.smithi149.stdout:(94/139): gperftools-libs-2.9.1-2.el9.x86_64.rp 6.1 MB/s | 309 kB 00:00 2024-05-07T11:10:51.231 INFO:teuthology.orchestra.run.smithi175.stdout:(88/139): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 936 kB/s | 94 kB 00:00 2024-05-07T11:10:51.237 INFO:teuthology.orchestra.run.smithi149.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 469 kB/s | 19 kB 00:00 2024-05-07T11:10:51.270 INFO:teuthology.orchestra.run.smithi088.stdout:(79/139): python3-pyasn1-modules-0.4.8-6.el9.no 644 kB/s | 279 kB 00:00 2024-05-07T11:10:51.331 INFO:teuthology.orchestra.run.smithi175.stdout:(89/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 638 kB/s | 64 kB 00:00 2024-05-07T11:10:51.370 INFO:teuthology.orchestra.run.smithi088.stdout:(80/139): python3-pytz-2021.1-5.el9.noarch.rpm 510 kB/s | 51 kB 00:00 2024-05-07T11:10:51.396 INFO:teuthology.orchestra.run.smithi149.stdout:(96/139): libarrow-9.0.0-11.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-05-07T11:10:51.438 INFO:teuthology.orchestra.run.smithi149.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-05-07T11:10:51.440 INFO:teuthology.orchestra.run.smithi175.stdout:(90/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-05-07T11:10:51.480 INFO:teuthology.orchestra.run.smithi149.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-05-07T11:10:51.504 INFO:teuthology.orchestra.run.smithi088.stdout:(81/139): python3-requests-oauthlib-1.3.0-12.el 402 kB/s | 54 kB 00:00 2024-05-07T11:10:51.521 INFO:teuthology.orchestra.run.smithi149.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-05-07T11:10:51.548 INFO:teuthology.orchestra.run.smithi175.stdout:(91/139): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-05-07T11:10:51.563 INFO:teuthology.orchestra.run.smithi149.stdout:(100/139): luarocks-3.9.2-1.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-05-07T11:10:51.639 INFO:teuthology.orchestra.run.smithi149.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-05-07T11:10:51.689 INFO:teuthology.orchestra.run.smithi149.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-05-07T11:10:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-05-07T11:10:51.773 INFO:teuthology.orchestra.run.smithi149.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 775 kB/s | 32 kB 00:00 2024-05-07T11:10:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:(105/139): python3-certifi-2021.10.8-2.el9.noar 362 kB/s | 15 kB 00:00 2024-05-07T11:10:51.857 INFO:teuthology.orchestra.run.smithi149.stdout:(106/139): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-05-07T11:10:51.865 INFO:teuthology.orchestra.run.smithi175.stdout:(92/139): protobuf-compiler-3.14.0-13.el9.x86_6 2.7 MB/s | 863 kB 00:00 2024-05-07T11:10:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:(107/139): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-05-07T11:10:51.949 INFO:teuthology.orchestra.run.smithi149.stdout:(108/139): python3-google-auth-2.29.0-1.el9.noa 4.8 MB/s | 206 kB 00:00 2024-05-07T11:10:52.033 INFO:teuthology.orchestra.run.smithi149.stdout:(109/139): python3-grpcio-1.46.7-10.el9.x86_64. 24 MB/s | 2.0 MB 00:00 2024-05-07T11:10:52.075 INFO:teuthology.orchestra.run.smithi149.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-05-07T11:10:52.125 INFO:teuthology.orchestra.run.smithi149.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-05-07T11:10:52.175 INFO:teuthology.orchestra.run.smithi149.stdout:(112/139): protobuf-compiler-3.14.0-13.el9.x86_ 670 kB/s | 863 kB 00:01 2024-05-07T11:10:52.201 INFO:teuthology.orchestra.run.smithi149.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-05-07T11:10:52.218 INFO:teuthology.orchestra.run.smithi149.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 553 kB/s | 23 kB 00:00 2024-05-07T11:10:52.243 INFO:teuthology.orchestra.run.smithi149.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 465 kB/s | 19 kB 00:00 2024-05-07T11:10:52.260 INFO:teuthology.orchestra.run.smithi149.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 470 kB/s | 20 kB 00:00 2024-05-07T11:10:52.302 INFO:teuthology.orchestra.run.smithi149.stdout:(117/139): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2024-05-07T11:10:52.327 INFO:teuthology.orchestra.run.smithi149.stdout:(118/139): python3-logutils-0.3.5-21.el9.noarch 693 kB/s | 46 kB 00:00 2024-05-07T11:10:52.352 INFO:teuthology.orchestra.run.smithi149.stdout:(119/139): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-05-07T11:10:52.369 INFO:teuthology.orchestra.run.smithi149.stdout:(120/139): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-05-07T11:10:52.403 INFO:teuthology.orchestra.run.smithi149.stdout:(121/139): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-05-07T11:10:52.420 INFO:teuthology.orchestra.run.smithi149.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-05-07T11:10:52.437 INFO:teuthology.orchestra.run.smithi149.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-05-07T11:10:52.454 INFO:teuthology.orchestra.run.smithi149.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 916 kB/s | 31 kB 00:00 2024-05-07T11:10:52.457 INFO:teuthology.orchestra.run.smithi175.stdout:(93/139): ceph-test-19.0.0-2504.gb05eb275.el9.x 2.4 MB/s | 48 MB 00:20 2024-05-07T11:10:52.479 INFO:teuthology.orchestra.run.smithi149.stdout:(125/139): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-05-07T11:10:52.496 INFO:teuthology.orchestra.run.smithi149.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-05-07T11:10:52.513 INFO:teuthology.orchestra.run.smithi149.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-05-07T11:10:52.530 INFO:teuthology.orchestra.run.smithi149.stdout:(128/139): python3-typing-extensions-4.4.0-2.el 1.5 MB/s | 51 kB 00:00 2024-05-07T11:10:52.564 INFO:teuthology.orchestra.run.smithi149.stdout:(129/139): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-05-07T11:10:52.589 INFO:teuthology.orchestra.run.smithi149.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-05-07T11:10:52.625 INFO:teuthology.orchestra.run.smithi149.stdout:(131/139): python3-werkzeug-2.0.3-3.el9.1.noarc 6.9 MB/s | 427 kB 00:00 2024-05-07T11:10:52.648 INFO:teuthology.orchestra.run.smithi149.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 346 kB/s | 20 kB 00:00 2024-05-07T11:10:52.681 INFO:teuthology.orchestra.run.smithi149.stdout:(133/139): re2-20211101-3.el9.x86_64.rpm 3.4 MB/s | 192 kB 00:00 2024-05-07T11:10:52.715 INFO:teuthology.orchestra.run.smithi149.stdout:(134/139): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-05-07T11:10:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-07T11:10:53.082 INFO:teuthology.orchestra.run.smithi149.stdout:(135/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.1 MB/s | 16 MB 00:03 2024-05-07T11:10:53.155 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/143 2024-05-07T11:10:53.165 INFO:teuthology.orchestra.run.smithi149.stdout:(136/139): librados2-19.0.0-2504.gb05eb275.el9. 7.0 MB/s | 3.4 MB 00:00 2024-05-07T11:10:53.201 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-05-07T11:10:53.276 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-05-07T11:10:53.317 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-05-07T11:10:53.348 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-05-07T11:10:53.411 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-05-07T11:10:53.649 INFO:teuthology.orchestra.run.smithi175.stdout:(94/139): gperftools-libs-2.9.1-2.el9.x86_64.rp 259 kB/s | 309 kB 00:01 2024-05-07T11:10:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-05-07T11:10:53.857 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:10:53.989 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:10:54.041 INFO:teuthology.orchestra.run.smithi175.stdout:(95/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 252 kB/s | 548 kB 00:02 2024-05-07T11:10:54.058 INFO:teuthology.orchestra.run.smithi175.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 48 kB/s | 19 kB 00:00 2024-05-07T11:10:54.133 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:10:54.157 INFO:teuthology.orchestra.run.smithi149.stdout:(137/139): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:00 2024-05-07T11:10:54.225 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:10:54.264 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 10/143 2024-05-07T11:10:54.292 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:10:54.350 INFO:teuthology.orchestra.run.smithi175.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 89 kB/s | 26 kB 00:00 2024-05-07T11:10:54.397 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:10:54.426 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 12/143 2024-05-07T11:10:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 12/143 2024-05-07T11:10:54.511 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-05-07T11:10:54.533 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-05-07T11:10:54.624 INFO:teuthology.orchestra.run.smithi149.stdout:(138/139): librbd1-19.0.0-2504.gb05eb275.el9.x8 1.6 MB/s | 3.1 MB 00:01 2024-05-07T11:10:54.709 INFO:teuthology.orchestra.run.smithi175.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 135 kB/s | 49 kB 00:00 2024-05-07T11:10:54.714 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-05-07T11:10:54.744 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-05-07T11:10:54.855 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/143 2024-05-07T11:10:54.952 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-05-07T11:10:54.985 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-05-07T11:10:55.009 INFO:teuthology.orchestra.run.smithi175.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 225 kB/s | 67 kB 00:00 2024-05-07T11:10:55.019 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-05-07T11:10:55.096 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-05-07T11:10:55.136 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-05-07T11:10:55.179 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/143 2024-05-07T11:10:55.212 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/143 2024-05-07T11:10:55.239 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/143 2024-05-07T11:10:55.310 INFO:teuthology.orchestra.run.smithi175.stdout:(100/139): luarocks-3.9.2-1.el9.noarch.rpm 503 kB/s | 151 kB 00:00 2024-05-07T11:10:55.310 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 24/143 2024-05-07T11:10:55.363 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 25/143 2024-05-07T11:10:55.398 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 26/143 2024-05-07T11:10:55.436 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 27/143 2024-05-07T11:10:55.514 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 28/143 2024-05-07T11:10:55.546 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.0.0-2504.gb05eb275.el9. 29/143 2024-05-07T11:10:55.582 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el 30/143 2024-05-07T11:10:55.609 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_6 31/143 2024-05-07T11:10:55.685 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 32/143 2024-05-07T11:10:55.733 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-1.el9.noarch 33/143 2024-05-07T11:10:55.811 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 34/143 2024-05-07T11:10:55.948 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/143 2024-05-07T11:10:56.003 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/143 2024-05-07T11:10:56.112 INFO:teuthology.orchestra.run.smithi088.stdout:(82/139): python3-babel-2.9.1-2.el9.noarch.rpm 695 kB/s | 6.0 MB 00:08 2024-05-07T11:10:56.229 INFO:teuthology.orchestra.run.smithi088.stdout:(83/139): python3-toml-0.10.2-6.el9.noarch.rpm 358 kB/s | 42 kB 00:00 2024-05-07T11:10:56.454 INFO:teuthology.orchestra.run.smithi088.stdout:(84/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 699 kB/s | 5.1 MB 00:07 2024-05-07T11:10:56.567 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/143 2024-05-07T11:10:56.571 INFO:teuthology.orchestra.run.smithi088.stdout:(85/139): qatlib-service-24.02.0-1.el9.x86_64.r 307 kB/s | 36 kB 00:00 2024-05-07T11:10:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:(86/139): qatlib-24.02.0-1.el9.x86_64.rpm 575 kB/s | 221 kB 00:00 2024-05-07T11:10:56.658 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/143 2024-05-07T11:10:56.672 INFO:teuthology.orchestra.run.smithi088.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-05-07T11:10:56.693 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 39/143 2024-05-07T11:10:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 40/143 2024-05-07T11:10:56.774 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_6 41/143 2024-05-07T11:10:56.776 INFO:teuthology.orchestra.run.smithi175.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 572 kB/s | 839 kB 00:01 2024-05-07T11:10:56.817 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/143 2024-05-07T11:10:56.864 INFO:teuthology.orchestra.run.smithi088.stdout:(88/139): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 489 kB/s | 94 kB 00:00 2024-05-07T11:10:56.973 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/143 2024-05-07T11:10:57.010 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 44/143 2024-05-07T11:10:57.047 INFO:teuthology.orchestra.run.smithi088.stdout:(89/139): socat-1.7.4.1-5.el9.x86_64.rpm 703 kB/s | 305 kB 00:00 2024-05-07T11:10:57.073 INFO:teuthology.orchestra.run.smithi088.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 305 kB/s | 64 kB 00:00 2024-05-07T11:10:57.075 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/143 2024-05-07T11:10:57.148 INFO:teuthology.orchestra.run.smithi088.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 447 kB/s | 45 kB 00:00 2024-05-07T11:10:57.150 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/143 2024-05-07T11:10:57.173 INFO:teuthology.orchestra.run.smithi088.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-05-07T11:10:57.185 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/143 2024-05-07T11:10:57.222 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/143 2024-05-07T11:10:57.270 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/143 2024-05-07T11:10:57.315 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/143 2024-05-07T11:10:57.356 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/143 2024-05-07T11:10:57.501 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/143 2024-05-07T11:10:57.550 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/143 2024-05-07T11:10:57.556 INFO:teuthology.orchestra.run.smithi088.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 1.4 MB/s | 548 kB 00:00 2024-05-07T11:10:57.583 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 54/143 2024-05-07T11:10:57.593 INFO:teuthology.orchestra.run.smithi175.stdout:(102/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.3 MB/s | 16 MB 00:07 2024-05-07T11:10:57.632 INFO:teuthology.orchestra.run.smithi088.stdout:(94/139): gperftools-libs-2.9.1-2.el9.x86_64.rp 4.0 MB/s | 309 kB 00:00 2024-05-07T11:10:57.683 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 55/143 2024-05-07T11:10:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-05-07T11:10:57.725 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 56/143 2024-05-07T11:10:57.735 INFO:teuthology.orchestra.run.smithi175.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 308 kB/s | 43 kB 00:00 2024-05-07T11:10:57.766 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 57/143 2024-05-07T11:10:57.798 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 58/143 2024-05-07T11:10:57.822 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 59/143 2024-05-07T11:10:57.902 INFO:teuthology.orchestra.run.smithi175.stdout:(104/139): python3-asyncssh-2.13.2-5.el9.noarch 487 kB/s | 548 kB 00:01 2024-05-07T11:10:57.918 INFO:teuthology.orchestra.run.smithi175.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 175 kB/s | 32 kB 00:00 2024-05-07T11:10:57.929 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 60/143 2024-05-07T11:10:57.932 INFO:teuthology.orchestra.run.smithi088.stdout:(96/139): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-05-07T11:10:57.991 INFO:teuthology.orchestra.run.smithi088.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 448 kB/s | 26 kB 00:00 2024-05-07T11:10:58.011 INFO:teuthology.orchestra.run.smithi175.stdout:(106/139): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-05-07T11:10:58.050 INFO:teuthology.orchestra.run.smithi088.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 832 kB/s | 49 kB 00:00 2024-05-07T11:10:58.063 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 61/143 2024-05-07T11:10:58.096 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 62/143 2024-05-07T11:10:58.116 INFO:teuthology.orchestra.run.smithi088.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-05-07T11:10:58.119 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 63/143 2024-05-07T11:10:58.153 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 64/143 2024-05-07T11:10:58.183 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/143 2024-05-07T11:10:58.183 INFO:teuthology.orchestra.run.smithi088.stdout:(100/139): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-05-07T11:10:58.211 INFO:teuthology.orchestra.run.smithi175.stdout:(107/139): libarrow-9.0.0-11.el9.x86_64.rpm 1.1 MB/s | 4.4 MB 00:04 2024-05-07T11:10:58.217 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/143 2024-05-07T11:10:58.245 INFO:teuthology.orchestra.run.smithi175.stdout:(108/139): python3-cheroot-8.6.0-4.el9.noarch.r 527 kB/s | 172 kB 00:00 2024-05-07T11:10:58.251 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 67/143 2024-05-07T11:10:58.275 INFO:teuthology.orchestra.run.smithi088.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-05-07T11:10:58.293 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 68/143 2024-05-07T11:10:58.327 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 69/143 2024-05-07T11:10:58.359 INFO:teuthology.orchestra.run.smithi088.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-05-07T11:10:58.370 INFO:teuthology.orchestra.run.smithi175.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 999 kB/s | 358 kB 00:00 2024-05-07T11:10:58.384 INFO:teuthology.orchestra.run.smithi088.stdout:(103/139): protobuf-compiler-3.14.0-13.el9.x86_ 698 kB/s | 863 kB 00:01 2024-05-07T11:10:58.416 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 70/143 2024-05-07T11:10:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:(104/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 650 kB/s | 43 kB 00:00 2024-05-07T11:10:58.451 INFO:teuthology.orchestra.run.smithi088.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 481 kB/s | 32 kB 00:00 2024-05-07T11:10:58.473 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 71/143 2024-05-07T11:10:58.487 INFO:teuthology.orchestra.run.smithi175.stdout:(110/139): python3-google-auth-2.29.0-1.el9.noa 746 kB/s | 206 kB 00:00 2024-05-07T11:10:58.493 INFO:teuthology.orchestra.run.smithi088.stdout:(106/139): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2024-05-07T11:10:58.513 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/143 2024-05-07T11:10:58.519 INFO:teuthology.orchestra.run.smithi088.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-05-07T11:10:58.562 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/143 2024-05-07T11:10:58.563 INFO:teuthology.orchestra.run.smithi175.stdout:(111/139): python3-grpcio-tools-1.46.7-10.el9.x 754 kB/s | 144 kB 00:00 2024-05-07T11:10:58.569 INFO:teuthology.orchestra.run.smithi088.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-05-07T11:10:58.594 INFO:teuthology.orchestra.run.smithi088.stdout:(109/139): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-07T11:10:58.662 INFO:teuthology.orchestra.run.smithi175.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 61 kB/s | 11 kB 00:00 2024-05-07T11:10:58.673 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 74/143 2024-05-07T11:10:58.711 INFO:teuthology.orchestra.run.smithi088.stdout:(110/139): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-05-07T11:10:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-05-07T11:10:58.729 INFO:teuthology.orchestra.run.smithi175.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 106 kB/s | 18 kB 00:00 2024-05-07T11:10:58.736 INFO:teuthology.orchestra.run.smithi088.stdout:(111/139): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-05-07T11:10:58.829 INFO:teuthology.orchestra.run.smithi175.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 139 kB/s | 23 kB 00:00 2024-05-07T11:10:58.853 INFO:teuthology.orchestra.run.smithi088.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 76 kB/s | 11 kB 00:00 2024-05-07T11:10:58.879 INFO:teuthology.orchestra.run.smithi088.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 124 kB/s | 18 kB 00:00 2024-05-07T11:10:58.896 INFO:teuthology.orchestra.run.smithi175.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 116 kB/s | 19 kB 00:00 2024-05-07T11:10:58.946 INFO:teuthology.orchestra.run.smithi088.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 347 kB/s | 23 kB 00:00 2024-05-07T11:10:58.971 INFO:teuthology.orchestra.run.smithi088.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-05-07T11:10:59.013 INFO:teuthology.orchestra.run.smithi088.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-05-07T11:10:59.013 INFO:teuthology.orchestra.run.smithi175.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 107 kB/s | 20 kB 00:00 2024-05-07T11:10:59.072 INFO:teuthology.orchestra.run.smithi088.stdout:(117/139): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-05-07T11:10:59.097 INFO:teuthology.orchestra.run.smithi088.stdout:(118/139): python3-logutils-0.3.5-21.el9.noarch 557 kB/s | 46 kB 00:00 2024-05-07T11:10:59.139 INFO:teuthology.orchestra.run.smithi088.stdout:(119/139): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-05-07T11:10:59.172 INFO:teuthology.orchestra.run.smithi088.stdout:(120/139): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-05-07T11:10:59.238 INFO:teuthology.orchestra.run.smithi175.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 206 kB/s | 46 kB 00:00 2024-05-07T11:10:59.239 INFO:teuthology.orchestra.run.smithi088.stdout:(121/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-05-07T11:10:59.264 INFO:teuthology.orchestra.run.smithi088.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-05-07T11:10:59.307 INFO:teuthology.orchestra.run.smithi088.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-05-07T11:10:59.332 INFO:teuthology.orchestra.run.smithi088.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-05-07T11:10:59.447 INFO:teuthology.orchestra.run.smithi175.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 379 kB/s | 79 kB 00:00 2024-05-07T11:10:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-05-07T11:10:59.516 INFO:teuthology.orchestra.run.smithi088.stdout:(125/139): python3-routes-2.5.1-5.el9.noarch.rp 904 kB/s | 188 kB 00:00 2024-05-07T11:10:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-05-07T11:10:59.541 INFO:teuthology.orchestra.run.smithi088.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 283 kB/s | 59 kB 00:00 2024-05-07T11:10:59.547 INFO:teuthology.orchestra.run.smithi175.stdout:(119/139): python3-grpcio-1.46.7-10.el9.x86_64. 1.6 MB/s | 2.0 MB 00:01 2024-05-07T11:10:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-05-07T11:10:59.582 INFO:teuthology.orchestra.run.smithi088.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 538 kB/s | 36 kB 00:00 2024-05-07T11:10:59.624 INFO:teuthology.orchestra.run.smithi088.stdout:(128/139): python3-typing-extensions-4.4.0-2.el 612 kB/s | 51 kB 00:00 2024-05-07T11:10:59.647 INFO:teuthology.orchestra.run.smithi175.stdout:(120/139): python3-natsort-7.1.1-5.el9.noarch.r 288 kB/s | 58 kB 00:00 2024-05-07T11:10:59.658 INFO:teuthology.orchestra.run.smithi088.stdout:(129/139): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-07T11:10:59.673 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-05-07T11:10:59.692 INFO:teuthology.orchestra.run.smithi088.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-05-07T11:10:59.723 INFO:teuthology.orchestra.run.smithi175.stdout:(121/139): python3-portend-3.1.0-2.el9.noarch.r 219 kB/s | 16 kB 00:00 2024-05-07T11:10:59.735 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 80/143 2024-05-07T11:10:59.742 INFO:teuthology.orchestra.run.smithi088.stdout:(131/139): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-07T11:10:59.767 INFO:teuthology.orchestra.run.smithi088.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-05-07T11:10:59.809 INFO:teuthology.orchestra.run.smithi088.stdout:(133/139): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-05-07T11:10:59.857 INFO:teuthology.orchestra.run.smithi175.stdout:(122/139): python3-kubernetes-26.1.0-2.el9.noar 1.1 MB/s | 1.0 MB 00:00 2024-05-07T11:10:59.890 INFO:teuthology.orchestra.run.smithi175.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 538 kB/s | 90 kB 00:00 2024-05-07T11:10:59.894 INFO:teuthology.orchestra.run.smithi088.stdout:(134/139): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-07T11:10:59.924 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.21-2.el9.x86_64 81/143 2024-05-07T11:10:59.957 INFO:teuthology.orchestra.run.smithi175.stdout:(124/139): python3-pecan-1.4.2-3.el9.noarch.rpm 665 kB/s | 272 kB 00:00 2024-05-07T11:10:59.966 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 82/143 2024-05-07T11:10:59.982 INFO:teuthology.orchestra.run.smithi175.stdout:(125/139): python3-repoze-lru-0.7-16.el9.noarch 245 kB/s | 31 kB 00:00 2024-05-07T11:11:00.024 INFO:teuthology.orchestra.run.smithi175.stdout:(126/139): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-05-07T11:11:00.061 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-05-07T11:11:00.075 INFO:teuthology.orchestra.run.smithi175.stdout:(127/139): python3-rsa-4.9-2.el9.noarch.rpm 506 kB/s | 59 kB 00:00 2024-05-07T11:11:00.142 INFO:teuthology.orchestra.run.smithi175.stdout:(128/139): python3-tempora-5.0.0-2.el9.noarch.r 225 kB/s | 36 kB 00:00 2024-05-07T11:11:00.167 INFO:teuthology.orchestra.run.smithi175.stdout:(129/139): python3-typing-extensions-4.4.0-2.el 359 kB/s | 51 kB 00:00 2024-05-07T11:11:00.225 INFO:teuthology.orchestra.run.smithi175.stdout:(130/139): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-05-07T11:11:00.267 INFO:teuthology.orchestra.run.smithi175.stdout:(131/139): python3-websocket-client-1.2.3-2.el9 899 kB/s | 90 kB 00:00 2024-05-07T11:11:00.351 INFO:teuthology.orchestra.run.smithi175.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 160 kB/s | 20 kB 00:00 2024-05-07T11:11:00.426 INFO:teuthology.orchestra.run.smithi175.stdout:(133/139): python3-werkzeug-2.0.3-3.el9.1.noarc 1.6 MB/s | 427 kB 00:00 2024-05-07T11:11:00.493 INFO:teuthology.orchestra.run.smithi175.stdout:(134/139): re2-20211101-3.el9.x86_64.rpm 851 kB/s | 192 kB 00:00 2024-05-07T11:11:00.758 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-05-07T11:11:00.893 INFO:teuthology.orchestra.run.smithi175.stdout:(135/139): librados2-19.0.0-2504.gb05eb275.el9. 7.3 MB/s | 3.4 MB 00:00 2024-05-07T11:11:00.904 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-05-07T11:11:01.118 INFO:teuthology.orchestra.run.smithi175.stdout:(136/139): thrift-0.15.0-2.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-05-07T11:11:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:(139/139): openssl-3.2.1-1.el9.x86_64.rpm 171 kB/s | 1.3 MB 00:08 2024-05-07T11:11:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-05-07T11:11:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:Total 6.0 MB/s | 211 MB 00:35 2024-05-07T11:11:01.443 INFO:teuthology.orchestra.run.smithi088.stdout:(135/139): librbd1-19.0.0-2504.gb05eb275.el9.x8 2.0 MB/s | 3.1 MB 00:01 2024-05-07T11:11:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:(137/139): librbd1-19.0.0-2504.gb05eb275.el9.x8 3.2 MB/s | 3.1 MB 00:00 2024-05-07T11:11:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:(136/139): librados2-19.0.0-2504.gb05eb275.el9. 1.7 MB/s | 3.4 MB 00:02 2024-05-07T11:11:01.852 INFO:teuthology.orchestra.run.smithi175.stdout:(138/139): openssl-3.2.1-1.el9.x86_64.rpm 1.4 MB/s | 1.3 MB 00:00 2024-05-07T11:11:02.102 INFO:teuthology.orchestra.run.smithi175.stdout:(139/139): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:00 2024-05-07T11:11:02.107 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-05-07T11:11:02.107 INFO:teuthology.orchestra.run.smithi175.stdout:Total 6.0 MB/s | 211 MB 00:35 2024-05-07T11:11:02.127 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-05-07T11:11:02.242 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-05-07T11:11:02.266 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-05-07T11:11:02.266 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-05-07T11:11:02.301 INFO:teuthology.orchestra.run.smithi088.stdout:(137/139): openssl-3.2.1-1.el9.x86_64.rpm 1.6 MB/s | 1.3 MB 00:00 2024-05-07T11:11:02.322 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-05-07T11:11:02.349 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-05-07T11:11:02.383 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 89/143 2024-05-07T11:11:02.712 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-05-07T11:11:02.754 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 91/143 2024-05-07T11:11:02.777 INFO:teuthology.orchestra.run.smithi088.stdout:(138/139): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.6 MB/s | 2.4 MB 00:00 2024-05-07T11:11:02.846 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 91/143 2024-05-07T11:11:02.876 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 92/143 2024-05-07T11:11:02.913 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-05-07T11:11:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-05-07T11:11:03.196 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-05-07T11:11:03.197 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-05-07T11:11:03.410 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-05-07T11:11:03.440 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 95/143 2024-05-07T11:11:03.512 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 95/143 2024-05-07T11:11:03.550 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 96/143 2024-05-07T11:11:04.402 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-05-07T11:11:04.402 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-05-07T11:11:05.211 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-05-07T11:11:05.211 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-05-07T11:11:05.898 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:06.505 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:06.541 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 98/143 2024-05-07T11:11:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 98/143 2024-05-07T11:11:06.632 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-07T11:11:06.632 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-07T11:11:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:06.667 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 99/143 2024-05-07T11:11:09.856 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-05-07T11:11:09.945 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/143 2024-05-07T11:11:09.986 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-05-07T11:11:10.045 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-05-07T11:11:10.079 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-05-07T11:11:10.104 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-05-07T11:11:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-05-07T11:11:10.496 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-05-07T11:11:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:11:10.691 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-05-07T11:11:10.728 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:11:10.765 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:11:10.781 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/143 2024-05-07T11:11:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-05-07T11:11:10.842 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:11:10.880 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 10/143 2024-05-07T11:11:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-05-07T11:11:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:11:10.923 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-05-07T11:11:10.949 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-05-07T11:11:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:11:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-05-07T11:11:11.017 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 12/143 2024-05-07T11:11:11.079 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 12/143 2024-05-07T11:11:11.109 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-05-07T11:11:11.134 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-05-07T11:11:11.278 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-05-07T11:11:11.318 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-05-07T11:11:11.337 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-05-07T11:11:11.426 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/143 2024-05-07T11:11:11.433 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:11:11.519 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-05-07T11:11:11.551 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-05-07T11:11:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:11:11.585 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-05-07T11:11:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:11:11.649 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-05-07T11:11:11.684 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:11:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-05-07T11:11:11.724 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 10/143 2024-05-07T11:11:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/143 2024-05-07T11:11:11.743 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:11:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/143 2024-05-07T11:11:11.796 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/143 2024-05-07T11:11:11.848 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:11:11.865 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 24/143 2024-05-07T11:11:11.869 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 12/143 2024-05-07T11:11:11.918 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 25/143 2024-05-07T11:11:11.931 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 12/143 2024-05-07T11:11:11.954 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-05-07T11:11:11.958 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 26/143 2024-05-07T11:11:11.977 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-05-07T11:11:11.993 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 27/143 2024-05-07T11:11:12.068 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 28/143 2024-05-07T11:11:12.120 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:19.0.0-2504.gb05eb275.el9. 29/143 2024-05-07T11:11:12.163 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el 30/143 2024-05-07T11:11:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-05-07T11:11:12.192 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_6 31/143 2024-05-07T11:11:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-05-07T11:11:12.261 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 32/143 2024-05-07T11:11:12.307 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : luarocks-3.9.2-1.el9.noarch 33/143 2024-05-07T11:11:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/143 2024-05-07T11:11:12.380 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 34/143 2024-05-07T11:11:12.429 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-05-07T11:11:12.512 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/143 2024-05-07T11:11:12.519 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-05-07T11:11:12.553 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-05-07T11:11:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/143 2024-05-07T11:11:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-05-07T11:11:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-05-07T11:11:12.696 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/143 2024-05-07T11:11:12.729 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/143 2024-05-07T11:11:12.757 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/143 2024-05-07T11:11:12.825 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 24/143 2024-05-07T11:11:12.879 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 25/143 2024-05-07T11:11:12.929 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 26/143 2024-05-07T11:11:12.970 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 27/143 2024-05-07T11:11:13.045 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 28/143 2024-05-07T11:11:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.0.0-2504.gb05eb275.el9. 29/143 2024-05-07T11:11:13.089 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/143 2024-05-07T11:11:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el 30/143 2024-05-07T11:11:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_6 31/143 2024-05-07T11:11:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/143 2024-05-07T11:11:13.200 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 39/143 2024-05-07T11:11:13.221 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 32/143 2024-05-07T11:11:13.244 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 40/143 2024-05-07T11:11:13.267 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-1.el9.noarch 33/143 2024-05-07T11:11:13.281 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_6 41/143 2024-05-07T11:11:13.323 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/143 2024-05-07T11:11:13.341 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 34/143 2024-05-07T11:11:13.470 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/143 2024-05-07T11:11:13.480 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/143 2024-05-07T11:11:13.526 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 44/143 2024-05-07T11:11:13.536 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/143 2024-05-07T11:11:13.580 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/143 2024-05-07T11:11:13.644 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/143 2024-05-07T11:11:13.685 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/143 2024-05-07T11:11:13.721 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/143 2024-05-07T11:11:13.767 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/143 2024-05-07T11:11:13.821 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/143 2024-05-07T11:11:13.863 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/143 2024-05-07T11:11:13.998 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/143 2024-05-07T11:11:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/143 2024-05-07T11:11:14.050 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/143 2024-05-07T11:11:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 54/143 2024-05-07T11:11:14.131 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/143 2024-05-07T11:11:14.161 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 39/143 2024-05-07T11:11:14.182 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 55/143 2024-05-07T11:11:14.205 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 40/143 2024-05-07T11:11:14.216 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 56/143 2024-05-07T11:11:14.241 INFO:teuthology.orchestra.run.smithi088.stdout:(139/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 732 kB/s | 16 MB 00:22 2024-05-07T11:11:14.242 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_6 41/143 2024-05-07T11:11:14.246 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-05-07T11:11:14.246 INFO:teuthology.orchestra.run.smithi088.stdout:Total 4.2 MB/s | 211 MB 00:49 2024-05-07T11:11:14.257 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 57/143 2024-05-07T11:11:14.284 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/143 2024-05-07T11:11:14.289 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 58/143 2024-05-07T11:11:14.313 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 59/143 2024-05-07T11:11:14.406 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 60/143 2024-05-07T11:11:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/143 2024-05-07T11:11:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 44/143 2024-05-07T11:11:14.530 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 61/143 2024-05-07T11:11:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/143 2024-05-07T11:11:14.571 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 62/143 2024-05-07T11:11:14.599 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 63/143 2024-05-07T11:11:14.605 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/143 2024-05-07T11:11:14.636 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 64/143 2024-05-07T11:11:14.645 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/143 2024-05-07T11:11:14.666 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/143 2024-05-07T11:11:14.681 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/143 2024-05-07T11:11:14.700 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/143 2024-05-07T11:11:14.728 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/143 2024-05-07T11:11:14.742 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 67/143 2024-05-07T11:11:14.773 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/143 2024-05-07T11:11:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 68/143 2024-05-07T11:11:14.816 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/143 2024-05-07T11:11:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 69/143 2024-05-07T11:11:14.903 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 70/143 2024-05-07T11:11:14.948 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 71/143 2024-05-07T11:11:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/143 2024-05-07T11:11:14.979 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/143 2024-05-07T11:11:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/143 2024-05-07T11:11:15.026 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/143 2024-05-07T11:11:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 54/143 2024-05-07T11:11:15.123 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 74/143 2024-05-07T11:11:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 55/143 2024-05-07T11:11:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 56/143 2024-05-07T11:11:15.180 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-05-07T11:11:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 57/143 2024-05-07T11:11:15.218 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-05-07T11:11:15.282 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 58/143 2024-05-07T11:11:15.307 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 59/143 2024-05-07T11:11:15.354 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-05-07T11:11:15.354 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-05-07T11:11:15.409 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 60/143 2024-05-07T11:11:15.533 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 61/143 2024-05-07T11:11:15.589 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 62/143 2024-05-07T11:11:15.617 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 63/143 2024-05-07T11:11:15.654 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 64/143 2024-05-07T11:11:15.684 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/143 2024-05-07T11:11:15.710 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/143 2024-05-07T11:11:15.743 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 67/143 2024-05-07T11:11:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 68/143 2024-05-07T11:11:15.820 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 69/143 2024-05-07T11:11:15.891 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-05-07T11:11:15.906 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 70/143 2024-05-07T11:11:15.936 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-05-07T11:11:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 71/143 2024-05-07T11:11:15.970 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-05-07T11:11:15.981 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/143 2024-05-07T11:11:16.028 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/143 2024-05-07T11:11:16.066 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-05-07T11:11:16.112 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 80/143 2024-05-07T11:11:16.127 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 74/143 2024-05-07T11:11:16.182 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-05-07T11:11:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.21-2.el9.x86_64 81/143 2024-05-07T11:11:16.326 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 82/143 2024-05-07T11:11:16.405 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-05-07T11:11:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-05-07T11:11:16.947 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-05-07T11:11:16.980 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-05-07T11:11:17.051 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-05-07T11:11:17.077 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-05-07T11:11:17.122 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 80/143 2024-05-07T11:11:17.173 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-05-07T11:11:17.299 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.21-2.el9.x86_64 81/143 2024-05-07T11:11:17.337 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 82/143 2024-05-07T11:11:17.415 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-05-07T11:11:17.626 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-05-07T11:11:17.626 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-05-07T11:11:18.067 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-05-07T11:11:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-05-07T11:11:18.218 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 99/143 2024-05-07T11:11:18.219 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-05-07T11:11:18.219 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-05-07T11:11:18.219 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-05-07T11:11:18.219 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-05-07T11:11:18.219 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-05-07T11:11:18.219 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-05-07T11:11:18.219 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-05-07T11:11:18.219 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:18.386 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 100/143 2024-05-07T11:11:18.400 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-05-07T11:11:18.404 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 100/143 2024-05-07T11:11:18.404 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:18.404 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-07T11:11:18.404 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:18.488 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-05-07T11:11:18.508 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-05-07T11:11:18.532 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 89/143 2024-05-07T11:11:18.844 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-05-07T11:11:18.887 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 91/143 2024-05-07T11:11:18.970 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 91/143 2024-05-07T11:11:19.000 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 92/143 2024-05-07T11:11:19.036 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-05-07T11:11:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-05-07T11:11:19.507 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-05-07T11:11:19.531 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-05-07T11:11:19.548 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 95/143 2024-05-07T11:11:19.551 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-05-07T11:11:19.576 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 89/143 2024-05-07T11:11:19.627 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 95/143 2024-05-07T11:11:19.650 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 96/143 2024-05-07T11:11:19.878 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-05-07T11:11:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 91/143 2024-05-07T11:11:19.940 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 101/143 2024-05-07T11:11:19.968 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 101/143 2024-05-07T11:11:19.968 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:19.968 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-07T11:11:19.969 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T11:11:19.969 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T11:11:19.969 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:20.004 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 91/143 2024-05-07T11:11:20.035 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 92/143 2024-05-07T11:11:20.071 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-05-07T11:11:20.207 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 102/143 2024-05-07T11:11:20.232 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 102/143 2024-05-07T11:11:20.232 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:20.232 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-07T11:11:20.233 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T11:11:20.233 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T11:11:20.233 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:20.548 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-05-07T11:11:20.575 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 95/143 2024-05-07T11:11:20.646 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 95/143 2024-05-07T11:11:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 96/143 2024-05-07T11:11:20.707 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 103/143 2024-05-07T11:11:20.733 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 103/143 2024-05-07T11:11:20.733 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:20.733 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-07T11:11:20.733 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T11:11:20.733 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T11:11:20.733 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:20.846 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-05-07T11:11:20.904 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-05-07T11:11:20.969 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-05-07T11:11:21.163 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-05-07T11:11:21.217 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-05-07T11:11:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-05-07T11:11:21.395 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-05-07T11:11:21.546 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-05-07T11:11:21.592 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-05-07T11:11:21.624 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-05-07T11:11:21.650 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-15.el9.x86_64 114/143 2024-05-07T11:11:21.877 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:21.921 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 115/143 2024-05-07T11:11:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 115/143 2024-05-07T11:11:22.181 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.e 116/143 2024-05-07T11:11:22.246 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275. 117/143 2024-05-07T11:11:22.272 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 118/143 2024-05-07T11:11:22.466 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:22.500 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 98/143 2024-05-07T11:11:22.582 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 98/143 2024-05-07T11:11:22.582 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-07T11:11:22.582 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-07T11:11:22.582 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:22.618 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 99/143 2024-05-07T11:11:22.965 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:23.006 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:23.090 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-05-07T11:11:23.170 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/143 2024-05-07T11:11:23.208 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-05-07T11:11:23.273 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-05-07T11:11:23.312 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-05-07T11:11:23.338 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-05-07T11:11:23.365 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 118/143 2024-05-07T11:11:23.398 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-05-07T11:11:23.399 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 119/143 2024-05-07T11:11:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:23.592 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 98/143 2024-05-07T11:11:23.685 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 98/143 2024-05-07T11:11:23.685 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-07T11:11:23.685 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-07T11:11:23.685 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:23.726 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-05-07T11:11:23.727 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 99/143 2024-05-07T11:11:23.830 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:11:23.960 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:11:23.990 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:11:24.081 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:11:24.121 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 10/143 2024-05-07T11:11:24.149 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:11:24.253 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:11:24.275 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 12/143 2024-05-07T11:11:24.337 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 12/143 2024-05-07T11:11:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-05-07T11:11:24.382 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-05-07T11:11:24.420 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 119/143 2024-05-07T11:11:24.449 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 120/143 2024-05-07T11:11:24.558 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 120/143 2024-05-07T11:11:24.578 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-05-07T11:11:24.609 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-05-07T11:11:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/143 2024-05-07T11:11:24.745 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el 121/143 2024-05-07T11:11:24.759 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 122/143 2024-05-07T11:11:24.785 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 122/143 2024-05-07T11:11:24.785 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:24.785 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-07T11:11:24.785 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T11:11:24.785 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T11:11:24.785 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:24.835 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 123/143 2024-05-07T11:11:24.837 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-05-07T11:11:24.847 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 123/143 2024-05-07T11:11:24.884 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-05-07T11:11:24.919 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-05-07T11:11:24.950 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 124/143 2024-05-07T11:11:24.992 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-05-07T11:11:25.014 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 125/143 2024-05-07T11:11:25.027 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-05-07T11:11:25.070 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/143 2024-05-07T11:11:25.103 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/143 2024-05-07T11:11:25.130 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/143 2024-05-07T11:11:25.200 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 24/143 2024-05-07T11:11:25.253 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 25/143 2024-05-07T11:11:25.291 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 26/143 2024-05-07T11:11:25.335 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 27/143 2024-05-07T11:11:25.411 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 28/143 2024-05-07T11:11:25.446 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:19.0.0-2504.gb05eb275.el9. 29/143 2024-05-07T11:11:25.489 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el 30/143 2024-05-07T11:11:25.517 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_6 31/143 2024-05-07T11:11:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 32/143 2024-05-07T11:11:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : luarocks-3.9.2-1.el9.noarch 33/143 2024-05-07T11:11:25.706 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 34/143 2024-05-07T11:11:25.839 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/143 2024-05-07T11:11:25.892 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/143 2024-05-07T11:11:25.958 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/143 2024-05-07T11:11:25.990 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 127/143 2024-05-07T11:11:26.015 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 127/143 2024-05-07T11:11:26.015 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:26.015 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-07T11:11:26.015 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T11:11:26.015 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T11:11:26.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:26.057 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 128/143 2024-05-07T11:11:26.081 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 128/143 2024-05-07T11:11:26.082 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:26.082 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-07T11:11:26.082 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:26.414 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/143 2024-05-07T11:11:26.429 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 129/143 2024-05-07T11:11:26.454 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 129/143 2024-05-07T11:11:26.454 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:26.455 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-07T11:11:26.455 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T11:11:26.455 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T11:11:26.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:26.504 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/143 2024-05-07T11:11:26.534 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 39/143 2024-05-07T11:11:26.577 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 40/143 2024-05-07T11:11:26.639 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_6 41/143 2024-05-07T11:11:26.682 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/143 2024-05-07T11:11:26.867 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/143 2024-05-07T11:11:26.934 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 44/143 2024-05-07T11:11:26.989 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/143 2024-05-07T11:11:27.061 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/143 2024-05-07T11:11:27.101 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/143 2024-05-07T11:11:27.137 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/143 2024-05-07T11:11:27.184 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/143 2024-05-07T11:11:27.230 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/143 2024-05-07T11:11:27.271 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/143 2024-05-07T11:11:27.406 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/143 2024-05-07T11:11:27.457 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/143 2024-05-07T11:11:27.498 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 54/143 2024-05-07T11:11:27.592 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 55/143 2024-05-07T11:11:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 56/143 2024-05-07T11:11:27.666 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 57/143 2024-05-07T11:11:27.697 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 58/143 2024-05-07T11:11:27.722 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 59/143 2024-05-07T11:11:27.811 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 60/143 2024-05-07T11:11:27.940 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 61/143 2024-05-07T11:11:27.979 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 62/143 2024-05-07T11:11:28.013 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 63/143 2024-05-07T11:11:28.052 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 64/143 2024-05-07T11:11:28.083 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/143 2024-05-07T11:11:28.117 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/143 2024-05-07T11:11:28.150 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 67/143 2024-05-07T11:11:28.192 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 68/143 2024-05-07T11:11:28.226 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 69/143 2024-05-07T11:11:28.312 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 70/143 2024-05-07T11:11:28.357 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 71/143 2024-05-07T11:11:28.388 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/143 2024-05-07T11:11:28.435 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/143 2024-05-07T11:11:28.533 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-packaging-20.9-5.el9.noarch 74/143 2024-05-07T11:11:28.581 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-05-07T11:11:29.298 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-05-07T11:11:29.345 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-05-07T11:11:29.379 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-05-07T11:11:29.476 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-05-07T11:11:29.521 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 80/143 2024-05-07T11:11:29.697 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.21-2.el9.x86_64 81/143 2024-05-07T11:11:29.727 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 82/143 2024-05-07T11:11:29.809 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-05-07T11:11:30.449 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-05-07T11:11:30.566 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-05-07T11:11:31.262 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 130/143 2024-05-07T11:11:31.303 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 131/143 2024-05-07T11:11:31.352 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 132/143 2024-05-07T11:11:31.384 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/143 2024-05-07T11:11:31.411 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/143 2024-05-07T11:11:31.812 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-05-07T11:11:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-05-07T11:11:31.925 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-05-07T11:11:31.958 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 89/143 2024-05-07T11:11:32.270 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-05-07T11:11:32.313 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 91/143 2024-05-07T11:11:32.319 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_ 135/143 2024-05-07T11:11:32.404 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 91/143 2024-05-07T11:11:32.411 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 136/143 2024-05-07T11:11:32.435 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 92/143 2024-05-07T11:11:32.470 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-05-07T11:11:32.473 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-05-07T11:11:32.586 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-05-07T11:11:32.624 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-05-07T11:11:32.624 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-05-07T11:11:32.708 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-05-07T11:11:32.740 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-05-07T11:11:32.741 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-05-07T11:11:32.818 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-05-07T11:11:32.893 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:11:32.942 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-05-07T11:11:32.982 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 95/143 2024-05-07T11:11:33.054 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 95/143 2024-05-07T11:11:33.076 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 96/143 2024-05-07T11:11:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 99/143 2024-05-07T11:11:34.292 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-05-07T11:11:34.292 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-05-07T11:11:34.292 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-05-07T11:11:34.292 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-05-07T11:11:34.292 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-05-07T11:11:34.292 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-05-07T11:11:34.292 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-05-07T11:11:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:34.446 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 100/143 2024-05-07T11:11:34.461 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 100/143 2024-05-07T11:11:34.461 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:34.461 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-07T11:11:34.462 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:35.096 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 99/143 2024-05-07T11:11:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-05-07T11:11:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-05-07T11:11:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-05-07T11:11:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-05-07T11:11:35.097 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-05-07T11:11:35.097 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-05-07T11:11:35.097 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-05-07T11:11:35.097 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 100/143 2024-05-07T11:11:35.277 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 100/143 2024-05-07T11:11:35.277 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:35.277 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-07T11:11:35.278 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:35.355 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:35.911 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 97/143 2024-05-07T11:11:35.948 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 101/143 2024-05-07T11:11:35.950 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 98/143 2024-05-07T11:11:35.974 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 101/143 2024-05-07T11:11:35.975 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:35.975 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-07T11:11:35.975 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T11:11:35.975 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T11:11:35.975 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:36.051 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 98/143 2024-05-07T11:11:36.051 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-07T11:11:36.051 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-07T11:11:36.051 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:11:36.085 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 99/143 2024-05-07T11:11:36.208 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 102/143 2024-05-07T11:11:36.233 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 102/143 2024-05-07T11:11:36.233 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:36.233 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-07T11:11:36.233 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T11:11:36.233 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T11:11:36.234 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:36.684 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 103/143 2024-05-07T11:11:36.707 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 103/143 2024-05-07T11:11:36.708 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:36.708 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-07T11:11:36.708 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T11:11:36.708 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T11:11:36.708 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:36.764 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 101/143 2024-05-07T11:11:36.791 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 101/143 2024-05-07T11:11:36.791 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:36.791 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-07T11:11:36.791 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T11:11:36.791 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T11:11:36.792 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:36.823 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-05-07T11:11:36.888 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-05-07T11:11:36.946 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-05-07T11:11:37.024 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 102/143 2024-05-07T11:11:37.049 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 102/143 2024-05-07T11:11:37.049 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:37.050 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-07T11:11:37.050 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T11:11:37.050 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T11:11:37.050 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:37.129 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-05-07T11:11:37.207 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-05-07T11:11:37.282 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-05-07T11:11:37.371 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-05-07T11:11:37.507 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-05-07T11:11:37.509 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 103/143 2024-05-07T11:11:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 103/143 2024-05-07T11:11:37.532 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:37.532 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-07T11:11:37.532 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T11:11:37.532 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T11:11:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:37.554 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-05-07T11:11:37.586 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-05-07T11:11:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-15.el9.x86_64 114/143 2024-05-07T11:11:37.631 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-05-07T11:11:37.687 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-05-07T11:11:37.742 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-05-07T11:11:37.927 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-05-07T11:11:37.976 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-05-07T11:11:38.016 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 115/143 2024-05-07T11:11:38.045 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 115/143 2024-05-07T11:11:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:11:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 1/143 2024-05-07T11:11:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 2/143 2024-05-07T11:11:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 3/143 2024-05-07T11:11:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 4/143 2024-05-07T11:11:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 5/143 2024-05-07T11:11:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 6/143 2024-05-07T11:11:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 7/143 2024-05-07T11:11:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 10/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 12/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_ 13/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 14/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 15/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_6 16/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 17/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 18/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el 19/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.0.0-2504.gb05eb275.el9. 20/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_6 21/143 2024-05-07T11:11:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 22/143 2024-05-07T11:11:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 23/143 2024-05-07T11:11:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 24/143 2024-05-07T11:11:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 25/143 2024-05-07T11:11:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 26/143 2024-05-07T11:11:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 27/143 2024-05-07T11:11:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275. 28/143 2024-05-07T11:11:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 29/143 2024-05-07T11:11:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 30/143 2024-05-07T11:11:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 31/143 2024-05-07T11:11:38.053 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-05-07T11:11:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el 32/143 2024-05-07T11:11:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 33/143 2024-05-07T11:11:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.e 34/143 2024-05-07T11:11:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 35/143 2024-05-07T11:11:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 36/143 2024-05-07T11:11:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/143 2024-05-07T11:11:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-05-07T11:11:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-05-07T11:11:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-05-07T11:11:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-05-07T11:11:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-05-07T11:11:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-05-07T11:11:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-05-07T11:11:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-05-07T11:11:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/143 2024-05-07T11:11:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/143 2024-05-07T11:11:38.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-05-07T11:11:38.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-05-07T11:11:38.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 69/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-05-07T11:11:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-05-07T11:11:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-05-07T11:11:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 110/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-05-07T11:11:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/143 2024-05-07T11:11:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 136/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 138/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 140/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-05-07T11:11:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 142/143 2024-05-07T11:11:38.085 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.e 116/143 2024-05-07T11:11:38.141 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-05-07T11:11:38.146 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275. 117/143 2024-05-07T11:11:38.176 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 118/143 2024-05-07T11:11:38.271 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-05-07T11:11:38.310 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-05-07T11:11:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-05-07T11:11:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-15.el9.x86_64 114/143 2024-05-07T11:11:38.805 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 115/143 2024-05-07T11:11:38.834 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 115/143 2024-05-07T11:11:38.865 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.e 116/143 2024-05-07T11:11:38.926 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275. 117/143 2024-05-07T11:11:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 118/143 2024-05-07T11:11:39.203 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 118/143 2024-05-07T11:11:39.245 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 119/143 2024-05-07T11:11:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 118/143 2024-05-07T11:11:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 119/143 2024-05-07T11:11:40.202 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 119/143 2024-05-07T11:11:40.228 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 120/143 2024-05-07T11:11:40.330 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 120/143 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout: automake-1.16.2-8.el9.noarch 2024-05-07T11:11:40.385 INFO:teuthology.orchestra.run.smithi062.stdout: bison-3.7.4-5.el9.x86_64 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:40.386 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: flex-2.6.4-9.el9.x86_64 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-07T11:11:40.387 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-07T11:11:40.388 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-07T11:11:40.389 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-07T11:11:40.390 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-07T11:11:40.391 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-05-07T11:11:40.392 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-07T11:11:40.393 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.394 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.395 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:40.395 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-3.el9.x86_64 2024-05-07T11:11:40.395 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-07T11:11:40.395 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-07T11:11:40.395 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-07T11:11:40.395 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-07T11:11:40.395 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-07T11:11:40.395 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:11:40.395 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-07T11:11:40.499 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el 121/143 2024-05-07T11:11:40.530 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 122/143 2024-05-07T11:11:40.555 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 122/143 2024-05-07T11:11:40.555 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:40.555 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-07T11:11:40.555 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T11:11:40.555 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T11:11:40.555 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:40.606 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 123/143 2024-05-07T11:11:40.617 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 123/143 2024-05-07T11:11:40.714 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 124/143 2024-05-07T11:11:40.761 DEBUG:teuthology.parallel:result is None 2024-05-07T11:11:40.767 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 125/143 2024-05-07T11:11:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 119/143 2024-05-07T11:11:41.025 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 120/143 2024-05-07T11:11:41.125 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 120/143 2024-05-07T11:11:41.282 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el 121/143 2024-05-07T11:11:41.319 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 122/143 2024-05-07T11:11:41.342 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 122/143 2024-05-07T11:11:41.342 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:41.343 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-07T11:11:41.343 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T11:11:41.343 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T11:11:41.343 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:41.386 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 123/143 2024-05-07T11:11:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 123/143 2024-05-07T11:11:41.501 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 124/143 2024-05-07T11:11:41.557 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 125/143 2024-05-07T11:11:41.678 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/143 2024-05-07T11:11:41.708 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 127/143 2024-05-07T11:11:41.732 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 127/143 2024-05-07T11:11:41.733 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:41.733 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-07T11:11:41.733 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T11:11:41.733 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T11:11:41.733 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:41.797 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 128/143 2024-05-07T11:11:41.820 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 128/143 2024-05-07T11:11:41.820 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:41.820 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-07T11:11:41.820 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:42.118 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 129/143 2024-05-07T11:11:42.141 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 129/143 2024-05-07T11:11:42.142 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:42.142 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-07T11:11:42.142 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T11:11:42.142 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T11:11:42.142 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:42.458 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/143 2024-05-07T11:11:42.482 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 127/143 2024-05-07T11:11:42.506 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 127/143 2024-05-07T11:11:42.506 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:42.506 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-07T11:11:42.506 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T11:11:42.506 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T11:11:42.506 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 128/143 2024-05-07T11:11:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 128/143 2024-05-07T11:11:42.580 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:42.580 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-07T11:11:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 129/143 2024-05-07T11:11:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 129/143 2024-05-07T11:11:42.915 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:42.915 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-07T11:11:42.915 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T11:11:42.915 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T11:11:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:46.654 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 130/143 2024-05-07T11:11:46.696 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 131/143 2024-05-07T11:11:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 132/143 2024-05-07T11:11:46.769 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/143 2024-05-07T11:11:46.795 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/143 2024-05-07T11:11:47.445 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 130/143 2024-05-07T11:11:47.486 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 131/143 2024-05-07T11:11:47.527 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 132/143 2024-05-07T11:11:47.560 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/143 2024-05-07T11:11:47.565 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 99/143 2024-05-07T11:11:47.565 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2024-05-07T11:11:47.566 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2024-05-07T11:11:47.566 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2024-05-07T11:11:47.566 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2024-05-07T11:11:47.566 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2024-05-07T11:11:47.566 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /root 2024-05-07T11:11:47.566 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2024-05-07T11:11:47.566 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:11:47.586 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/143 2024-05-07T11:11:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_ 135/143 2024-05-07T11:11:47.723 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 100/143 2024-05-07T11:11:47.729 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 136/143 2024-05-07T11:11:47.738 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 100/143 2024-05-07T11:11:47.738 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:47.738 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-07T11:11:47.739 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:11:47.785 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-05-07T11:11:47.878 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-05-07T11:11:47.908 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-05-07T11:11:47.908 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-05-07T11:11:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-05-07T11:11:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-05-07T11:11:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-05-07T11:11:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-05-07T11:11:48.183 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:11:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_ 135/143 2024-05-07T11:11:48.503 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 136/143 2024-05-07T11:11:48.565 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-05-07T11:11:48.682 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-05-07T11:11:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-05-07T11:11:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-05-07T11:11:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-05-07T11:11:48.824 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-05-07T11:11:48.825 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-05-07T11:11:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-05-07T11:11:48.982 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:11:49.219 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 101/143 2024-05-07T11:11:49.245 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 101/143 2024-05-07T11:11:49.246 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:49.246 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-07T11:11:49.246 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T11:11:49.246 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T11:11:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:11:49.470 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 102/143 2024-05-07T11:11:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 102/143 2024-05-07T11:11:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-07T11:11:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T11:11:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T11:11:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:11:49.929 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 103/143 2024-05-07T11:11:49.952 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 103/143 2024-05-07T11:11:49.952 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:49.952 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-07T11:11:49.952 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T11:11:49.952 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T11:11:49.952 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:11:50.058 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-05-07T11:11:50.107 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-05-07T11:11:50.163 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-05-07T11:11:50.347 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-05-07T11:11:50.399 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-05-07T11:11:50.473 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-05-07T11:11:50.560 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-05-07T11:11:50.695 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-05-07T11:11:50.738 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-05-07T11:11:50.770 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-05-07T11:11:50.797 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.9-15.el9.x86_64 114/143 2024-05-07T11:11:51.251 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 115/143 2024-05-07T11:11:51.271 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 115/143 2024-05-07T11:11:51.303 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.e 116/143 2024-05-07T11:11:51.364 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275. 117/143 2024-05-07T11:11:51.394 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 118/143 2024-05-07T11:11:52.428 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 118/143 2024-05-07T11:11:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 119/143 2024-05-07T11:11:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 1/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 2/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 3/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 4/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 5/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 6/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 7/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 10/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 12/143 2024-05-07T11:11:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_ 13/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 14/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 15/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_6 16/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 17/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 18/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el 19/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:19.0.0-2504.gb05eb275.el9. 20/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_6 21/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 22/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 23/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 24/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 25/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 26/143 2024-05-07T11:11:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 27/143 2024-05-07T11:11:53.340 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275. 28/143 2024-05-07T11:11:53.340 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 29/143 2024-05-07T11:11:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 30/143 2024-05-07T11:11:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 31/143 2024-05-07T11:11:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el 32/143 2024-05-07T11:11:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 33/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.e 34/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 35/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 36/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-05-07T11:11:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-05-07T11:11:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 69/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-05-07T11:11:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/143 2024-05-07T11:11:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-05-07T11:11:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 110/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-05-07T11:11:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-05-07T11:11:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-05-07T11:11:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/143 2024-05-07T11:11:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-05-07T11:11:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 136/143 2024-05-07T11:11:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-05-07T11:11:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 138/143 2024-05-07T11:11:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-05-07T11:11:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 140/143 2024-05-07T11:11:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-05-07T11:11:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 142/143 2024-05-07T11:11:53.431 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 119/143 2024-05-07T11:11:53.463 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 120/143 2024-05-07T11:11:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 120/143 2024-05-07T11:11:53.725 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el 121/143 2024-05-07T11:11:53.748 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 122/143 2024-05-07T11:11:53.772 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 122/143 2024-05-07T11:11:53.772 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:53.772 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-07T11:11:53.772 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T11:11:53.772 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T11:11:53.772 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:11:53.822 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 123/143 2024-05-07T11:11:53.833 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 123/143 2024-05-07T11:11:53.937 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 124/143 2024-05-07T11:11:53.984 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 125/143 2024-05-07T11:11:54.177 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:11:54.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 1/143 2024-05-07T11:11:54.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 2/143 2024-05-07T11:11:54.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 3/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 4/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 5/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 6/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 7/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 10/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 12/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_ 13/143 2024-05-07T11:11:54.178 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 14/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 15/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_6 16/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 17/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 18/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el 19/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.0.0-2504.gb05eb275.el9. 20/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_6 21/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 22/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 23/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 24/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 25/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 26/143 2024-05-07T11:11:54.179 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 27/143 2024-05-07T11:11:54.191 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275. 28/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 29/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 30/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 31/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el 32/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 33/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.e 34/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 35/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 36/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-05-07T11:11:54.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-05-07T11:11:54.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-05-07T11:11:54.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-05-07T11:11:54.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-05-07T11:11:54.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/143 2024-05-07T11:11:54.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/143 2024-05-07T11:11:54.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-05-07T11:11:54.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-05-07T11:11:54.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-05-07T11:11:54.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 69/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-05-07T11:11:54.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-05-07T11:11:54.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-05-07T11:11:54.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/143 2024-05-07T11:11:54.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-05-07T11:11:54.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-05-07T11:11:54.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 110/143 2024-05-07T11:11:54.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-05-07T11:11:54.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-05-07T11:11:54.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-05-07T11:11:54.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-05-07T11:11:54.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-05-07T11:11:54.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/143 2024-05-07T11:11:54.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 136/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 138/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 140/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-05-07T11:11:54.200 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 142/143 2024-05-07T11:11:54.881 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/143 2024-05-07T11:11:54.910 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 127/143 2024-05-07T11:11:54.934 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 127/143 2024-05-07T11:11:54.934 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:54.934 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-07T11:11:54.934 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T11:11:54.934 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T11:11:54.934 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:11:54.977 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 128/143 2024-05-07T11:11:55.000 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 128/143 2024-05-07T11:11:55.000 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:55.001 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-07T11:11:55.001 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:11:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 129/143 2024-05-07T11:11:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 129/143 2024-05-07T11:11:55.326 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T11:11:55.326 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-07T11:11:55.326 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T11:11:55.327 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T11:11:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:11:55.689 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:11:55.689 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:55.689 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-05-07T11:11:55.690 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.690 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.690 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-07T11:11:55.690 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-07T11:11:55.690 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-05-07T11:11:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-07T11:11:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.2-8.el9.noarch 2024-05-07T11:11:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.7.4-5.el9.x86_64 2024-05-07T11:11:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-07T11:11:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-07T11:11:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.4-9.el9.x86_64 2024-05-07T11:11:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-07T11:11:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-07T11:11:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-07T11:11:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-07T11:11:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-07T11:11:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-07T11:11:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-07T11:11:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-07T11:11:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: lua-5.4.4-4.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-07T11:11:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-07T11:11:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-07T11:11:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-07T11:11:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-07T11:11:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-07T11:11:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-07T11:11:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-07T11:11:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-07T11:11:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-07T11:11:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-07T11:11:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-3.el9.x86_64 2024-05-07T11:11:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-07T11:11:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-07T11:11:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-07T11:11:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-07T11:11:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-07T11:11:55.705 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:11:55.705 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-05-07T11:11:56.119 DEBUG:teuthology.parallel:result is None 2024-05-07T11:11:56.813 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:11:56.813 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:56.813 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-05-07T11:11:56.813 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.814 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.815 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-07T11:11:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-07T11:11:56.818 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-07T11:11:56.819 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-07T11:11:56.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-07T11:11:56.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-07T11:11:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-07T11:11:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-07T11:11:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-07T11:11:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:11:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-3.el9.x86_64 2024-05-07T11:11:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-07T11:11:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-07T11:11:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-07T11:11:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-07T11:11:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-07T11:11:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:11:56.824 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-05-07T11:11:57.190 DEBUG:teuthology.parallel:result is None 2024-05-07T11:11:59.865 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 130/143 2024-05-07T11:11:59.906 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 131/143 2024-05-07T11:11:59.947 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 132/143 2024-05-07T11:11:59.979 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/143 2024-05-07T11:12:00.006 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/143 2024-05-07T11:12:00.850 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_ 135/143 2024-05-07T11:12:00.939 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 136/143 2024-05-07T11:12:00.997 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-05-07T11:12:01.091 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-05-07T11:12:01.127 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-05-07T11:12:01.127 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-05-07T11:12:01.211 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-05-07T11:12:01.244 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-05-07T11:12:01.244 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-05-07T11:12:01.329 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-05-07T11:12:01.394 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:12:06.599 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:12:06.599 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 1/143 2024-05-07T11:12:06.599 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 2/143 2024-05-07T11:12:06.599 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 3/143 2024-05-07T11:12:06.599 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 4/143 2024-05-07T11:12:06.599 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2504.gb05eb 5/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 6/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 7/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 8/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 9/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 10/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 11/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 12/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_ 13/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 14/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 15/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_6 16/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86 17/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 18/143 2024-05-07T11:12:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el 19/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:19.0.0-2504.gb05eb275.el9. 20/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_6 21/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 22/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 23/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 24/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 25/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 26/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 27/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275. 28/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noa 29/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.n 30/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05 31/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el 32/143 2024-05-07T11:12:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 33/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.e 34/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 35/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 36/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-05-07T11:12:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-05-07T11:12:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 69/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-05-07T11:12:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-05-07T11:12:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-05-07T11:12:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 110/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-05-07T11:12:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-05-07T11:12:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 136/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 138/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 140/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-05-07T11:12:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 142/143 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout: automake-1.16.2-8.el9.noarch 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.7.4-5.el9.x86_64 2024-05-07T11:12:08.992 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:12:08.993 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:19.0.0-2504.gb05eb275.el9.noarch 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.4-9.el9.x86_64 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-07T11:12:08.994 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-07T11:12:08.995 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: lua-5.4.4-4.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-07T11:12:08.996 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-07T11:12:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-07T11:12:08.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply-3.11-14.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-07T11:12:08.999 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-07T11:12:09.000 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:19.0.0-2504.gb05eb275.el9.x86_64 2024-05-07T11:12:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: re2-1:20211101-3.el9.x86_64 2024-05-07T11:12:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-07T11:12:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-07T11:12:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-07T11:12:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-07T11:12:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-07T11:12:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:09.002 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-05-07T11:12:09.387 DEBUG:teuthology.parallel:result is None 2024-05-07T11:12:09.388 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b05eb2754514c6559f7c34d831877d418ea3a9c7 2024-05-07T11:12:09.621 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-07T11:12:09.648 INFO:teuthology.orchestra.run.smithi062.stdout:19.0.0-2504.gb05eb275.el9 2024-05-07T11:12:09.649 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2504.gb05eb275.el9 2024-05-07T11:12:09.649 INFO:teuthology.task.install:The correct ceph version 19.0.0-2504.gb05eb275 is installed. 2024-05-07T11:12:09.651 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b05eb2754514c6559f7c34d831877d418ea3a9c7 2024-05-07T11:12:09.798 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-07T11:12:09.820 INFO:teuthology.orchestra.run.smithi088.stdout:19.0.0-2504.gb05eb275.el9 2024-05-07T11:12:09.821 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2504.gb05eb275.el9 2024-05-07T11:12:09.821 INFO:teuthology.task.install:The correct ceph version 19.0.0-2504.gb05eb275 is installed. 2024-05-07T11:12:09.823 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b05eb2754514c6559f7c34d831877d418ea3a9c7 2024-05-07T11:12:09.961 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-07T11:12:09.990 INFO:teuthology.orchestra.run.smithi149.stdout:19.0.0-2504.gb05eb275.el9 2024-05-07T11:12:09.990 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2504.gb05eb275.el9 2024-05-07T11:12:09.991 INFO:teuthology.task.install:The correct ceph version 19.0.0-2504.gb05eb275 is installed. 2024-05-07T11:12:09.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b05eb2754514c6559f7c34d831877d418ea3a9c7 2024-05-07T11:12:10.214 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-07T11:12:10.240 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-2504.gb05eb275.el9 2024-05-07T11:12:10.241 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2504.gb05eb275.el9 2024-05-07T11:12:10.241 INFO:teuthology.task.install:The correct ceph version 19.0.0-2504.gb05eb275 is installed. 2024-05-07T11:12:10.243 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-07T11:12:10.243 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:10.243 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-07T11:12:10.278 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:12:10.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-07T11:12:10.309 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:12:10.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-07T11:12:10.342 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:12:10.342 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-07T11:12:10.375 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-07T11:12:10.375 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:10.375 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-05-07T11:12:10.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-07T11:12:10.476 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:12:10.476 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-05-07T11:12:10.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-07T11:12:10.573 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:12:10.573 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-05-07T11:12:10.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-07T11:12:10.672 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:12:10.672 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-05-07T11:12:10.702 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-07T11:12:10.770 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-07T11:12:10.771 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:10.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-07T11:12:10.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-07T11:12:10.869 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:12:10.869 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-07T11:12:10.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-07T11:12:10.965 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:12:10.965 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-07T11:12:10.998 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-07T11:12:11.062 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:12:11.063 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-07T11:12:11.092 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-07T11:12:11.161 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-07T11:12:11.161 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:11.162 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-05-07T11:12:11.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-07T11:12:11.255 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:12:11.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-05-07T11:12:11.285 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-07T11:12:11.355 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:12:11.356 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-05-07T11:12:11.385 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-07T11:12:11.455 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:12:11.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-05-07T11:12:11.485 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-07T11:12:11.553 INFO:teuthology.run_tasks:Running task ceph... 2024-05-07T11:12:11.643 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-07T11:12:11.644 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-05-07T11:12:11.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2024-05-07T11:12:11.650 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2024-05-07T11:12:11.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-05-07T11:12:11.682 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-07T11:12:11.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-07T11:12:11.712 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-07T11:12:11.719 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-07T11:12:11.725 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-07T11:12:11.753 INFO:tasks.ceph:Creating extra log directories... 2024-05-07T11:12:11.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-07T11:12:11.777 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-07T11:12:11.787 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-07T11:12:11.796 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-07T11:12:11.844 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-07T11:12:11.844 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-07T11:12:11.845 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7694861', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '510b35d4b766757579df5fd9efd2f892309f09e1'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 466, 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_510b35d4b766757579df5fd9efd2f892309f09e1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '510b35d4b766757579df5fd9efd2f892309f09e1', 'targets': {'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNe3riJAovr1mD7EZKsLr2BKG9M1rS7AtGi+8aZBwYveI+vn3NhpWprR0chamwPBTEsJQcKyBJUr/sQhDjtQUw=', 'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIXu0uzxb/cVcJHa8ICjt2brwa2gNIApw8TJIEPlNy5ehzJvSE1eoUGiDMs5DYxwxAqekV+dUpw0uB4bWwRo630=', 'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAEKd7xti3tEPj+/xoerh7OXC0gHE7S7LVt3AyqJmmzQncEBiREZzUHFxUmyWeP5Uda8n+RPGcD/wJb+n0Bpk0k=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkFJFZyYxW4WjMXovFMeaXL96Rttq7VuZkBBGQHAnUf3QT0VN4iH5OhhxhGWJ+y+VakYTlIelr/k5Pij3Y3T9A='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsx.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-06_21:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-07T11:12:11.846 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-07T11:12:11.852 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-07T11:12:11.854 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-07T11:12:11.871 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-07T11:12:11.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-05-07T11:12:11.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2024-05-07T11:12:11.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2024-05-07T11:12:11.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-05-07T11:12:11.954 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:12:11.954 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-05-07T11:12:11.992 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-07T11:12:11.992 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-05-07T11:12:12.048 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-07T11:12:12.049 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:12.049 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-07T11:12:12.049 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:12.049 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:12.049 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-05-07 11:12:01.751104587 +0000 2024-05-07T11:12:12.049 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-05-07 11:09:19.591201378 +0000 2024-05-07T11:12:12.049 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-05-07 11:09:19.591201378 +0000 2024-05-07T11:12:12.049 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-05-07 11:09:19.591201378 +0000 2024-05-07T11:12:12.049 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-07T11:12:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-05-07T11:12:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-05-07T11:12:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000204813 s, 2.5 MB/s 2024-05-07T11:12:12.114 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-07T11:12:12.171 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-05-07T11:12:12.227 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-07T11:12:12.227 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:12.227 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-07T11:12:12.227 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:12.227 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:12.227 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-05-07 11:12:01.751104587 +0000 2024-05-07T11:12:12.227 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-05-07 11:09:19.933194376 +0000 2024-05-07T11:12:12.227 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-05-07 11:09:19.933194376 +0000 2024-05-07T11:12:12.227 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-05-07 11:09:19.933194376 +0000 2024-05-07T11:12:12.227 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-07T11:12:12.289 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-05-07T11:12:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-05-07T11:12:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000184186 s, 2.8 MB/s 2024-05-07T11:12:12.291 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-07T11:12:12.347 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-05-07T11:12:12.403 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-07T11:12:12.403 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:12.403 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-07T11:12:12.403 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:12.403 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:12.403 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-05-07 11:12:01.751104587 +0000 2024-05-07T11:12:12.403 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-05-07 11:09:20.275187374 +0000 2024-05-07T11:12:12.403 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-05-07 11:09:20.275187374 +0000 2024-05-07T11:12:12.403 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-05-07 11:09:20.275187374 +0000 2024-05-07T11:12:12.403 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-07T11:12:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-05-07T11:12:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-05-07T11:12:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000194568 s, 2.6 MB/s 2024-05-07T11:12:12.467 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-07T11:12:12.524 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-05-07T11:12:12.578 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-07T11:12:12.579 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:12.579 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-07T11:12:12.579 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:12.579 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:12.579 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-05-07 11:12:01.751104587 +0000 2024-05-07T11:12:12.579 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-05-07 11:09:20.616180393 +0000 2024-05-07T11:12:12.579 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-05-07 11:09:20.616180393 +0000 2024-05-07T11:12:12.579 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-05-07 11:09:20.616180393 +0000 2024-05-07T11:12:12.579 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-07T11:12:12.642 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-05-07T11:12:12.642 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-05-07T11:12:12.642 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000188054 s, 2.7 MB/s 2024-05-07T11:12:12.643 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-07T11:12:12.699 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-07T11:12:12.700 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:12:12.700 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-05-07T11:12:12.719 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-07T11:12:12.719 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-05-07T11:12:12.777 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-07T11:12:12.778 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:12.778 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-07T11:12:12.778 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:12.778 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:12.778 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-07 11:11:48.548328540 +0000 2024-05-07T11:12:12.778 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-07 11:09:24.345372178 +0000 2024-05-07T11:12:12.778 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-07 11:09:24.345372178 +0000 2024-05-07T11:12:12.778 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-07 11:09:24.345372178 +0000 2024-05-07T11:12:12.778 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-07T11:12:12.846 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-07T11:12:12.847 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-07T11:12:12.847 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000255413 s, 2.0 MB/s 2024-05-07T11:12:12.847 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-07T11:12:12.906 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-05-07T11:12:12.963 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-07T11:12:12.964 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:12.964 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-07T11:12:12.964 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:12.964 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:12.964 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-07 11:11:48.549328520 +0000 2024-05-07T11:12:12.964 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-07 11:09:24.686365401 +0000 2024-05-07T11:12:12.964 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-07 11:09:24.686365401 +0000 2024-05-07T11:12:12.964 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-07 11:09:24.686365401 +0000 2024-05-07T11:12:12.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-07T11:12:13.033 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-07T11:12:13.033 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-07T11:12:13.033 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000230003 s, 2.2 MB/s 2024-05-07T11:12:13.034 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-07T11:12:13.093 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-05-07T11:12:13.151 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-07T11:12:13.151 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:13.151 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-07T11:12:13.151 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:13.151 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:13.151 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-07 11:11:48.549328520 +0000 2024-05-07T11:12:13.151 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-07 11:09:25.024358683 +0000 2024-05-07T11:12:13.152 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-07 11:09:25.024358683 +0000 2024-05-07T11:12:13.152 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-07 11:09:25.024358683 +0000 2024-05-07T11:12:13.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-07T11:12:13.217 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-07T11:12:13.218 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-07T11:12:13.218 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000199726 s, 2.6 MB/s 2024-05-07T11:12:13.219 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-07T11:12:13.279 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-05-07T11:12:13.336 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-07T11:12:13.336 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:13.336 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-07T11:12:13.336 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:13.336 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:13.336 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-07 11:11:48.549328520 +0000 2024-05-07T11:12:13.336 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-07 11:09:25.366351886 +0000 2024-05-07T11:12:13.336 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-07 11:09:25.366351886 +0000 2024-05-07T11:12:13.336 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-07 11:09:25.366351886 +0000 2024-05-07T11:12:13.337 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-07T11:12:13.401 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-07T11:12:13.401 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-07T11:12:13.401 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000169053 s, 3.0 MB/s 2024-05-07T11:12:13.402 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-07T11:12:13.460 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-05-07T11:12:13.460 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:12:13.460 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-05-07T11:12:13.480 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-07T11:12:13.480 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-05-07T11:12:13.539 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-07T11:12:13.539 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:13.539 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-07T11:12:13.539 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:13.539 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:13.539 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-05-07 11:11:49.336690305 +0000 2024-05-07T11:12:13.539 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-05-07 11:09:21.769284886 +0000 2024-05-07T11:12:13.539 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-05-07 11:09:21.769284886 +0000 2024-05-07T11:12:13.539 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-05-07 11:09:21.769284886 +0000 2024-05-07T11:12:13.540 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-07T11:12:13.607 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-05-07T11:12:13.607 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-05-07T11:12:13.607 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000276016 s, 1.9 MB/s 2024-05-07T11:12:13.608 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-07T11:12:13.672 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-05-07T11:12:13.729 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-07T11:12:13.729 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:13.729 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-07T11:12:13.729 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:13.729 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:13.729 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-05-07 11:11:49.337690290 +0000 2024-05-07T11:12:13.729 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-05-07 11:09:22.128279374 +0000 2024-05-07T11:12:13.729 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-05-07 11:09:22.128279374 +0000 2024-05-07T11:12:13.729 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-05-07 11:09:22.128279374 +0000 2024-05-07T11:12:13.730 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-07T11:12:13.796 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-05-07T11:12:13.796 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-05-07T11:12:13.796 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000201941 s, 2.5 MB/s 2024-05-07T11:12:13.797 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-07T11:12:13.855 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-05-07T11:12:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-07T11:12:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:13.912 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-07T11:12:13.912 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:13.912 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:13.912 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-05-07 11:11:49.337690290 +0000 2024-05-07T11:12:13.912 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-05-07 11:09:22.468274154 +0000 2024-05-07T11:12:13.912 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-05-07 11:09:22.468274154 +0000 2024-05-07T11:12:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-05-07 11:09:22.468274154 +0000 2024-05-07T11:12:13.913 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-07T11:12:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-05-07T11:12:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-05-07T11:12:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000230987 s, 2.2 MB/s 2024-05-07T11:12:13.979 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-07T11:12:14.037 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-05-07T11:12:14.092 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-07T11:12:14.092 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T11:12:14.092 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-07T11:12:14.092 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:12:14.093 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T11:12:14.093 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-05-07 11:11:49.337690290 +0000 2024-05-07T11:12:14.093 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-05-07 11:09:22.819268765 +0000 2024-05-07T11:12:14.093 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-05-07 11:09:22.819268765 +0000 2024-05-07T11:12:14.093 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-05-07 11:09:22.819268765 +0000 2024-05-07T11:12:14.093 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-07T11:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-05-07T11:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-05-07T11:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000186668 s, 2.7 MB/s 2024-05-07T11:12:14.158 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-07T11:12:14.214 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-05-07T11:12:14.214 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-05-07T11:12:14.214 INFO:tasks.ceph:Generating config... 2024-05-07T11:12:14.215 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-07T11:12:14.216 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-07T11:12:14.216 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-07T11:12:14.216 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-07T11:12:14.216 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-07T11:12:14.216 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-07T11:12:14.216 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2024-05-07T11:12:14.216 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-05-07T11:12:14.216 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-07T11:12:14.216 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-07T11:12:14.216 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-07T11:12:14.216 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-07T11:12:14.216 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-07T11:12:14.216 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-07T11:12:14.217 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-07T11:12:14.217 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-07T11:12:14.217 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-07T11:12:14.217 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-07T11:12:14.217 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-07T11:12:14.217 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-07T11:12:14.217 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-07T11:12:14.217 INFO:tasks.ceph:Setting up mon.a... 2024-05-07T11:12:14.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-07T11:12:14.277 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2024-05-07T11:12:14.284 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-07T11:12:14.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T11:12:14.358 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.b', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]'), ('mon.c', '[v2:172.21.15.62:3302,v1:172.21.15.62:6791]')] 2024-05-07T11:12:14.358 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-05-07T11:12:14.359 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:14.359 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-07T11:12:14.416 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --addv b '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --addv c '[v2:172.21.15.62:3302,v1:172.21.15.62:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-07T11:12:14.506 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-07T11:12:14.506 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid 712a8431-2ac1-4386-a81f-c899bab82549 2024-05-07T11:12:14.506 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = quincy 2024-05-07T11:12:14.506 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2024-05-07T11:12:14.506 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 712a8431-2ac1-4386-a81f-c899bab82549 2024-05-07T11:12:14.507 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2024-05-07T11:12:14.506318+0000 2024-05-07T11:12:14.507 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-07T11:12:14.506318+0000 2024-05-07T11:12:14.507 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 17 (quincy) 2024-05-07T11:12:14.507 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2024-05-07T11:12:14.507 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-05-07T11:12:14.507 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.b 2024-05-07T11:12:14.508 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.62:3302/0,v1:172.21.15.62:6791/0] mon.c 2024-05-07T11:12:14.508 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-07T11:12:14.509 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-07T11:12:14.525 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 712a8431-2ac1-4386-a81f-c899bab82549... 2024-05-07T11:12:14.526 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-07T11:12:14.568 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-07T11:12:14.570 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-07T11:12:14.573 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-07T11:12:14.610 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-05-07T11:12:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-05-07T11:12:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-07T11:12:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-07T11:12:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-05-07T11:12:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]" 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 712a8431-2ac1-4386-a81f-c899bab82549 2024-05-07T11:12:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-05-07T11:12:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-05-07T11:12:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore compression algorithm = lz4 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore compression mode = aggressive 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-05-07T11:12:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: osd blocked scrub grace period = 3600 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: osd max markdown count = 1000 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-05-07T11:12:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-05-07T11:12:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-05-07T11:12:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-05-07T11:12:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-05-07T11:12:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-05-07T11:12:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-07T11:12:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-07T11:12:14.620 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-05-07T11:12:14.620 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2024-05-07T11:12:14.620 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2024-05-07T11:12:14.620 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-05-07T11:12:14.621 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-05-07T11:12:14.622 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]" 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 712a8431-2ac1-4386-a81f-c899bab82549 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-05-07T11:12:14.624 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-05-07T11:12:14.625 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-05-07T11:12:14.626 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore compression algorithm = lz4 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore compression mode = aggressive 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-05-07T11:12:14.627 INFO:teuthology.orchestra.run.smithi175.stdout: osd blocked scrub grace period = 3600 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: osd max markdown count = 1000 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-05-07T11:12:14.628 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-07T11:12:14.629 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-05-07T11:12:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-05-07T11:12:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-05-07T11:12:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-07T11:12:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-07T11:12:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-05-07T11:12:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-05-07T11:12:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-05-07T11:12:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-07T11:12:14.631 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-05-07T11:12:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-05-07T11:12:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-05-07T11:12:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-05-07T11:12:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-07T11:12:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2024-05-07T11:12:14.632 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.634 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]" 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 712a8431-2ac1-4386-a81f-c899bab82549 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2024-05-07T11:12:14.635 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug trim objects = true 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.636 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore compression algorithm = lz4 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore compression mode = aggressive 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 1/20 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 1/20 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-05-07T11:12:14.637 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 4/10 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: osd blocked scrub grace period = 3600 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: osd max markdown count = 1000 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-05-07T11:12:14.638 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-05-07T11:12:14.639 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2024-05-07T11:12:14.640 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2024-05-07T11:12:14.641 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2024-05-07T11:12:14.641 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2024-05-07T11:12:14.641 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-07T11:12:14.641 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-07T11:12:14.641 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2024-05-07T11:12:14.641 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2024-05-07T11:12:14.641 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2024-05-07T11:12:14.641 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.644 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2024-05-07T11:12:14.645 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2024-05-07T11:12:14.646 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2024-05-07T11:12:14.647 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2024-05-07T11:12:14.647 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]" 2024-05-07T11:12:14.647 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 712a8431-2ac1-4386-a81f-c899bab82549 2024-05-07T11:12:14.647 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.647 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2024-05-07T11:12:14.647 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2024-05-07T11:12:14.647 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.647 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2024-05-07T11:12:14.647 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2024-05-07T11:12:14.648 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore compression algorithm = lz4 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore compression mode = aggressive 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2024-05-07T11:12:14.649 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 1/20 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 1/20 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 4/10 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: osd blocked scrub grace period = 3600 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: osd max markdown count = 1000 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-07T11:12:14.650 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-05-07T11:12:14.651 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.652 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2024-05-07T11:12:14.653 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-05-07T11:12:14.653 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-07T11:12:14.654 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-07T11:12:14.740 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-07T11:12:14.740 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:14.740 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-07T11:12:14.756 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:14.756 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-07T11:12:14.812 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-05-07T11:12:14.813 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:14.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-07T11:12:14.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T11:12:14.888 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:14.889 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-07T11:12:14.944 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2024-05-07T11:12:14.944 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:12:14.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-07T11:12:14.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T11:12:14.985 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:12:14.985 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-07T11:12:15.043 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2024-05-07T11:12:15.043 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:12:15.043 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-07T11:12:15.043 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T11:12:15.084 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:12:15.084 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-07T11:12:15.142 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-05-07T11:12:15.143 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:12:15.143 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-07T11:12:15.143 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T11:12:15.184 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:12:15.184 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-07T11:12:15.241 INFO:tasks.ceph:Setting up mon nodes... 2024-05-07T11:12:15.242 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-07T11:12:15.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-07T11:12:15.296 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-07T11:12:15.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-07T11:12:15.351 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-07T11:12:15.354 INFO:tasks.ceph:Setting up mds nodes... 2024-05-07T11:12:15.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-07T11:12:15.406 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-07T11:12:15.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-07T11:12:15.435 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-07T11:12:15.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-07T11:12:15.517 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-07T11:12:15.531 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-07T11:12:15.531 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-05-07T11:12:15.531 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-07T11:12:15.561 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-07T11:12:15.561 INFO:tasks.ceph:role: osd.0 2024-05-07T11:12:15.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2024-05-07T11:12:15.561 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-07T11:12:15.637 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T11:12:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T11:12:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T11:12:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-07T11:12:15.638 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T11:12:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-05-07T11:12:15.638 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T11:12:15.638 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-07T11:12:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T11:12:15.638 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T11:12:16.144 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-05-07T11:12:16.147 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-05-07T11:12:16.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-07T11:12:16.285 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-07T11:12:16.322 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T11:12:16.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-05-07T11:12:16.421+0000 7fa7b6323640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-07T11:12:16.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-05-07T11:12:16.422+0000 7fa7b6323640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-07T11:12:16.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-05-07T11:12:16.422+0000 7fa7b6323640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-07T11:12:16.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-05-07T11:12:16.422+0000 7fa7b6323640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-07T11:12:16.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-05-07T11:12:16.422+0000 7fa7b6323640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-07T11:12:16.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-05-07T11:12:16.429+0000 7fa7b6323640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-07T11:12:19.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-07T11:12:19.304 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-07T11:12:19.333 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-05-07T11:12:19.333 INFO:tasks.ceph:role: osd.1 2024-05-07T11:12:19.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-07T11:12:19.334 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-07T11:12:19.409 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T11:12:19.410 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T11:12:19.410 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T11:12:19.410 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-07T11:12:19.410 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T11:12:19.410 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-05-07T11:12:19.410 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T11:12:19.410 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-07T11:12:19.410 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T11:12:19.410 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T11:12:19.910 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-05-07T11:12:19.912 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-05-07T11:12:19.912 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-05-07T11:12:20.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-07T11:12:20.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T11:12:20.189 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-07T11:12:20.188+0000 7fbcae144640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-07T11:12:20.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-07T11:12:20.193+0000 7fbcae144640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-07T11:12:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-07T11:12:20.193+0000 7fbcae144640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-07T11:12:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-07T11:12:20.193+0000 7fbcae144640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-07T11:12:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-07T11:12:20.193+0000 7fbcae144640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-07T11:12:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-07T11:12:20.195+0000 7fbcae144640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-07T11:12:23.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-07T11:12:23.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-07T11:12:23.098 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-05-07T11:12:23.098 INFO:tasks.ceph:role: osd.2 2024-05-07T11:12:23.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-05-07T11:12:23.099 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-07T11:12:23.174 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T11:12:23.174 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T11:12:23.174 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T11:12:23.174 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-07T11:12:23.175 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T11:12:23.175 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-05-07T11:12:23.175 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T11:12:23.175 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-07T11:12:23.175 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T11:12:23.175 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T11:12:23.693 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-05-07T11:12:23.695 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-05-07T11:12:23.695 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-05-07T11:12:23.812 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-07T11:12:23.846 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T11:12:23.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-07T11:12:23.954+0000 7f73de622640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-07T11:12:23.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-07T11:12:23.955+0000 7f73de622640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-07T11:12:23.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-07T11:12:23.955+0000 7f73de622640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-07T11:12:23.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-07T11:12:23.955+0000 7f73de622640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-07T11:12:23.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-07T11:12:23.955+0000 7f73de622640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-07T11:12:23.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-07T11:12:23.957+0000 7f73de622640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-07T11:12:26.833 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-07T11:12:26.861 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-07T11:12:26.862 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:26.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-07T11:12:26.894 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:26.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-07T11:12:26.964 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:26.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-07T11:12:27.033 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:12:27.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-07T11:12:27.064 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:12:27.064 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-07T11:12:27.094 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:12:27.094 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-07T11:12:27.120 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:12:27.120 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-07T11:12:27.138 INFO:tasks.ceph:Adding keys to all mons... 2024-05-07T11:12:27.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-07T11:12:27.205 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-05-07T11:12:27.205 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCPDDpmvZS4ERAA4Dmg02Q/OQwxaGPdu0yYJQ== 2024-05-07T11:12:27.205 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2024-05-07T11:12:27.205 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCPDDpmQRACFRAAkL5K14q/7ZWx26UjvUpXSw== 2024-05-07T11:12:27.205 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-05-07T11:12:27.205 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCPDDpmeLFHGBAACVNtAQb04wBg+FFL2DYz/w== 2024-05-07T11:12:27.205 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-05-07T11:12:27.206 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCQDDpmrPcyGRAAeqU3fkvjKm+UbXkE5tIdfQ== 2024-05-07T11:12:27.206 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-05-07T11:12:27.206 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCUDDpmpwFQCxAAWHm5hT9lZI1p/1SKOeriqQ== 2024-05-07T11:12:27.206 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-05-07T11:12:27.206 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCXDDpmSKHxOBAADrj03+ufKrox7NuyD6ayiQ== 2024-05-07T11:12:27.206 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-05-07T11:12:27.206 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCPDDpmELXkHhAAGBulCW4f6bg0A6kX2h3ecg== 2024-05-07T11:12:27.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-07T11:12:27.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-07T11:12:27.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-07T11:12:27.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T11:12:27.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T11:12:27.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T11:12:27.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-07T11:12:27.623 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-07T11:12:27.623 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-07T11:12:27.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-07T11:12:27.745 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-07T11:12:27.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-07T11:12:27.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-07T11:12:27.935 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-07T11:12:27.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-07T11:12:28.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-07T11:12:28.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-07T11:12:28.149 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-07T11:12:28.206 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-07T11:12:28.206 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-07T11:12:28.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-07T11:12:28.249 INFO:tasks.ceph.mon.a:Started 2024-05-07T11:12:28.249 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-07T11:12:28.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-07T11:12:28.251 INFO:tasks.ceph.mon.b:Started 2024-05-07T11:12:28.251 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-07T11:12:28.251 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-07T11:12:28.254 INFO:tasks.ceph.mon.c:Started 2024-05-07T11:12:28.254 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-07T11:12:28.254 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-07T11:12:28.254 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-07T11:12:28.256 INFO:tasks.ceph.mgr.x:Started 2024-05-07T11:12:28.257 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-07T11:12:28.257 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-07T11:12:28.261 INFO:tasks.ceph.mgr.y:Started 2024-05-07T11:12:28.261 INFO:tasks.ceph:Setting crush tunables to default 2024-05-07T11:12:28.262 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2024-05-07T11:12:28.698 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2024-05-07T11:12:28.711 INFO:tasks.ceph:check_enable_crimson: False 2024-05-07T11:12:28.711 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-07T11:12:28.711 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-07T11:12:28.711 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-07T11:12:28.712 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:28.711+0000 7f3990b21040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-07T11:12:28.722 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:28.721+0000 7f8b3728a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-07T11:12:28.738 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-07T11:12:28.738 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-07T11:12:28.767 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-07T11:12:28.767 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-07T11:12:28.798 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new cd7246e2-0069-4df7-a669-4abe038a28ad 0 2024-05-07T11:12:28.876 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:28.876+0000 7f3990b21040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-07T11:12:28.877 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:28.876+0000 7f8b3728a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-07T11:12:28.933 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:28.932+0000 7f3990b21040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-07T11:12:28.933 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:28.932+0000 7f8b3728a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-07T11:12:29.030 INFO:teuthology.orchestra.run.smithi175.stdout:0 2024-05-07T11:12:29.041 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 7df5bb74-60c0-4a46-a3d1-494f777a4f88 1 2024-05-07T11:12:29.190 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:29.189+0000 7f3990b21040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-07T11:12:29.190 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:29.189+0000 7f8b3728a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-07T11:12:29.223 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-05-07T11:12:29.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new ebed6b16-fba7-4b8a-a78e-1f84a500c31f 2 2024-05-07T11:12:29.239 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:29.238+0000 7f3990b21040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-07T11:12:29.239 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:29.238+0000 7f8b3728a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-07T11:12:29.418 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-05-07T11:12:29.429 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-07T11:12:29.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-07T11:12:29.432 INFO:tasks.ceph.osd.0:Started 2024-05-07T11:12:29.432 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-07T11:12:29.432 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-07T11:12:29.435 INFO:tasks.ceph.osd.1:Started 2024-05-07T11:12:29.435 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-07T11:12:29.435 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-07T11:12:29.437 INFO:tasks.ceph.osd.2:Started 2024-05-07T11:12:29.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:29.621 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:29.411691+0000","last_up_change":"0.000000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:29.633 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-07T11:12:29.633 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-07T11:12:29.936 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:30.023 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:12:30.023+0000 7fa389217640 -1 Falling back to public interface 2024-05-07T11:12:30.023 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:12:30.023+0000 7f657fe0d640 -1 Falling back to public interface 2024-05-07T11:12:30.033 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:30.032+0000 7f8b3728a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-07T11:12:30.035 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:12:30.035+0000 7f6328a32640 -1 Falling back to public interface 2024-05-07T11:12:30.068 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:30.067+0000 7f3990b21040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-07T11:12:30.128 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:30.127+0000 7f8b3728a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-07T11:12:30.146 INFO:teuthology.misc.health.smithi062.stdout: 2024-05-07T11:12:30.147 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":5,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:29.411691+0000","last_up_change":"0.000000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:30.161 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-05-07T11:12:30.165 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:30.165+0000 7f3990b21040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-07T11:12:30.185 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:30.185+0000 7f8b3728a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-07T11:12:30.210 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:30.210+0000 7f3990b21040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-07T11:12:30.360 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:30.360+0000 7f8b3728a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-07T11:12:30.381 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:30.381+0000 7f3990b21040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-07T11:12:30.425 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:30.426+0000 7f8b3728a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-07T11:12:30.429 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:30.428+0000 7f3990b21040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-07T11:12:30.481 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:30.482+0000 7f8b3728a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-07T11:12:30.483 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:30.483+0000 7f3990b21040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-07T11:12:30.602 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:30.602+0000 7f8b3728a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-07T11:12:30.602 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:30.603+0000 7f3990b21040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-07T11:12:31.009 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:31.009+0000 7f3990b21040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-07T11:12:31.009 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:31.009+0000 7f8b3728a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-07T11:12:31.282 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:31.282+0000 7f3990b21040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-07T11:12:31.282 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:31.283+0000 7f8b3728a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-07T11:12:31.337 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:31.337+0000 7f3990b21040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-07T11:12:31.337 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:31.338+0000 7f8b3728a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-07T11:12:31.460 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:31.460+0000 7f3990b21040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-07T11:12:31.460 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:31.461+0000 7f8b3728a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-07T11:12:31.765 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:31.765+0000 7f8b3728a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-07T11:12:31.765 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:31.765+0000 7f3990b21040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-07T11:12:31.815 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:31.815+0000 7f3990b21040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-07T11:12:31.816 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:31.816+0000 7f8b3728a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-07T11:12:31.981 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:31.981+0000 7f3990b21040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-07T11:12:31.981 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:31.982+0000 7f8b3728a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-07T11:12:32.126 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:32.127+0000 7f8b3728a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-07T11:12:32.127 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:32.127+0000 7f3990b21040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-07T11:12:32.179 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:32.179+0000 7f3990b21040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-07T11:12:32.179 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:32.179+0000 7f8b3728a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-07T11:12:32.253 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:32.253+0000 7f3990b21040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-07T11:12:32.253 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:32.254+0000 7f8b3728a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-07T11:12:32.301 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:32.301+0000 7f3990b21040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-07T11:12:32.301 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:32.302+0000 7f8b3728a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-07T11:12:32.806 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:32.807+0000 7f3990b21040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-07T11:12:32.807 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:32.807+0000 7f8b3728a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-07T11:12:32.928 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:32.928+0000 7f3990b21040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-07T11:12:32.929 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-07T11:12:32.930+0000 7f8b3728a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-07T11:12:33.456 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:12:33.456+0000 7f657fe0d640 -1 osd.0 0 log_to_monitors true 2024-05-07T11:12:33.465 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:12:33.466+0000 7fa389217640 -1 osd.2 0 log_to_monitors true 2024-05-07T11:12:33.468 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:12:33.467+0000 7f6328a32640 -1 osd.1 0 log_to_monitors true 2024-05-07T11:12:33.945 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:33.945+0000 7f3931650640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-07T11:12:33.945 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-05-07T11:12:33.945+0000 7f3931650640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-07T11:12:35.673 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:12:35.673+0000 7fa385320640 -1 osd.2 0 waiting for initial osdmap 2024-05-07T11:12:35.684 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:12:35.684+0000 7f63251dc640 -1 osd.1 0 waiting for initial osdmap 2024-05-07T11:12:35.685 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:12:35.685+0000 7fa37c92c640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T11:12:35.692 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:12:35.691+0000 7f657beb1640 -1 osd.0 0 waiting for initial osdmap 2024-05-07T11:12:35.699 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:12:35.699+0000 7f631c7e8640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T11:12:35.706 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:12:35.706+0000 7f65734bd640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T11:12:36.463 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:36.768 INFO:teuthology.misc.health.smithi062.stdout: 2024-05-07T11:12:36.768 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":8,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:36.689723+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:36.779 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-05-07T11:12:36.780 INFO:tasks.ceph:Creating RBD pool 2024-05-07T11:12:36.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-07T11:12:37.701 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2024-05-07T11:12:37.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-07T11:12:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-07T11:12:38.722 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-07T11:12:38.722 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-07T11:12:38.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-07T11:12:38.726 INFO:tasks.ceph.mds.a:Started 2024-05-07T11:12:38.726 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-07T11:12:38.727 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:38.810 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2024-05-07T11:12:39.039 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:39.039 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:38.694905+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:39.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-07T11:12:39.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-07T11:12:39.356 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-05-07T11:12:39.369 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-05-07T11:12:39.677 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2024-05-07T11:12:39.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-07T11:12:40.032 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:40.033 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6803/1691847174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1691847174},{"type":"v1","addr":"172.21.15.62:6803","nonce":1691847174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-07T11:12:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 2 2024-05-07T11:12:40.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:40.343 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:40.344 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":11,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:39.698564+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:40.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-07T11:12:40.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-07T11:12:40.656 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-05-07T11:12:40.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-05-07T11:12:40.970 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2024-05-07T11:12:40.983 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-07T11:12:41.280 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:41.281 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2024-05-07T11:12:41.281 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:12:41.281 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2024-05-07T11:12:41.281 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2024-05-07T11:12:41.281 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:12:41.281 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:12:41.281 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2024-05-07T11:12:41.281 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2024-05-07T11:12:41.281 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:12:41.281 INFO:teuthology.orchestra.run.smithi062.stdout:] 2024-05-07T11:12:41.293 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-07T11:12:41.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-07T11:12:42.033 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2024-05-07T11:12:42.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-07T11:12:43.040 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2024-05-07T11:12:43.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-07T11:12:44.040 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 3 and data pool 4 2024-05-07T11:12:44.060 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:44.365 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:44.366 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":14,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:43.397730+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:44.378 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:44.678 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:44.678 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":14,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:43.397730+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:44.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-07T11:12:45.061 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-07T11:12:45.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-07T11:12:46.070 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-07T11:12:46.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-07T11:12:46.412 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:46.412 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-07T11:12:43.398023+0000","modified":"2024-05-07T11:12:45.405916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6803/1691847174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1691847174},{"type":"v1","addr":"172.21.15.62:6803","nonce":1691847174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4190,"qdb_cluster":[4190]},"id":1}]} 2024-05-07T11:12:46.412 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2024-05-07T11:12:46.424 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:46.724 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":15,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:45.043439+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:46.737 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-07T11:12:46.737 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:12:47.041 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:47.042 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:12:47.052 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-07T11:12:46.938367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81536,"kb_used_data":400,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033984,"statfs":{"total":289910292480,"available":289826799616,"internally_reserved":0,"allocated":409600,"data_stored":1264088,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906829"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703509+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:12:39.703509+0000","last_peered":"2024-05-07T11:12:39.703509+0000","last_clean":"2024-05-07T11:12:39.703509+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:12:39.703509+0000","last_undegraded":"2024-05-07T11:12:39.703509+0000","last_fullsized":"2024-05-07T11:12:39.703509+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703489+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:12:39.703489+0000","last_peered":"2024-05-07T11:12:39.703489+0000","last_clean":"2024-05-07T11:12:39.703489+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:12:39.703489+0000","last_undegraded":"2024-05-07T11:12:39.703489+0000","last_fullsized":"2024-05-07T11:12:39.703489+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703486+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:12:39.703486+0000","last_peered":"2024-05-07T11:12:39.703486+0000","last_clean":"2024-05-07T11:12:39.703486+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:12:39.703486+0000","last_undegraded":"2024-05-07T11:12:39.703486+0000","last_fullsized":"2024-05-07T11:12:39.703486+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703867+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:12:39.703867+0000","last_peered":"2024-05-07T11:12:39.703867+0000","last_clean":"2024-05-07T11:12:39.703867+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:12:39.703867+0000","last_undegraded":"2024-05-07T11:12:39.703867+0000","last_fullsized":"2024-05-07T11:12:39.703867+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703476+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:12:39.703476+0000","last_peered":"2024-05-07T11:12:39.703476+0000","last_clean":"2024-05-07T11:12:39.703476+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:12:39.703476+0000","last_undegraded":"2024-05-07T11:12:39.703476+0000","last_fullsized":"2024-05-07T11:12:39.703476+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703867+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:12:39.703867+0000","last_peered":"2024-05-07T11:12:39.703867+0000","last_clean":"2024-05-07T11:12:39.703867+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:12:39.703867+0000","last_undegraded":"2024-05-07T11:12:39.703867+0000","last_fullsized":"2024-05-07T11:12:39.703867+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.860678+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:12:39.860678+0000","last_peered":"2024-05-07T11:12:39.860678+0000","last_clean":"2024-05-07T11:12:39.860678+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:12:39.860678+0000","last_undegraded":"2024-05-07T11:12:39.860678+0000","last_fullsized":"2024-05-07T11:12:39.860678+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703866+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:12:39.703866+0000","last_peered":"2024-05-07T11:12:39.703866+0000","last_clean":"2024-05-07T11:12:39.703866+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:12:39.703866+0000","last_undegraded":"2024-05-07T11:12:39.703866+0000","last_fullsized":"2024-05-07T11:12:39.703866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703491+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:12:39.703491+0000","last_peered":"2024-05-07T11:12:39.703491+0000","last_clean":"2024-05-07T11:12:39.703491+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:12:39.703491+0000","last_undegraded":"2024-05-07T11:12:39.703491+0000","last_fullsized":"2024-05-07T11:12:39.703491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":155648,"data_stored":618152,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":155648,"data_stored":618152,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:12:47.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:12:47.393 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:47.394 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:12:47.404 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-07T11:12:46.938367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81536,"kb_used_data":400,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033984,"statfs":{"total":289910292480,"available":289826799616,"internally_reserved":0,"allocated":409600,"data_stored":1264088,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906829"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703509+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:12:39.703509+0000","last_peered":"2024-05-07T11:12:39.703509+0000","last_clean":"2024-05-07T11:12:39.703509+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:12:39.703509+0000","last_undegraded":"2024-05-07T11:12:39.703509+0000","last_fullsized":"2024-05-07T11:12:39.703509+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703489+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:12:39.703489+0000","last_peered":"2024-05-07T11:12:39.703489+0000","last_clean":"2024-05-07T11:12:39.703489+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:12:39.703489+0000","last_undegraded":"2024-05-07T11:12:39.703489+0000","last_fullsized":"2024-05-07T11:12:39.703489+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703486+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:12:39.703486+0000","last_peered":"2024-05-07T11:12:39.703486+0000","last_clean":"2024-05-07T11:12:39.703486+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:12:39.703486+0000","last_undegraded":"2024-05-07T11:12:39.703486+0000","last_fullsized":"2024-05-07T11:12:39.703486+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703867+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:12:39.703867+0000","last_peered":"2024-05-07T11:12:39.703867+0000","last_clean":"2024-05-07T11:12:39.703867+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:12:39.703867+0000","last_undegraded":"2024-05-07T11:12:39.703867+0000","last_fullsized":"2024-05-07T11:12:39.703867+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703476+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:12:39.703476+0000","last_peered":"2024-05-07T11:12:39.703476+0000","last_clean":"2024-05-07T11:12:39.703476+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:12:39.703476+0000","last_undegraded":"2024-05-07T11:12:39.703476+0000","last_fullsized":"2024-05-07T11:12:39.703476+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703867+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:12:39.703867+0000","last_peered":"2024-05-07T11:12:39.703867+0000","last_clean":"2024-05-07T11:12:39.703867+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:12:39.703867+0000","last_undegraded":"2024-05-07T11:12:39.703867+0000","last_fullsized":"2024-05-07T11:12:39.703867+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.860678+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:12:39.860678+0000","last_peered":"2024-05-07T11:12:39.860678+0000","last_clean":"2024-05-07T11:12:39.860678+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:12:39.860678+0000","last_undegraded":"2024-05-07T11:12:39.860678+0000","last_fullsized":"2024-05-07T11:12:39.860678+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703866+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:12:39.703866+0000","last_peered":"2024-05-07T11:12:39.703866+0000","last_clean":"2024-05-07T11:12:39.703866+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:12:39.703866+0000","last_undegraded":"2024-05-07T11:12:39.703866+0000","last_fullsized":"2024-05-07T11:12:39.703866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703491+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:12:39.703491+0000","last_peered":"2024-05-07T11:12:39.703491+0000","last_clean":"2024-05-07T11:12:39.703491+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:12:39.703491+0000","last_undegraded":"2024-05-07T11:12:39.703491+0000","last_fullsized":"2024-05-07T11:12:39.703491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":155648,"data_stored":618152,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":155648,"data_stored":618152,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:12:47.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:12:47.747 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:47.749 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:12:47.759 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-07T11:12:46.938367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81536,"kb_used_data":400,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033984,"statfs":{"total":289910292480,"available":289826799616,"internally_reserved":0,"allocated":409600,"data_stored":1264088,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906829"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703509+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:12:39.703509+0000","last_peered":"2024-05-07T11:12:39.703509+0000","last_clean":"2024-05-07T11:12:39.703509+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:12:39.703509+0000","last_undegraded":"2024-05-07T11:12:39.703509+0000","last_fullsized":"2024-05-07T11:12:39.703509+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703489+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:12:39.703489+0000","last_peered":"2024-05-07T11:12:39.703489+0000","last_clean":"2024-05-07T11:12:39.703489+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:12:39.703489+0000","last_undegraded":"2024-05-07T11:12:39.703489+0000","last_fullsized":"2024-05-07T11:12:39.703489+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703486+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:12:39.703486+0000","last_peered":"2024-05-07T11:12:39.703486+0000","last_clean":"2024-05-07T11:12:39.703486+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:12:39.703486+0000","last_undegraded":"2024-05-07T11:12:39.703486+0000","last_fullsized":"2024-05-07T11:12:39.703486+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703867+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:12:39.703867+0000","last_peered":"2024-05-07T11:12:39.703867+0000","last_clean":"2024-05-07T11:12:39.703867+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:12:39.703867+0000","last_undegraded":"2024-05-07T11:12:39.703867+0000","last_fullsized":"2024-05-07T11:12:39.703867+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703476+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:12:39.703476+0000","last_peered":"2024-05-07T11:12:39.703476+0000","last_clean":"2024-05-07T11:12:39.703476+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:12:39.703476+0000","last_undegraded":"2024-05-07T11:12:39.703476+0000","last_fullsized":"2024-05-07T11:12:39.703476+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703867+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:12:39.703867+0000","last_peered":"2024-05-07T11:12:39.703867+0000","last_clean":"2024-05-07T11:12:39.703867+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:12:39.703867+0000","last_undegraded":"2024-05-07T11:12:39.703867+0000","last_fullsized":"2024-05-07T11:12:39.703867+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.860678+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:12:39.860678+0000","last_peered":"2024-05-07T11:12:39.860678+0000","last_clean":"2024-05-07T11:12:39.860678+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:12:39.860678+0000","last_undegraded":"2024-05-07T11:12:39.860678+0000","last_fullsized":"2024-05-07T11:12:39.860678+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703866+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:12:39.703866+0000","last_peered":"2024-05-07T11:12:39.703866+0000","last_clean":"2024-05-07T11:12:39.703866+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:12:39.703866+0000","last_undegraded":"2024-05-07T11:12:39.703866+0000","last_fullsized":"2024-05-07T11:12:39.703866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703491+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:12:39.703491+0000","last_peered":"2024-05-07T11:12:39.703491+0000","last_clean":"2024-05-07T11:12:39.703491+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:12:39.703491+0000","last_undegraded":"2024-05-07T11:12:39.703491+0000","last_fullsized":"2024-05-07T11:12:39.703491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":155648,"data_stored":618152,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":155648,"data_stored":618152,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:12:47.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-05-07T11:12:47.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-05-07T11:12:47.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-05-07T11:12:47.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-05-07T11:12:47.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-05-07T11:12:47.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-05-07T11:12:47.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-05-07T11:12:47.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-05-07T11:12:47.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-05-07T11:12:47.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-05-07T11:12:47.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-05-07T11:12:47.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-05-07T11:12:47.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-05-07T11:12:47.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-05-07T11:12:47.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-05-07T11:12:47.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-05-07T11:12:47.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-05-07T11:12:47.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-05-07T11:12:47.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-05-07T11:12:47.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-05-07T11:12:47.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-05-07T11:12:47.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-05-07T11:12:47.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-05-07T11:12:47.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-05-07T11:12:47.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-05-07T11:12:47.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-05-07T11:12:47.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-05-07T11:12:47.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-05-07T11:12:47.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-05-07T11:12:47.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-05-07T11:12:47.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-05-07T11:12:47.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-05-07T11:12:47.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-05-07T11:12:47.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-05-07T11:12:47.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-05-07T11:12:47.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-05-07T11:12:47.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-05-07T11:12:47.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-05-07T11:12:47.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-05-07T11:12:47.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-05-07T11:12:47.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-05-07T11:12:47.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-05-07T11:12:47.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-05-07T11:12:47.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-05-07T11:12:47.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-05-07T11:12:47.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-05-07T11:12:47.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-05-07T11:12:47.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-05-07T11:12:47.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-05-07T11:12:47.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-05-07T11:12:47.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-05-07T11:12:47.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-05-07T11:12:47.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-05-07T11:12:47.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-05-07T11:12:47.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-05-07T11:12:47.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-05-07T11:12:47.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-05-07T11:12:47.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-05-07T11:12:47.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-05-07T11:12:47.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-05-07T11:12:47.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-05-07T11:12:47.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-05-07T11:12:47.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-05-07T11:12:47.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-05-07T11:12:47.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-05-07T11:12:47.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-05-07T11:12:47.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-05-07T11:12:47.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-05-07T11:12:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-05-07T11:12:47.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-05-07T11:12:47.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-05-07T11:12:47.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-05-07T11:12:47.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-05-07T11:12:47.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-05-07T11:12:47.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-05-07T11:12:47.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:43.030504+0000', 'last_change': '2024-05-07T11:12:43.030504+0000', 'last_active': '2024-05-07T11:12:43.030504+0000', 'last_peered': '2024-05-07T11:12:43.030504+0000', 'last_clean': '2024-05-07T11:12:43.030504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:43.030504+0000', 'last_undegraded': '2024-05-07T11:12:43.030504+0000', 'last_fullsized': '2024-05-07T11:12:43.030504+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:43.030504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-05-07T11:12:47.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-07T11:12:42.024701+0000', 'last_change': '2024-05-07T11:12:42.024701+0000', 'last_active': '2024-05-07T11:12:42.024701+0000', 'last_peered': '2024-05-07T11:12:42.024701+0000', 'last_clean': '2024-05-07T11:12:42.024701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-07T11:12:42.024701+0000', 'last_undegraded': '2024-05-07T11:12:42.024701+0000', 'last_fullsized': '2024-05-07T11:12:42.024701+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'last_clean_scrub_stamp': '2024-05-07T11:12:42.024701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-07T11:12:47.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-07T11:12:48.167 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:48.167 INFO:teuthology.orchestra.run.smithi062.stdout:{"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":19,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":15,"num_osds":3,"num_up_osds":3,"osd_up_since":1715080356,"num_in_osds":3,"osd_in_since":1715080349,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":83492864,"bytes_avail":289826799616,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4190}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-07T11:12:28.568701+0000","services":{}},"progress_events":{}} 2024-05-07T11:12:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-07T11:12:48.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:12:48.486 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:48.487 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:12:48.497 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-07T11:12:46.938367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81536,"kb_used_data":400,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033984,"statfs":{"total":289910292480,"available":289826799616,"internally_reserved":0,"allocated":409600,"data_stored":1264088,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906829"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703509+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:12:39.703509+0000","last_peered":"2024-05-07T11:12:39.703509+0000","last_clean":"2024-05-07T11:12:39.703509+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:12:39.703509+0000","last_undegraded":"2024-05-07T11:12:39.703509+0000","last_fullsized":"2024-05-07T11:12:39.703509+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703489+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:12:39.703489+0000","last_peered":"2024-05-07T11:12:39.703489+0000","last_clean":"2024-05-07T11:12:39.703489+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:12:39.703489+0000","last_undegraded":"2024-05-07T11:12:39.703489+0000","last_fullsized":"2024-05-07T11:12:39.703489+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703486+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:12:39.703486+0000","last_peered":"2024-05-07T11:12:39.703486+0000","last_clean":"2024-05-07T11:12:39.703486+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:12:39.703486+0000","last_undegraded":"2024-05-07T11:12:39.703486+0000","last_fullsized":"2024-05-07T11:12:39.703486+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703867+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:12:39.703867+0000","last_peered":"2024-05-07T11:12:39.703867+0000","last_clean":"2024-05-07T11:12:39.703867+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:12:39.703867+0000","last_undegraded":"2024-05-07T11:12:39.703867+0000","last_fullsized":"2024-05-07T11:12:39.703867+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703476+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:12:39.703476+0000","last_peered":"2024-05-07T11:12:39.703476+0000","last_clean":"2024-05-07T11:12:39.703476+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:12:39.703476+0000","last_undegraded":"2024-05-07T11:12:39.703476+0000","last_fullsized":"2024-05-07T11:12:39.703476+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703867+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:12:39.703867+0000","last_peered":"2024-05-07T11:12:39.703867+0000","last_clean":"2024-05-07T11:12:39.703867+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:12:39.703867+0000","last_undegraded":"2024-05-07T11:12:39.703867+0000","last_fullsized":"2024-05-07T11:12:39.703867+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.860678+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:12:39.860678+0000","last_peered":"2024-05-07T11:12:39.860678+0000","last_clean":"2024-05-07T11:12:39.860678+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:12:39.860678+0000","last_undegraded":"2024-05-07T11:12:39.860678+0000","last_fullsized":"2024-05-07T11:12:39.860678+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703866+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:12:39.703866+0000","last_peered":"2024-05-07T11:12:39.703866+0000","last_clean":"2024-05-07T11:12:39.703866+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:12:39.703866+0000","last_undegraded":"2024-05-07T11:12:39.703866+0000","last_fullsized":"2024-05-07T11:12:39.703866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T11:12:39.703491+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:12:39.703491+0000","last_peered":"2024-05-07T11:12:39.703491+0000","last_clean":"2024-05-07T11:12:39.703491+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:12:39.703491+0000","last_undegraded":"2024-05-07T11:12:39.703491+0000","last_fullsized":"2024-05-07T11:12:39.703491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:43.030504+0000","last_change":"2024-05-07T11:12:43.030504+0000","last_active":"2024-05-07T11:12:43.030504+0000","last_peered":"2024-05-07T11:12:43.030504+0000","last_clean":"2024-05-07T11:12:43.030504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:43.030504+0000","last_undegraded":"2024-05-07T11:12:43.030504+0000","last_fullsized":"2024-05-07T11:12:43.030504+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-07T11:12:42.024701+0000","last_change":"2024-05-07T11:12:42.024701+0000","last_active":"2024-05-07T11:12:42.024701+0000","last_peered":"2024-05-07T11:12:42.024701+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-07T11:12:42.024701+0000","last_undegraded":"2024-05-07T11:12:42.024701+0000","last_fullsized":"2024-05-07T11:12:42.024701+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":155648,"data_stored":618152,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":155648,"data_stored":618152,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:12:48.821 INFO:tasks.ceph.mds.a.smithi062.stderr:2024-05-07T11:12:48.820+0000 7fec0682b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-07T11:12:51.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:12:51.821 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:12:51.832 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-05-07T11:12:50.939236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81628,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033892,"statfs":{"total":289910292480,"available":289826705408,"internally_reserved":0,"allocated":573440,"data_stored":1323805,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.902048"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051518+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:12:45.051518+0000","last_peered":"2024-05-07T11:12:45.051518+0000","last_clean":"2024-05-07T11:12:45.051518+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:12:45.051518+0000","last_undegraded":"2024-05-07T11:12:45.051518+0000","last_fullsized":"2024-05-07T11:12:45.051518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051016+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:12:45.051016+0000","last_peered":"2024-05-07T11:12:45.051016+0000","last_clean":"2024-05-07T11:12:45.051016+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:12:45.051016+0000","last_undegraded":"2024-05-07T11:12:45.051016+0000","last_fullsized":"2024-05-07T11:12:45.051016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044931+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:12:46.044931+0000","last_peered":"2024-05-07T11:12:46.044931+0000","last_clean":"2024-05-07T11:12:46.044931+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:12:46.044931+0000","last_undegraded":"2024-05-07T11:12:46.044931+0000","last_fullsized":"2024-05-07T11:12:46.044931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051123+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:12:45.051123+0000","last_peered":"2024-05-07T11:12:45.051123+0000","last_clean":"2024-05-07T11:12:45.051123+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:12:45.051123+0000","last_undegraded":"2024-05-07T11:12:45.051123+0000","last_fullsized":"2024-05-07T11:12:45.051123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044619+0000","last_change":"2024-05-07T11:12:44.054002+0000","last_active":"2024-05-07T11:12:46.044619+0000","last_peered":"2024-05-07T11:12:46.044619+0000","last_clean":"2024-05-07T11:12:46.044619+0000","last_became_active":"2024-05-07T11:12:44.053275+0000","last_became_peered":"2024-05-07T11:12:44.053275+0000","last_unstale":"2024-05-07T11:12:46.044619+0000","last_undegraded":"2024-05-07T11:12:46.044619+0000","last_fullsized":"2024-05-07T11:12:46.044619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044470+0000","last_change":"2024-05-07T11:12:44.053753+0000","last_active":"2024-05-07T11:12:46.044470+0000","last_peered":"2024-05-07T11:12:46.044470+0000","last_clean":"2024-05-07T11:12:46.044470+0000","last_became_active":"2024-05-07T11:12:44.052991+0000","last_became_peered":"2024-05-07T11:12:44.052991+0000","last_unstale":"2024-05-07T11:12:46.044470+0000","last_undegraded":"2024-05-07T11:12:46.044470+0000","last_fullsized":"2024-05-07T11:12:46.044470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044203+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:12:46.044203+0000","last_peered":"2024-05-07T11:12:46.044203+0000","last_clean":"2024-05-07T11:12:46.044203+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:12:46.044203+0000","last_undegraded":"2024-05-07T11:12:46.044203+0000","last_fullsized":"2024-05-07T11:12:46.044203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052288+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:12:45.052288+0000","last_peered":"2024-05-07T11:12:45.052288+0000","last_clean":"2024-05-07T11:12:45.052288+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:12:45.052288+0000","last_undegraded":"2024-05-07T11:12:45.052288+0000","last_fullsized":"2024-05-07T11:12:45.052288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051125+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:12:45.051125+0000","last_peered":"2024-05-07T11:12:45.051125+0000","last_clean":"2024-05-07T11:12:45.051125+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:12:45.051125+0000","last_undegraded":"2024-05-07T11:12:45.051125+0000","last_fullsized":"2024-05-07T11:12:45.051125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045295+0000","last_change":"2024-05-07T11:12:44.054308+0000","last_active":"2024-05-07T11:12:46.045295+0000","last_peered":"2024-05-07T11:12:46.045295+0000","last_clean":"2024-05-07T11:12:46.045295+0000","last_became_active":"2024-05-07T11:12:44.053809+0000","last_became_peered":"2024-05-07T11:12:44.053809+0000","last_unstale":"2024-05-07T11:12:46.045295+0000","last_undegraded":"2024-05-07T11:12:46.045295+0000","last_fullsized":"2024-05-07T11:12:46.045295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:22.261724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051159+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:12:45.051159+0000","last_peered":"2024-05-07T11:12:45.051159+0000","last_clean":"2024-05-07T11:12:45.051159+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:12:45.051159+0000","last_undegraded":"2024-05-07T11:12:45.051159+0000","last_fullsized":"2024-05-07T11:12:45.051159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050678+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:12:45.050678+0000","last_peered":"2024-05-07T11:12:45.050678+0000","last_clean":"2024-05-07T11:12:45.050678+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:12:45.050678+0000","last_undegraded":"2024-05-07T11:12:45.050678+0000","last_fullsized":"2024-05-07T11:12:45.050678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044673+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:12:46.044673+0000","last_peered":"2024-05-07T11:12:46.044673+0000","last_clean":"2024-05-07T11:12:46.044673+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:12:46.044673+0000","last_undegraded":"2024-05-07T11:12:46.044673+0000","last_fullsized":"2024-05-07T11:12:46.044673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044712+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:12:46.044712+0000","last_peered":"2024-05-07T11:12:46.044712+0000","last_clean":"2024-05-07T11:12:46.044712+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:12:46.044712+0000","last_undegraded":"2024-05-07T11:12:46.044712+0000","last_fullsized":"2024-05-07T11:12:46.044712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044199+0000","last_change":"2024-05-07T11:12:44.057719+0000","last_active":"2024-05-07T11:12:46.044199+0000","last_peered":"2024-05-07T11:12:46.044199+0000","last_clean":"2024-05-07T11:12:46.044199+0000","last_became_active":"2024-05-07T11:12:44.055208+0000","last_became_peered":"2024-05-07T11:12:44.055208+0000","last_unstale":"2024-05-07T11:12:46.044199+0000","last_undegraded":"2024-05-07T11:12:46.044199+0000","last_fullsized":"2024-05-07T11:12:46.044199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052775+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:12:45.052775+0000","last_peered":"2024-05-07T11:12:45.052775+0000","last_clean":"2024-05-07T11:12:45.052775+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:12:45.052775+0000","last_undegraded":"2024-05-07T11:12:45.052775+0000","last_fullsized":"2024-05-07T11:12:45.052775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051527+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:12:45.051527+0000","last_peered":"2024-05-07T11:12:45.051527+0000","last_clean":"2024-05-07T11:12:45.051527+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:12:45.051527+0000","last_undegraded":"2024-05-07T11:12:45.051527+0000","last_fullsized":"2024-05-07T11:12:45.051527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052169+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:12:45.052169+0000","last_peered":"2024-05-07T11:12:45.052169+0000","last_clean":"2024-05-07T11:12:45.052169+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:12:45.052169+0000","last_undegraded":"2024-05-07T11:12:45.052169+0000","last_fullsized":"2024-05-07T11:12:45.052169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045083+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:12:46.045083+0000","last_peered":"2024-05-07T11:12:46.045083+0000","last_clean":"2024-05-07T11:12:46.045083+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:12:46.045083+0000","last_undegraded":"2024-05-07T11:12:46.045083+0000","last_fullsized":"2024-05-07T11:12:46.045083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044990+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:12:46.044990+0000","last_peered":"2024-05-07T11:12:46.044990+0000","last_clean":"2024-05-07T11:12:46.044990+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:12:46.044990+0000","last_undegraded":"2024-05-07T11:12:46.044990+0000","last_fullsized":"2024-05-07T11:12:46.044990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050573+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:12:45.050573+0000","last_peered":"2024-05-07T11:12:45.050573+0000","last_clean":"2024-05-07T11:12:45.050573+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:12:45.050573+0000","last_undegraded":"2024-05-07T11:12:45.050573+0000","last_fullsized":"2024-05-07T11:12:45.050573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051210+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:12:45.051210+0000","last_peered":"2024-05-07T11:12:45.051210+0000","last_clean":"2024-05-07T11:12:45.051210+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:12:45.051210+0000","last_undegraded":"2024-05-07T11:12:45.051210+0000","last_fullsized":"2024-05-07T11:12:45.051210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050292+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:12:45.050292+0000","last_peered":"2024-05-07T11:12:45.050292+0000","last_clean":"2024-05-07T11:12:45.050292+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:12:45.050292+0000","last_undegraded":"2024-05-07T11:12:45.050292+0000","last_fullsized":"2024-05-07T11:12:45.050292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051631+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:12:45.051631+0000","last_peered":"2024-05-07T11:12:45.051631+0000","last_clean":"2024-05-07T11:12:45.051631+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:12:45.051631+0000","last_undegraded":"2024-05-07T11:12:45.051631+0000","last_fullsized":"2024-05-07T11:12:45.051631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052426+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:12:45.052426+0000","last_peered":"2024-05-07T11:12:45.052426+0000","last_clean":"2024-05-07T11:12:45.052426+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:12:45.052426+0000","last_undegraded":"2024-05-07T11:12:45.052426+0000","last_fullsized":"2024-05-07T11:12:45.052426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045205+0000","last_change":"2024-05-07T11:12:44.059023+0000","last_active":"2024-05-07T11:12:46.045205+0000","last_peered":"2024-05-07T11:12:46.045205+0000","last_clean":"2024-05-07T11:12:46.045205+0000","last_became_active":"2024-05-07T11:12:44.057224+0000","last_became_peered":"2024-05-07T11:12:44.057224+0000","last_unstale":"2024-05-07T11:12:46.045205+0000","last_undegraded":"2024-05-07T11:12:46.045205+0000","last_fullsized":"2024-05-07T11:12:46.045205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:42.813261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051596+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:12:45.051596+0000","last_peered":"2024-05-07T11:12:45.051596+0000","last_clean":"2024-05-07T11:12:45.051596+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:12:45.051596+0000","last_undegraded":"2024-05-07T11:12:45.051596+0000","last_fullsized":"2024-05-07T11:12:45.051596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051768+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:12:45.051768+0000","last_peered":"2024-05-07T11:12:45.051768+0000","last_clean":"2024-05-07T11:12:45.051768+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:12:45.051768+0000","last_undegraded":"2024-05-07T11:12:45.051768+0000","last_fullsized":"2024-05-07T11:12:45.051768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050877+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:12:45.050877+0000","last_peered":"2024-05-07T11:12:45.050877+0000","last_clean":"2024-05-07T11:12:45.050877+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:12:45.050877+0000","last_undegraded":"2024-05-07T11:12:45.050877+0000","last_fullsized":"2024-05-07T11:12:45.050877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051253+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:12:45.051253+0000","last_peered":"2024-05-07T11:12:45.051253+0000","last_clean":"2024-05-07T11:12:45.051253+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:12:45.051253+0000","last_undegraded":"2024-05-07T11:12:45.051253+0000","last_fullsized":"2024-05-07T11:12:45.051253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044454+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:12:46.044454+0000","last_peered":"2024-05-07T11:12:46.044454+0000","last_clean":"2024-05-07T11:12:46.044454+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:12:46.044454+0000","last_undegraded":"2024-05-07T11:12:46.044454+0000","last_fullsized":"2024-05-07T11:12:46.044454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051364+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:12:45.051364+0000","last_peered":"2024-05-07T11:12:45.051364+0000","last_clean":"2024-05-07T11:12:45.051364+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:12:45.051364+0000","last_undegraded":"2024-05-07T11:12:45.051364+0000","last_fullsized":"2024-05-07T11:12:45.051364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045693+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:12:46.045693+0000","last_peered":"2024-05-07T11:12:46.045693+0000","last_clean":"2024-05-07T11:12:46.045693+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:12:46.045693+0000","last_undegraded":"2024-05-07T11:12:46.045693+0000","last_fullsized":"2024-05-07T11:12:46.045693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051592+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:12:45.051592+0000","last_peered":"2024-05-07T11:12:45.051592+0000","last_clean":"2024-05-07T11:12:45.051592+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:12:45.051592+0000","last_undegraded":"2024-05-07T11:12:45.051592+0000","last_fullsized":"2024-05-07T11:12:45.051592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051735+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:12:45.051735+0000","last_peered":"2024-05-07T11:12:45.051735+0000","last_clean":"2024-05-07T11:12:45.051735+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:12:45.051735+0000","last_undegraded":"2024-05-07T11:12:45.051735+0000","last_fullsized":"2024-05-07T11:12:45.051735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052590+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:12:45.052590+0000","last_peered":"2024-05-07T11:12:45.052590+0000","last_clean":"2024-05-07T11:12:45.052590+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:12:45.052590+0000","last_undegraded":"2024-05-07T11:12:45.052590+0000","last_fullsized":"2024-05-07T11:12:45.052590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050501+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:12:45.050501+0000","last_peered":"2024-05-07T11:12:45.050501+0000","last_clean":"2024-05-07T11:12:45.050501+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:12:45.050501+0000","last_undegraded":"2024-05-07T11:12:45.050501+0000","last_fullsized":"2024-05-07T11:12:45.050501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052285+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:12:45.052285+0000","last_peered":"2024-05-07T11:12:45.052285+0000","last_clean":"2024-05-07T11:12:45.052285+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:12:45.052285+0000","last_undegraded":"2024-05-07T11:12:45.052285+0000","last_fullsized":"2024-05-07T11:12:45.052285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044458+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:12:46.044458+0000","last_peered":"2024-05-07T11:12:46.044458+0000","last_clean":"2024-05-07T11:12:46.044458+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:12:46.044458+0000","last_undegraded":"2024-05-07T11:12:46.044458+0000","last_fullsized":"2024-05-07T11:12:46.044458+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045265+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:12:46.045265+0000","last_peered":"2024-05-07T11:12:46.045265+0000","last_clean":"2024-05-07T11:12:46.045265+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:12:46.045265+0000","last_undegraded":"2024-05-07T11:12:46.045265+0000","last_fullsized":"2024-05-07T11:12:46.045265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051383+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:12:45.051383+0000","last_peered":"2024-05-07T11:12:45.051383+0000","last_clean":"2024-05-07T11:12:45.051383+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:12:45.051383+0000","last_undegraded":"2024-05-07T11:12:45.051383+0000","last_fullsized":"2024-05-07T11:12:45.051383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051540+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:12:45.051540+0000","last_peered":"2024-05-07T11:12:45.051540+0000","last_clean":"2024-05-07T11:12:45.051540+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:12:45.051540+0000","last_undegraded":"2024-05-07T11:12:45.051540+0000","last_fullsized":"2024-05-07T11:12:45.051540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050384+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:12:45.050384+0000","last_peered":"2024-05-07T11:12:45.050384+0000","last_clean":"2024-05-07T11:12:45.050384+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:12:45.050384+0000","last_undegraded":"2024-05-07T11:12:45.050384+0000","last_fullsized":"2024-05-07T11:12:45.050384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045798+0000","last_change":"2024-05-07T11:12:43.054017+0000","last_active":"2024-05-07T11:12:46.045798+0000","last_peered":"2024-05-07T11:12:46.045798+0000","last_clean":"2024-05-07T11:12:46.045798+0000","last_became_active":"2024-05-07T11:12:43.053655+0000","last_became_peered":"2024-05-07T11:12:43.053655+0000","last_unstale":"2024-05-07T11:12:46.045798+0000","last_undegraded":"2024-05-07T11:12:46.045798+0000","last_fullsized":"2024-05-07T11:12:46.045798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044896+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:12:46.044896+0000","last_peered":"2024-05-07T11:12:46.044896+0000","last_clean":"2024-05-07T11:12:46.044896+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:12:46.044896+0000","last_undegraded":"2024-05-07T11:12:46.044896+0000","last_fullsized":"2024-05-07T11:12:46.044896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045701+0000","last_change":"2024-05-07T11:12:43.053040+0000","last_active":"2024-05-07T11:12:46.045701+0000","last_peered":"2024-05-07T11:12:46.045701+0000","last_clean":"2024-05-07T11:12:46.045701+0000","last_became_active":"2024-05-07T11:12:43.052641+0000","last_became_peered":"2024-05-07T11:12:43.052641+0000","last_unstale":"2024-05-07T11:12:46.045701+0000","last_undegraded":"2024-05-07T11:12:46.045701+0000","last_fullsized":"2024-05-07T11:12:46.045701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:56:26.393747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051649+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:12:45.051649+0000","last_peered":"2024-05-07T11:12:45.051649+0000","last_clean":"2024-05-07T11:12:45.051649+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:12:45.051649+0000","last_undegraded":"2024-05-07T11:12:45.051649+0000","last_fullsized":"2024-05-07T11:12:45.051649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051857+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:12:45.051857+0000","last_peered":"2024-05-07T11:12:45.051857+0000","last_clean":"2024-05-07T11:12:45.051857+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:12:45.051857+0000","last_undegraded":"2024-05-07T11:12:45.051857+0000","last_fullsized":"2024-05-07T11:12:45.051857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045603+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:12:46.045603+0000","last_peered":"2024-05-07T11:12:46.045603+0000","last_clean":"2024-05-07T11:12:46.045603+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:12:46.045603+0000","last_undegraded":"2024-05-07T11:12:46.045603+0000","last_fullsized":"2024-05-07T11:12:46.045603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045503+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:12:46.045503+0000","last_peered":"2024-05-07T11:12:46.045503+0000","last_clean":"2024-05-07T11:12:46.045503+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:12:46.045503+0000","last_undegraded":"2024-05-07T11:12:46.045503+0000","last_fullsized":"2024-05-07T11:12:46.045503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045711+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:12:46.045711+0000","last_peered":"2024-05-07T11:12:46.045711+0000","last_clean":"2024-05-07T11:12:46.045711+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:12:46.045711+0000","last_undegraded":"2024-05-07T11:12:46.045711+0000","last_fullsized":"2024-05-07T11:12:46.045711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050653+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:12:45.050653+0000","last_peered":"2024-05-07T11:12:45.050653+0000","last_clean":"2024-05-07T11:12:45.050653+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:12:45.050653+0000","last_undegraded":"2024-05-07T11:12:45.050653+0000","last_fullsized":"2024-05-07T11:12:45.050653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044984+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:12:46.044984+0000","last_peered":"2024-05-07T11:12:46.044984+0000","last_clean":"2024-05-07T11:12:46.044984+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:12:46.044984+0000","last_undegraded":"2024-05-07T11:12:46.044984+0000","last_fullsized":"2024-05-07T11:12:46.044984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050493+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:12:45.050493+0000","last_peered":"2024-05-07T11:12:45.050493+0000","last_clean":"2024-05-07T11:12:45.050493+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:12:45.050493+0000","last_undegraded":"2024-05-07T11:12:45.050493+0000","last_fullsized":"2024-05-07T11:12:45.050493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052487+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:12:45.052487+0000","last_peered":"2024-05-07T11:12:45.052487+0000","last_clean":"2024-05-07T11:12:45.052487+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:12:45.052487+0000","last_undegraded":"2024-05-07T11:12:45.052487+0000","last_fullsized":"2024-05-07T11:12:45.052487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045027+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:12:46.045027+0000","last_peered":"2024-05-07T11:12:46.045027+0000","last_clean":"2024-05-07T11:12:46.045027+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:12:46.045027+0000","last_undegraded":"2024-05-07T11:12:46.045027+0000","last_fullsized":"2024-05-07T11:12:46.045027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045735+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:12:46.045735+0000","last_peered":"2024-05-07T11:12:46.045735+0000","last_clean":"2024-05-07T11:12:46.045735+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:12:46.045735+0000","last_undegraded":"2024-05-07T11:12:46.045735+0000","last_fullsized":"2024-05-07T11:12:46.045735+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051913+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:12:45.051913+0000","last_peered":"2024-05-07T11:12:45.051913+0000","last_clean":"2024-05-07T11:12:45.051913+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:12:45.051913+0000","last_undegraded":"2024-05-07T11:12:45.051913+0000","last_fullsized":"2024-05-07T11:12:45.051913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045790+0000","last_change":"2024-05-07T11:12:44.059544+0000","last_active":"2024-05-07T11:12:46.045790+0000","last_peered":"2024-05-07T11:12:46.045790+0000","last_clean":"2024-05-07T11:12:46.045790+0000","last_became_active":"2024-05-07T11:12:44.058884+0000","last_became_peered":"2024-05-07T11:12:44.058884+0000","last_unstale":"2024-05-07T11:12:46.045790+0000","last_undegraded":"2024-05-07T11:12:46.045790+0000","last_fullsized":"2024-05-07T11:12:46.045790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:46:22.416221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044746+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:12:46.044746+0000","last_peered":"2024-05-07T11:12:46.044746+0000","last_clean":"2024-05-07T11:12:46.044746+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:12:46.044746+0000","last_undegraded":"2024-05-07T11:12:46.044746+0000","last_fullsized":"2024-05-07T11:12:46.044746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051566+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:12:45.051566+0000","last_peered":"2024-05-07T11:12:45.051566+0000","last_clean":"2024-05-07T11:12:45.051566+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:12:45.051566+0000","last_undegraded":"2024-05-07T11:12:45.051566+0000","last_fullsized":"2024-05-07T11:12:45.051566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051280+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:12:45.051280+0000","last_peered":"2024-05-07T11:12:45.051280+0000","last_clean":"2024-05-07T11:12:45.051280+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:12:45.051280+0000","last_undegraded":"2024-05-07T11:12:45.051280+0000","last_fullsized":"2024-05-07T11:12:45.051280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051628+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:12:45.051628+0000","last_peered":"2024-05-07T11:12:45.051628+0000","last_clean":"2024-05-07T11:12:45.051628+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:12:45.051628+0000","last_undegraded":"2024-05-07T11:12:45.051628+0000","last_fullsized":"2024-05-07T11:12:45.051628+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050743+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:12:45.050743+0000","last_peered":"2024-05-07T11:12:45.050743+0000","last_clean":"2024-05-07T11:12:45.050743+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:12:45.050743+0000","last_undegraded":"2024-05-07T11:12:45.050743+0000","last_fullsized":"2024-05-07T11:12:45.050743+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052485+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:12:45.052485+0000","last_peered":"2024-05-07T11:12:45.052485+0000","last_clean":"2024-05-07T11:12:45.052485+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:12:45.052485+0000","last_undegraded":"2024-05-07T11:12:45.052485+0000","last_fullsized":"2024-05-07T11:12:45.052485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045587+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:12:46.045587+0000","last_peered":"2024-05-07T11:12:46.045587+0000","last_clean":"2024-05-07T11:12:46.045587+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:12:46.045587+0000","last_undegraded":"2024-05-07T11:12:46.045587+0000","last_fullsized":"2024-05-07T11:12:46.045587+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045708+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:12:46.045708+0000","last_peered":"2024-05-07T11:12:46.045708+0000","last_clean":"2024-05-07T11:12:46.045708+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:12:46.045708+0000","last_undegraded":"2024-05-07T11:12:46.045708+0000","last_fullsized":"2024-05-07T11:12:46.045708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052318+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:12:45.052318+0000","last_peered":"2024-05-07T11:12:45.052318+0000","last_clean":"2024-05-07T11:12:45.052318+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:12:45.052318+0000","last_undegraded":"2024-05-07T11:12:45.052318+0000","last_fullsized":"2024-05-07T11:12:45.052318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045850+0000","last_change":"2024-05-07T11:12:43.053188+0000","last_active":"2024-05-07T11:12:46.045850+0000","last_peered":"2024-05-07T11:12:46.045850+0000","last_clean":"2024-05-07T11:12:46.045850+0000","last_became_active":"2024-05-07T11:12:43.052570+0000","last_became_peered":"2024-05-07T11:12:43.052570+0000","last_unstale":"2024-05-07T11:12:46.045850+0000","last_undegraded":"2024-05-07T11:12:46.045850+0000","last_fullsized":"2024-05-07T11:12:46.045850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052376+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:12:45.052376+0000","last_peered":"2024-05-07T11:12:45.052376+0000","last_clean":"2024-05-07T11:12:45.052376+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:12:45.052376+0000","last_undegraded":"2024-05-07T11:12:45.052376+0000","last_fullsized":"2024-05-07T11:12:45.052376+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050802+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:12:45.050802+0000","last_peered":"2024-05-07T11:12:45.050802+0000","last_clean":"2024-05-07T11:12:45.050802+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:12:45.050802+0000","last_undegraded":"2024-05-07T11:12:45.050802+0000","last_fullsized":"2024-05-07T11:12:45.050802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052342+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:12:45.052342+0000","last_peered":"2024-05-07T11:12:45.052342+0000","last_clean":"2024-05-07T11:12:45.052342+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:12:45.052342+0000","last_undegraded":"2024-05-07T11:12:45.052342+0000","last_fullsized":"2024-05-07T11:12:45.052342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051790+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:12:45.051790+0000","last_peered":"2024-05-07T11:12:45.051790+0000","last_clean":"2024-05-07T11:12:45.051790+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:12:45.051790+0000","last_undegraded":"2024-05-07T11:12:45.051790+0000","last_fullsized":"2024-05-07T11:12:45.051790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050741+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:12:45.050741+0000","last_peered":"2024-05-07T11:12:45.050741+0000","last_clean":"2024-05-07T11:12:45.050741+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:12:45.050741+0000","last_undegraded":"2024-05-07T11:12:45.050741+0000","last_fullsized":"2024-05-07T11:12:45.050741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052758+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:12:45.052758+0000","last_peered":"2024-05-07T11:12:45.052758+0000","last_clean":"2024-05-07T11:12:45.052758+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:12:45.052758+0000","last_undegraded":"2024-05-07T11:12:45.052758+0000","last_fullsized":"2024-05-07T11:12:45.052758+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052643+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:12:45.052643+0000","last_peered":"2024-05-07T11:12:45.052643+0000","last_clean":"2024-05-07T11:12:45.052643+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:12:45.052643+0000","last_undegraded":"2024-05-07T11:12:45.052643+0000","last_fullsized":"2024-05-07T11:12:45.052643+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051464+0000","last_change":"2024-05-07T11:12:44.056491+0000","last_active":"2024-05-07T11:12:45.051464+0000","last_peered":"2024-05-07T11:12:45.051464+0000","last_clean":"2024-05-07T11:12:45.051464+0000","last_became_active":"2024-05-07T11:12:44.056196+0000","last_became_peered":"2024-05-07T11:12:44.056196+0000","last_unstale":"2024-05-07T11:12:45.051464+0000","last_undegraded":"2024-05-07T11:12:45.051464+0000","last_fullsized":"2024-05-07T11:12:45.051464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.043497+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:12:46.043497+0000","last_peered":"2024-05-07T11:12:46.043497+0000","last_clean":"2024-05-07T11:12:46.043497+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:12:46.043497+0000","last_undegraded":"2024-05-07T11:12:46.043497+0000","last_fullsized":"2024-05-07T11:12:46.043497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045228+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:12:46.045228+0000","last_peered":"2024-05-07T11:12:46.045228+0000","last_clean":"2024-05-07T11:12:46.045228+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:12:46.045228+0000","last_undegraded":"2024-05-07T11:12:46.045228+0000","last_fullsized":"2024-05-07T11:12:46.045228+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050439+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:12:45.050439+0000","last_peered":"2024-05-07T11:12:45.050439+0000","last_clean":"2024-05-07T11:12:45.050439+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:12:45.050439+0000","last_undegraded":"2024-05-07T11:12:45.050439+0000","last_fullsized":"2024-05-07T11:12:45.050439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045214+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:12:46.045214+0000","last_peered":"2024-05-07T11:12:46.045214+0000","last_clean":"2024-05-07T11:12:46.045214+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:12:46.045214+0000","last_undegraded":"2024-05-07T11:12:46.045214+0000","last_fullsized":"2024-05-07T11:12:46.045214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051515+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:12:45.051515+0000","last_peered":"2024-05-07T11:12:45.051515+0000","last_clean":"2024-05-07T11:12:45.051515+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:12:45.051515+0000","last_undegraded":"2024-05-07T11:12:45.051515+0000","last_fullsized":"2024-05-07T11:12:45.051515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051787+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:12:45.051787+0000","last_peered":"2024-05-07T11:12:45.051787+0000","last_clean":"2024-05-07T11:12:45.051787+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:12:45.051787+0000","last_undegraded":"2024-05-07T11:12:45.051787+0000","last_fullsized":"2024-05-07T11:12:45.051787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053163+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.052490+0000","last_became_peered":"2024-05-07T11:12:43.052490+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051421+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:12:45.051421+0000","last_peered":"2024-05-07T11:12:45.051421+0000","last_clean":"2024-05-07T11:12:45.051421+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:12:45.051421+0000","last_undegraded":"2024-05-07T11:12:45.051421+0000","last_fullsized":"2024-05-07T11:12:45.051421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052690+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:12:45.052690+0000","last_peered":"2024-05-07T11:12:45.052690+0000","last_clean":"2024-05-07T11:12:45.052690+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:12:45.052690+0000","last_undegraded":"2024-05-07T11:12:45.052690+0000","last_fullsized":"2024-05-07T11:12:45.052690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051438+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:12:45.051438+0000","last_peered":"2024-05-07T11:12:45.051438+0000","last_clean":"2024-05-07T11:12:45.051438+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:12:45.051438+0000","last_undegraded":"2024-05-07T11:12:45.051438+0000","last_fullsized":"2024-05-07T11:12:45.051438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051706+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:12:45.051706+0000","last_peered":"2024-05-07T11:12:45.051706+0000","last_clean":"2024-05-07T11:12:45.051706+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:12:45.051706+0000","last_undegraded":"2024-05-07T11:12:45.051706+0000","last_fullsized":"2024-05-07T11:12:45.051706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051696+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:12:45.051696+0000","last_peered":"2024-05-07T11:12:45.051696+0000","last_clean":"2024-05-07T11:12:45.051696+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:12:45.051696+0000","last_undegraded":"2024-05-07T11:12:45.051696+0000","last_fullsized":"2024-05-07T11:12:45.051696+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052275+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:12:45.052275+0000","last_peered":"2024-05-07T11:12:45.052275+0000","last_clean":"2024-05-07T11:12:45.052275+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:12:45.052275+0000","last_undegraded":"2024-05-07T11:12:45.052275+0000","last_fullsized":"2024-05-07T11:12:45.052275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051505+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:12:45.051505+0000","last_peered":"2024-05-07T11:12:45.051505+0000","last_clean":"2024-05-07T11:12:45.051505+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:12:45.051505+0000","last_undegraded":"2024-05-07T11:12:45.051505+0000","last_fullsized":"2024-05-07T11:12:45.051505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051445+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:12:45.051445+0000","last_peered":"2024-05-07T11:12:45.051445+0000","last_clean":"2024-05-07T11:12:45.051445+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:12:45.051445+0000","last_undegraded":"2024-05-07T11:12:45.051445+0000","last_fullsized":"2024-05-07T11:12:45.051445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050944+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:12:45.050944+0000","last_peered":"2024-05-07T11:12:45.050944+0000","last_clean":"2024-05-07T11:12:45.050944+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:12:45.050944+0000","last_undegraded":"2024-05-07T11:12:45.050944+0000","last_fullsized":"2024-05-07T11:12:45.050944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051008+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:12:45.051008+0000","last_peered":"2024-05-07T11:12:45.051008+0000","last_clean":"2024-05-07T11:12:45.051008+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:12:45.051008+0000","last_undegraded":"2024-05-07T11:12:45.051008+0000","last_fullsized":"2024-05-07T11:12:45.051008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051044+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:12:45.051044+0000","last_peered":"2024-05-07T11:12:45.051044+0000","last_clean":"2024-05-07T11:12:45.051044+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:12:45.051044+0000","last_undegraded":"2024-05-07T11:12:45.051044+0000","last_fullsized":"2024-05-07T11:12:45.051044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045230+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:12:46.045230+0000","last_peered":"2024-05-07T11:12:46.045230+0000","last_clean":"2024-05-07T11:12:46.045230+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:12:46.045230+0000","last_undegraded":"2024-05-07T11:12:46.045230+0000","last_fullsized":"2024-05-07T11:12:46.045230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045154+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:12:46.045154+0000","last_peered":"2024-05-07T11:12:46.045154+0000","last_clean":"2024-05-07T11:12:46.045154+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:12:46.045154+0000","last_undegraded":"2024-05-07T11:12:46.045154+0000","last_fullsized":"2024-05-07T11:12:46.045154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051665+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:12:45.051665+0000","last_peered":"2024-05-07T11:12:45.051665+0000","last_clean":"2024-05-07T11:12:45.051665+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:12:45.051665+0000","last_undegraded":"2024-05-07T11:12:45.051665+0000","last_fullsized":"2024-05-07T11:12:45.051665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051165+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:12:45.051165+0000","last_peered":"2024-05-07T11:12:45.051165+0000","last_clean":"2024-05-07T11:12:45.051165+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:12:45.051165+0000","last_undegraded":"2024-05-07T11:12:45.051165+0000","last_fullsized":"2024-05-07T11:12:45.051165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052504+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:12:45.052504+0000","last_peered":"2024-05-07T11:12:45.052504+0000","last_clean":"2024-05-07T11:12:45.052504+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:12:45.052504+0000","last_undegraded":"2024-05-07T11:12:45.052504+0000","last_fullsized":"2024-05-07T11:12:45.052504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044918+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:12:46.044918+0000","last_peered":"2024-05-07T11:12:46.044918+0000","last_clean":"2024-05-07T11:12:46.044918+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:12:46.044918+0000","last_undegraded":"2024-05-07T11:12:46.044918+0000","last_fullsized":"2024-05-07T11:12:46.044918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052615+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:12:45.052615+0000","last_peered":"2024-05-07T11:12:45.052615+0000","last_clean":"2024-05-07T11:12:45.052615+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:12:45.052615+0000","last_undegraded":"2024-05-07T11:12:45.052615+0000","last_fullsized":"2024-05-07T11:12:45.052615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":638861,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":638245,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:12:51.836 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-07T11:12:51.837 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-07T11:12:51.837 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-07T11:12:51.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-07T11:12:51.837 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-07T11:12:52.228 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:52.239 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":4091824527},{"type":"v1","addr":"172.21.15.62:6801","nonce":4091824527}]},"active_addr":"172.21.15.62:6801/4091824527","active_change":"2024-05-07T11:12:32.930876+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":785395910}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":3213771254}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":3359559675}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":222446553}]}]} 2024-05-07T11:12:52.242 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-07T11:12:52.242 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-07T11:12:52.243 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:52.543 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:52.543 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":15,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:45.043439+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:52.556 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-07T11:12:52.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:52.855 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:52.855 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":15,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:45.043439+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:52.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-07T11:12:52.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-07T11:12:52.870 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-07T11:12:53.017 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-05-07T11:12:53.017 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T11:12:53.018 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-05-07T11:12:53.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T11:12:53.019 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-05-07T11:12:53.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T11:12:53.369 INFO:teuthology.orchestra.run.smithi062.stdout:34359738373 2024-05-07T11:12:53.371 INFO:teuthology.orchestra.run.smithi062.stdout:34359738373 2024-05-07T11:12:53.374 INFO:teuthology.orchestra.run.smithi062.stdout:34359738373 2024-05-07T11:12:53.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-05-07T11:12:53.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2024-05-07T11:12:53.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2024-05-07T11:12:54.388 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T11:12:54.388 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T11:12:54.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T11:12:54.709 INFO:teuthology.orchestra.run.smithi062.stdout:34359738373 2024-05-07T11:12:54.712 INFO:teuthology.orchestra.run.smithi062.stdout:34359738373 2024-05-07T11:12:54.716 INFO:teuthology.orchestra.run.smithi062.stdout:34359738373 2024-05-07T11:12:54.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2024-05-07T11:12:54.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-05-07T11:12:54.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2024-05-07T11:12:55.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T11:12:55.728 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T11:12:55.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T11:12:56.050 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-05-07T11:12:56.061 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-05-07T11:12:56.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2024-05-07T11:12:56.064 DEBUG:teuthology.parallel:result is None 2024-05-07T11:12:56.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-05-07T11:12:56.074 DEBUG:teuthology.parallel:result is None 2024-05-07T11:12:56.101 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-05-07T11:12:56.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.0 2024-05-07T11:12:56.113 DEBUG:teuthology.parallel:result is None 2024-05-07T11:12:56.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-07T11:12:56.114 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:12:56.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:56.457 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:12:56.466 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-07T11:12:54.940226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81628,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033892,"statfs":{"total":289910292480,"available":289826705408,"internally_reserved":0,"allocated":573440,"data_stored":1323805,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002141"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051518+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:12:45.051518+0000","last_peered":"2024-05-07T11:12:45.051518+0000","last_clean":"2024-05-07T11:12:45.051518+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:12:45.051518+0000","last_undegraded":"2024-05-07T11:12:45.051518+0000","last_fullsized":"2024-05-07T11:12:45.051518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051016+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:12:45.051016+0000","last_peered":"2024-05-07T11:12:45.051016+0000","last_clean":"2024-05-07T11:12:45.051016+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:12:45.051016+0000","last_undegraded":"2024-05-07T11:12:45.051016+0000","last_fullsized":"2024-05-07T11:12:45.051016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044931+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:12:46.044931+0000","last_peered":"2024-05-07T11:12:46.044931+0000","last_clean":"2024-05-07T11:12:46.044931+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:12:46.044931+0000","last_undegraded":"2024-05-07T11:12:46.044931+0000","last_fullsized":"2024-05-07T11:12:46.044931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051123+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:12:45.051123+0000","last_peered":"2024-05-07T11:12:45.051123+0000","last_clean":"2024-05-07T11:12:45.051123+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:12:45.051123+0000","last_undegraded":"2024-05-07T11:12:45.051123+0000","last_fullsized":"2024-05-07T11:12:45.051123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044619+0000","last_change":"2024-05-07T11:12:44.054002+0000","last_active":"2024-05-07T11:12:46.044619+0000","last_peered":"2024-05-07T11:12:46.044619+0000","last_clean":"2024-05-07T11:12:46.044619+0000","last_became_active":"2024-05-07T11:12:44.053275+0000","last_became_peered":"2024-05-07T11:12:44.053275+0000","last_unstale":"2024-05-07T11:12:46.044619+0000","last_undegraded":"2024-05-07T11:12:46.044619+0000","last_fullsized":"2024-05-07T11:12:46.044619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044470+0000","last_change":"2024-05-07T11:12:44.053753+0000","last_active":"2024-05-07T11:12:46.044470+0000","last_peered":"2024-05-07T11:12:46.044470+0000","last_clean":"2024-05-07T11:12:46.044470+0000","last_became_active":"2024-05-07T11:12:44.052991+0000","last_became_peered":"2024-05-07T11:12:44.052991+0000","last_unstale":"2024-05-07T11:12:46.044470+0000","last_undegraded":"2024-05-07T11:12:46.044470+0000","last_fullsized":"2024-05-07T11:12:46.044470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044203+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:12:46.044203+0000","last_peered":"2024-05-07T11:12:46.044203+0000","last_clean":"2024-05-07T11:12:46.044203+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:12:46.044203+0000","last_undegraded":"2024-05-07T11:12:46.044203+0000","last_fullsized":"2024-05-07T11:12:46.044203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052288+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:12:45.052288+0000","last_peered":"2024-05-07T11:12:45.052288+0000","last_clean":"2024-05-07T11:12:45.052288+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:12:45.052288+0000","last_undegraded":"2024-05-07T11:12:45.052288+0000","last_fullsized":"2024-05-07T11:12:45.052288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051125+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:12:45.051125+0000","last_peered":"2024-05-07T11:12:45.051125+0000","last_clean":"2024-05-07T11:12:45.051125+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:12:45.051125+0000","last_undegraded":"2024-05-07T11:12:45.051125+0000","last_fullsized":"2024-05-07T11:12:45.051125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045295+0000","last_change":"2024-05-07T11:12:44.054308+0000","last_active":"2024-05-07T11:12:46.045295+0000","last_peered":"2024-05-07T11:12:46.045295+0000","last_clean":"2024-05-07T11:12:46.045295+0000","last_became_active":"2024-05-07T11:12:44.053809+0000","last_became_peered":"2024-05-07T11:12:44.053809+0000","last_unstale":"2024-05-07T11:12:46.045295+0000","last_undegraded":"2024-05-07T11:12:46.045295+0000","last_fullsized":"2024-05-07T11:12:46.045295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:22.261724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051159+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:12:45.051159+0000","last_peered":"2024-05-07T11:12:45.051159+0000","last_clean":"2024-05-07T11:12:45.051159+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:12:45.051159+0000","last_undegraded":"2024-05-07T11:12:45.051159+0000","last_fullsized":"2024-05-07T11:12:45.051159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050678+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:12:45.050678+0000","last_peered":"2024-05-07T11:12:45.050678+0000","last_clean":"2024-05-07T11:12:45.050678+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:12:45.050678+0000","last_undegraded":"2024-05-07T11:12:45.050678+0000","last_fullsized":"2024-05-07T11:12:45.050678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044673+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:12:46.044673+0000","last_peered":"2024-05-07T11:12:46.044673+0000","last_clean":"2024-05-07T11:12:46.044673+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:12:46.044673+0000","last_undegraded":"2024-05-07T11:12:46.044673+0000","last_fullsized":"2024-05-07T11:12:46.044673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044712+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:12:46.044712+0000","last_peered":"2024-05-07T11:12:46.044712+0000","last_clean":"2024-05-07T11:12:46.044712+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:12:46.044712+0000","last_undegraded":"2024-05-07T11:12:46.044712+0000","last_fullsized":"2024-05-07T11:12:46.044712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044199+0000","last_change":"2024-05-07T11:12:44.057719+0000","last_active":"2024-05-07T11:12:46.044199+0000","last_peered":"2024-05-07T11:12:46.044199+0000","last_clean":"2024-05-07T11:12:46.044199+0000","last_became_active":"2024-05-07T11:12:44.055208+0000","last_became_peered":"2024-05-07T11:12:44.055208+0000","last_unstale":"2024-05-07T11:12:46.044199+0000","last_undegraded":"2024-05-07T11:12:46.044199+0000","last_fullsized":"2024-05-07T11:12:46.044199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052775+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:12:45.052775+0000","last_peered":"2024-05-07T11:12:45.052775+0000","last_clean":"2024-05-07T11:12:45.052775+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:12:45.052775+0000","last_undegraded":"2024-05-07T11:12:45.052775+0000","last_fullsized":"2024-05-07T11:12:45.052775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051527+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:12:45.051527+0000","last_peered":"2024-05-07T11:12:45.051527+0000","last_clean":"2024-05-07T11:12:45.051527+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:12:45.051527+0000","last_undegraded":"2024-05-07T11:12:45.051527+0000","last_fullsized":"2024-05-07T11:12:45.051527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052169+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:12:45.052169+0000","last_peered":"2024-05-07T11:12:45.052169+0000","last_clean":"2024-05-07T11:12:45.052169+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:12:45.052169+0000","last_undegraded":"2024-05-07T11:12:45.052169+0000","last_fullsized":"2024-05-07T11:12:45.052169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045083+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:12:46.045083+0000","last_peered":"2024-05-07T11:12:46.045083+0000","last_clean":"2024-05-07T11:12:46.045083+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:12:46.045083+0000","last_undegraded":"2024-05-07T11:12:46.045083+0000","last_fullsized":"2024-05-07T11:12:46.045083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044990+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:12:46.044990+0000","last_peered":"2024-05-07T11:12:46.044990+0000","last_clean":"2024-05-07T11:12:46.044990+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:12:46.044990+0000","last_undegraded":"2024-05-07T11:12:46.044990+0000","last_fullsized":"2024-05-07T11:12:46.044990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050573+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:12:45.050573+0000","last_peered":"2024-05-07T11:12:45.050573+0000","last_clean":"2024-05-07T11:12:45.050573+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:12:45.050573+0000","last_undegraded":"2024-05-07T11:12:45.050573+0000","last_fullsized":"2024-05-07T11:12:45.050573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051210+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:12:45.051210+0000","last_peered":"2024-05-07T11:12:45.051210+0000","last_clean":"2024-05-07T11:12:45.051210+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:12:45.051210+0000","last_undegraded":"2024-05-07T11:12:45.051210+0000","last_fullsized":"2024-05-07T11:12:45.051210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050292+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:12:45.050292+0000","last_peered":"2024-05-07T11:12:45.050292+0000","last_clean":"2024-05-07T11:12:45.050292+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:12:45.050292+0000","last_undegraded":"2024-05-07T11:12:45.050292+0000","last_fullsized":"2024-05-07T11:12:45.050292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051631+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:12:45.051631+0000","last_peered":"2024-05-07T11:12:45.051631+0000","last_clean":"2024-05-07T11:12:45.051631+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:12:45.051631+0000","last_undegraded":"2024-05-07T11:12:45.051631+0000","last_fullsized":"2024-05-07T11:12:45.051631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052426+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:12:45.052426+0000","last_peered":"2024-05-07T11:12:45.052426+0000","last_clean":"2024-05-07T11:12:45.052426+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:12:45.052426+0000","last_undegraded":"2024-05-07T11:12:45.052426+0000","last_fullsized":"2024-05-07T11:12:45.052426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045205+0000","last_change":"2024-05-07T11:12:44.059023+0000","last_active":"2024-05-07T11:12:46.045205+0000","last_peered":"2024-05-07T11:12:46.045205+0000","last_clean":"2024-05-07T11:12:46.045205+0000","last_became_active":"2024-05-07T11:12:44.057224+0000","last_became_peered":"2024-05-07T11:12:44.057224+0000","last_unstale":"2024-05-07T11:12:46.045205+0000","last_undegraded":"2024-05-07T11:12:46.045205+0000","last_fullsized":"2024-05-07T11:12:46.045205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:42.813261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051596+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:12:45.051596+0000","last_peered":"2024-05-07T11:12:45.051596+0000","last_clean":"2024-05-07T11:12:45.051596+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:12:45.051596+0000","last_undegraded":"2024-05-07T11:12:45.051596+0000","last_fullsized":"2024-05-07T11:12:45.051596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051768+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:12:45.051768+0000","last_peered":"2024-05-07T11:12:45.051768+0000","last_clean":"2024-05-07T11:12:45.051768+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:12:45.051768+0000","last_undegraded":"2024-05-07T11:12:45.051768+0000","last_fullsized":"2024-05-07T11:12:45.051768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050877+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:12:45.050877+0000","last_peered":"2024-05-07T11:12:45.050877+0000","last_clean":"2024-05-07T11:12:45.050877+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:12:45.050877+0000","last_undegraded":"2024-05-07T11:12:45.050877+0000","last_fullsized":"2024-05-07T11:12:45.050877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051253+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:12:45.051253+0000","last_peered":"2024-05-07T11:12:45.051253+0000","last_clean":"2024-05-07T11:12:45.051253+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:12:45.051253+0000","last_undegraded":"2024-05-07T11:12:45.051253+0000","last_fullsized":"2024-05-07T11:12:45.051253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044454+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:12:46.044454+0000","last_peered":"2024-05-07T11:12:46.044454+0000","last_clean":"2024-05-07T11:12:46.044454+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:12:46.044454+0000","last_undegraded":"2024-05-07T11:12:46.044454+0000","last_fullsized":"2024-05-07T11:12:46.044454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051364+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:12:45.051364+0000","last_peered":"2024-05-07T11:12:45.051364+0000","last_clean":"2024-05-07T11:12:45.051364+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:12:45.051364+0000","last_undegraded":"2024-05-07T11:12:45.051364+0000","last_fullsized":"2024-05-07T11:12:45.051364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045693+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:12:46.045693+0000","last_peered":"2024-05-07T11:12:46.045693+0000","last_clean":"2024-05-07T11:12:46.045693+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:12:46.045693+0000","last_undegraded":"2024-05-07T11:12:46.045693+0000","last_fullsized":"2024-05-07T11:12:46.045693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051592+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:12:45.051592+0000","last_peered":"2024-05-07T11:12:45.051592+0000","last_clean":"2024-05-07T11:12:45.051592+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:12:45.051592+0000","last_undegraded":"2024-05-07T11:12:45.051592+0000","last_fullsized":"2024-05-07T11:12:45.051592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051735+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:12:45.051735+0000","last_peered":"2024-05-07T11:12:45.051735+0000","last_clean":"2024-05-07T11:12:45.051735+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:12:45.051735+0000","last_undegraded":"2024-05-07T11:12:45.051735+0000","last_fullsized":"2024-05-07T11:12:45.051735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052590+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:12:45.052590+0000","last_peered":"2024-05-07T11:12:45.052590+0000","last_clean":"2024-05-07T11:12:45.052590+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:12:45.052590+0000","last_undegraded":"2024-05-07T11:12:45.052590+0000","last_fullsized":"2024-05-07T11:12:45.052590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050501+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:12:45.050501+0000","last_peered":"2024-05-07T11:12:45.050501+0000","last_clean":"2024-05-07T11:12:45.050501+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:12:45.050501+0000","last_undegraded":"2024-05-07T11:12:45.050501+0000","last_fullsized":"2024-05-07T11:12:45.050501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052285+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:12:45.052285+0000","last_peered":"2024-05-07T11:12:45.052285+0000","last_clean":"2024-05-07T11:12:45.052285+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:12:45.052285+0000","last_undegraded":"2024-05-07T11:12:45.052285+0000","last_fullsized":"2024-05-07T11:12:45.052285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044458+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:12:46.044458+0000","last_peered":"2024-05-07T11:12:46.044458+0000","last_clean":"2024-05-07T11:12:46.044458+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:12:46.044458+0000","last_undegraded":"2024-05-07T11:12:46.044458+0000","last_fullsized":"2024-05-07T11:12:46.044458+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045265+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:12:46.045265+0000","last_peered":"2024-05-07T11:12:46.045265+0000","last_clean":"2024-05-07T11:12:46.045265+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:12:46.045265+0000","last_undegraded":"2024-05-07T11:12:46.045265+0000","last_fullsized":"2024-05-07T11:12:46.045265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051383+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:12:45.051383+0000","last_peered":"2024-05-07T11:12:45.051383+0000","last_clean":"2024-05-07T11:12:45.051383+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:12:45.051383+0000","last_undegraded":"2024-05-07T11:12:45.051383+0000","last_fullsized":"2024-05-07T11:12:45.051383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051540+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:12:45.051540+0000","last_peered":"2024-05-07T11:12:45.051540+0000","last_clean":"2024-05-07T11:12:45.051540+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:12:45.051540+0000","last_undegraded":"2024-05-07T11:12:45.051540+0000","last_fullsized":"2024-05-07T11:12:45.051540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050384+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:12:45.050384+0000","last_peered":"2024-05-07T11:12:45.050384+0000","last_clean":"2024-05-07T11:12:45.050384+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:12:45.050384+0000","last_undegraded":"2024-05-07T11:12:45.050384+0000","last_fullsized":"2024-05-07T11:12:45.050384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045798+0000","last_change":"2024-05-07T11:12:43.054017+0000","last_active":"2024-05-07T11:12:46.045798+0000","last_peered":"2024-05-07T11:12:46.045798+0000","last_clean":"2024-05-07T11:12:46.045798+0000","last_became_active":"2024-05-07T11:12:43.053655+0000","last_became_peered":"2024-05-07T11:12:43.053655+0000","last_unstale":"2024-05-07T11:12:46.045798+0000","last_undegraded":"2024-05-07T11:12:46.045798+0000","last_fullsized":"2024-05-07T11:12:46.045798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044896+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:12:46.044896+0000","last_peered":"2024-05-07T11:12:46.044896+0000","last_clean":"2024-05-07T11:12:46.044896+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:12:46.044896+0000","last_undegraded":"2024-05-07T11:12:46.044896+0000","last_fullsized":"2024-05-07T11:12:46.044896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045701+0000","last_change":"2024-05-07T11:12:43.053040+0000","last_active":"2024-05-07T11:12:46.045701+0000","last_peered":"2024-05-07T11:12:46.045701+0000","last_clean":"2024-05-07T11:12:46.045701+0000","last_became_active":"2024-05-07T11:12:43.052641+0000","last_became_peered":"2024-05-07T11:12:43.052641+0000","last_unstale":"2024-05-07T11:12:46.045701+0000","last_undegraded":"2024-05-07T11:12:46.045701+0000","last_fullsized":"2024-05-07T11:12:46.045701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:56:26.393747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051649+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:12:45.051649+0000","last_peered":"2024-05-07T11:12:45.051649+0000","last_clean":"2024-05-07T11:12:45.051649+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:12:45.051649+0000","last_undegraded":"2024-05-07T11:12:45.051649+0000","last_fullsized":"2024-05-07T11:12:45.051649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051857+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:12:45.051857+0000","last_peered":"2024-05-07T11:12:45.051857+0000","last_clean":"2024-05-07T11:12:45.051857+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:12:45.051857+0000","last_undegraded":"2024-05-07T11:12:45.051857+0000","last_fullsized":"2024-05-07T11:12:45.051857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045603+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:12:46.045603+0000","last_peered":"2024-05-07T11:12:46.045603+0000","last_clean":"2024-05-07T11:12:46.045603+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:12:46.045603+0000","last_undegraded":"2024-05-07T11:12:46.045603+0000","last_fullsized":"2024-05-07T11:12:46.045603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045503+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:12:46.045503+0000","last_peered":"2024-05-07T11:12:46.045503+0000","last_clean":"2024-05-07T11:12:46.045503+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:12:46.045503+0000","last_undegraded":"2024-05-07T11:12:46.045503+0000","last_fullsized":"2024-05-07T11:12:46.045503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045711+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:12:46.045711+0000","last_peered":"2024-05-07T11:12:46.045711+0000","last_clean":"2024-05-07T11:12:46.045711+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:12:46.045711+0000","last_undegraded":"2024-05-07T11:12:46.045711+0000","last_fullsized":"2024-05-07T11:12:46.045711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050653+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:12:45.050653+0000","last_peered":"2024-05-07T11:12:45.050653+0000","last_clean":"2024-05-07T11:12:45.050653+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:12:45.050653+0000","last_undegraded":"2024-05-07T11:12:45.050653+0000","last_fullsized":"2024-05-07T11:12:45.050653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044984+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:12:46.044984+0000","last_peered":"2024-05-07T11:12:46.044984+0000","last_clean":"2024-05-07T11:12:46.044984+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:12:46.044984+0000","last_undegraded":"2024-05-07T11:12:46.044984+0000","last_fullsized":"2024-05-07T11:12:46.044984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050493+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:12:45.050493+0000","last_peered":"2024-05-07T11:12:45.050493+0000","last_clean":"2024-05-07T11:12:45.050493+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:12:45.050493+0000","last_undegraded":"2024-05-07T11:12:45.050493+0000","last_fullsized":"2024-05-07T11:12:45.050493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052487+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:12:45.052487+0000","last_peered":"2024-05-07T11:12:45.052487+0000","last_clean":"2024-05-07T11:12:45.052487+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:12:45.052487+0000","last_undegraded":"2024-05-07T11:12:45.052487+0000","last_fullsized":"2024-05-07T11:12:45.052487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045027+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:12:46.045027+0000","last_peered":"2024-05-07T11:12:46.045027+0000","last_clean":"2024-05-07T11:12:46.045027+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:12:46.045027+0000","last_undegraded":"2024-05-07T11:12:46.045027+0000","last_fullsized":"2024-05-07T11:12:46.045027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045735+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:12:46.045735+0000","last_peered":"2024-05-07T11:12:46.045735+0000","last_clean":"2024-05-07T11:12:46.045735+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:12:46.045735+0000","last_undegraded":"2024-05-07T11:12:46.045735+0000","last_fullsized":"2024-05-07T11:12:46.045735+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051913+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:12:45.051913+0000","last_peered":"2024-05-07T11:12:45.051913+0000","last_clean":"2024-05-07T11:12:45.051913+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:12:45.051913+0000","last_undegraded":"2024-05-07T11:12:45.051913+0000","last_fullsized":"2024-05-07T11:12:45.051913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045790+0000","last_change":"2024-05-07T11:12:44.059544+0000","last_active":"2024-05-07T11:12:46.045790+0000","last_peered":"2024-05-07T11:12:46.045790+0000","last_clean":"2024-05-07T11:12:46.045790+0000","last_became_active":"2024-05-07T11:12:44.058884+0000","last_became_peered":"2024-05-07T11:12:44.058884+0000","last_unstale":"2024-05-07T11:12:46.045790+0000","last_undegraded":"2024-05-07T11:12:46.045790+0000","last_fullsized":"2024-05-07T11:12:46.045790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:46:22.416221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044746+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:12:46.044746+0000","last_peered":"2024-05-07T11:12:46.044746+0000","last_clean":"2024-05-07T11:12:46.044746+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:12:46.044746+0000","last_undegraded":"2024-05-07T11:12:46.044746+0000","last_fullsized":"2024-05-07T11:12:46.044746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051566+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:12:45.051566+0000","last_peered":"2024-05-07T11:12:45.051566+0000","last_clean":"2024-05-07T11:12:45.051566+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:12:45.051566+0000","last_undegraded":"2024-05-07T11:12:45.051566+0000","last_fullsized":"2024-05-07T11:12:45.051566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051280+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:12:45.051280+0000","last_peered":"2024-05-07T11:12:45.051280+0000","last_clean":"2024-05-07T11:12:45.051280+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:12:45.051280+0000","last_undegraded":"2024-05-07T11:12:45.051280+0000","last_fullsized":"2024-05-07T11:12:45.051280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051628+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:12:45.051628+0000","last_peered":"2024-05-07T11:12:45.051628+0000","last_clean":"2024-05-07T11:12:45.051628+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:12:45.051628+0000","last_undegraded":"2024-05-07T11:12:45.051628+0000","last_fullsized":"2024-05-07T11:12:45.051628+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050743+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:12:45.050743+0000","last_peered":"2024-05-07T11:12:45.050743+0000","last_clean":"2024-05-07T11:12:45.050743+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:12:45.050743+0000","last_undegraded":"2024-05-07T11:12:45.050743+0000","last_fullsized":"2024-05-07T11:12:45.050743+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052485+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:12:45.052485+0000","last_peered":"2024-05-07T11:12:45.052485+0000","last_clean":"2024-05-07T11:12:45.052485+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:12:45.052485+0000","last_undegraded":"2024-05-07T11:12:45.052485+0000","last_fullsized":"2024-05-07T11:12:45.052485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045587+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:12:46.045587+0000","last_peered":"2024-05-07T11:12:46.045587+0000","last_clean":"2024-05-07T11:12:46.045587+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:12:46.045587+0000","last_undegraded":"2024-05-07T11:12:46.045587+0000","last_fullsized":"2024-05-07T11:12:46.045587+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045708+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:12:46.045708+0000","last_peered":"2024-05-07T11:12:46.045708+0000","last_clean":"2024-05-07T11:12:46.045708+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:12:46.045708+0000","last_undegraded":"2024-05-07T11:12:46.045708+0000","last_fullsized":"2024-05-07T11:12:46.045708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052318+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:12:45.052318+0000","last_peered":"2024-05-07T11:12:45.052318+0000","last_clean":"2024-05-07T11:12:45.052318+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:12:45.052318+0000","last_undegraded":"2024-05-07T11:12:45.052318+0000","last_fullsized":"2024-05-07T11:12:45.052318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045850+0000","last_change":"2024-05-07T11:12:43.053188+0000","last_active":"2024-05-07T11:12:46.045850+0000","last_peered":"2024-05-07T11:12:46.045850+0000","last_clean":"2024-05-07T11:12:46.045850+0000","last_became_active":"2024-05-07T11:12:43.052570+0000","last_became_peered":"2024-05-07T11:12:43.052570+0000","last_unstale":"2024-05-07T11:12:46.045850+0000","last_undegraded":"2024-05-07T11:12:46.045850+0000","last_fullsized":"2024-05-07T11:12:46.045850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052376+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:12:45.052376+0000","last_peered":"2024-05-07T11:12:45.052376+0000","last_clean":"2024-05-07T11:12:45.052376+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:12:45.052376+0000","last_undegraded":"2024-05-07T11:12:45.052376+0000","last_fullsized":"2024-05-07T11:12:45.052376+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050802+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:12:45.050802+0000","last_peered":"2024-05-07T11:12:45.050802+0000","last_clean":"2024-05-07T11:12:45.050802+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:12:45.050802+0000","last_undegraded":"2024-05-07T11:12:45.050802+0000","last_fullsized":"2024-05-07T11:12:45.050802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052342+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:12:45.052342+0000","last_peered":"2024-05-07T11:12:45.052342+0000","last_clean":"2024-05-07T11:12:45.052342+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:12:45.052342+0000","last_undegraded":"2024-05-07T11:12:45.052342+0000","last_fullsized":"2024-05-07T11:12:45.052342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051790+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:12:45.051790+0000","last_peered":"2024-05-07T11:12:45.051790+0000","last_clean":"2024-05-07T11:12:45.051790+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:12:45.051790+0000","last_undegraded":"2024-05-07T11:12:45.051790+0000","last_fullsized":"2024-05-07T11:12:45.051790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050741+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:12:45.050741+0000","last_peered":"2024-05-07T11:12:45.050741+0000","last_clean":"2024-05-07T11:12:45.050741+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:12:45.050741+0000","last_undegraded":"2024-05-07T11:12:45.050741+0000","last_fullsized":"2024-05-07T11:12:45.050741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052758+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:12:45.052758+0000","last_peered":"2024-05-07T11:12:45.052758+0000","last_clean":"2024-05-07T11:12:45.052758+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:12:45.052758+0000","last_undegraded":"2024-05-07T11:12:45.052758+0000","last_fullsized":"2024-05-07T11:12:45.052758+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052643+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:12:45.052643+0000","last_peered":"2024-05-07T11:12:45.052643+0000","last_clean":"2024-05-07T11:12:45.052643+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:12:45.052643+0000","last_undegraded":"2024-05-07T11:12:45.052643+0000","last_fullsized":"2024-05-07T11:12:45.052643+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051464+0000","last_change":"2024-05-07T11:12:44.056491+0000","last_active":"2024-05-07T11:12:45.051464+0000","last_peered":"2024-05-07T11:12:45.051464+0000","last_clean":"2024-05-07T11:12:45.051464+0000","last_became_active":"2024-05-07T11:12:44.056196+0000","last_became_peered":"2024-05-07T11:12:44.056196+0000","last_unstale":"2024-05-07T11:12:45.051464+0000","last_undegraded":"2024-05-07T11:12:45.051464+0000","last_fullsized":"2024-05-07T11:12:45.051464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.043497+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:12:46.043497+0000","last_peered":"2024-05-07T11:12:46.043497+0000","last_clean":"2024-05-07T11:12:46.043497+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:12:46.043497+0000","last_undegraded":"2024-05-07T11:12:46.043497+0000","last_fullsized":"2024-05-07T11:12:46.043497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045228+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:12:46.045228+0000","last_peered":"2024-05-07T11:12:46.045228+0000","last_clean":"2024-05-07T11:12:46.045228+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:12:46.045228+0000","last_undegraded":"2024-05-07T11:12:46.045228+0000","last_fullsized":"2024-05-07T11:12:46.045228+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050439+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:12:45.050439+0000","last_peered":"2024-05-07T11:12:45.050439+0000","last_clean":"2024-05-07T11:12:45.050439+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:12:45.050439+0000","last_undegraded":"2024-05-07T11:12:45.050439+0000","last_fullsized":"2024-05-07T11:12:45.050439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045214+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:12:46.045214+0000","last_peered":"2024-05-07T11:12:46.045214+0000","last_clean":"2024-05-07T11:12:46.045214+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:12:46.045214+0000","last_undegraded":"2024-05-07T11:12:46.045214+0000","last_fullsized":"2024-05-07T11:12:46.045214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051515+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:12:45.051515+0000","last_peered":"2024-05-07T11:12:45.051515+0000","last_clean":"2024-05-07T11:12:45.051515+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:12:45.051515+0000","last_undegraded":"2024-05-07T11:12:45.051515+0000","last_fullsized":"2024-05-07T11:12:45.051515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051787+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:12:45.051787+0000","last_peered":"2024-05-07T11:12:45.051787+0000","last_clean":"2024-05-07T11:12:45.051787+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:12:45.051787+0000","last_undegraded":"2024-05-07T11:12:45.051787+0000","last_fullsized":"2024-05-07T11:12:45.051787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053163+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.052490+0000","last_became_peered":"2024-05-07T11:12:43.052490+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051421+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:12:45.051421+0000","last_peered":"2024-05-07T11:12:45.051421+0000","last_clean":"2024-05-07T11:12:45.051421+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:12:45.051421+0000","last_undegraded":"2024-05-07T11:12:45.051421+0000","last_fullsized":"2024-05-07T11:12:45.051421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052690+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:12:45.052690+0000","last_peered":"2024-05-07T11:12:45.052690+0000","last_clean":"2024-05-07T11:12:45.052690+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:12:45.052690+0000","last_undegraded":"2024-05-07T11:12:45.052690+0000","last_fullsized":"2024-05-07T11:12:45.052690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051438+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:12:45.051438+0000","last_peered":"2024-05-07T11:12:45.051438+0000","last_clean":"2024-05-07T11:12:45.051438+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:12:45.051438+0000","last_undegraded":"2024-05-07T11:12:45.051438+0000","last_fullsized":"2024-05-07T11:12:45.051438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051706+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:12:45.051706+0000","last_peered":"2024-05-07T11:12:45.051706+0000","last_clean":"2024-05-07T11:12:45.051706+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:12:45.051706+0000","last_undegraded":"2024-05-07T11:12:45.051706+0000","last_fullsized":"2024-05-07T11:12:45.051706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051696+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:12:45.051696+0000","last_peered":"2024-05-07T11:12:45.051696+0000","last_clean":"2024-05-07T11:12:45.051696+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:12:45.051696+0000","last_undegraded":"2024-05-07T11:12:45.051696+0000","last_fullsized":"2024-05-07T11:12:45.051696+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052275+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:12:45.052275+0000","last_peered":"2024-05-07T11:12:45.052275+0000","last_clean":"2024-05-07T11:12:45.052275+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:12:45.052275+0000","last_undegraded":"2024-05-07T11:12:45.052275+0000","last_fullsized":"2024-05-07T11:12:45.052275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051505+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:12:45.051505+0000","last_peered":"2024-05-07T11:12:45.051505+0000","last_clean":"2024-05-07T11:12:45.051505+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:12:45.051505+0000","last_undegraded":"2024-05-07T11:12:45.051505+0000","last_fullsized":"2024-05-07T11:12:45.051505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051445+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:12:45.051445+0000","last_peered":"2024-05-07T11:12:45.051445+0000","last_clean":"2024-05-07T11:12:45.051445+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:12:45.051445+0000","last_undegraded":"2024-05-07T11:12:45.051445+0000","last_fullsized":"2024-05-07T11:12:45.051445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050944+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:12:45.050944+0000","last_peered":"2024-05-07T11:12:45.050944+0000","last_clean":"2024-05-07T11:12:45.050944+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:12:45.050944+0000","last_undegraded":"2024-05-07T11:12:45.050944+0000","last_fullsized":"2024-05-07T11:12:45.050944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051008+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:12:45.051008+0000","last_peered":"2024-05-07T11:12:45.051008+0000","last_clean":"2024-05-07T11:12:45.051008+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:12:45.051008+0000","last_undegraded":"2024-05-07T11:12:45.051008+0000","last_fullsized":"2024-05-07T11:12:45.051008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051044+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:12:45.051044+0000","last_peered":"2024-05-07T11:12:45.051044+0000","last_clean":"2024-05-07T11:12:45.051044+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:12:45.051044+0000","last_undegraded":"2024-05-07T11:12:45.051044+0000","last_fullsized":"2024-05-07T11:12:45.051044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045230+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:12:46.045230+0000","last_peered":"2024-05-07T11:12:46.045230+0000","last_clean":"2024-05-07T11:12:46.045230+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:12:46.045230+0000","last_undegraded":"2024-05-07T11:12:46.045230+0000","last_fullsized":"2024-05-07T11:12:46.045230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045154+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:12:46.045154+0000","last_peered":"2024-05-07T11:12:46.045154+0000","last_clean":"2024-05-07T11:12:46.045154+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:12:46.045154+0000","last_undegraded":"2024-05-07T11:12:46.045154+0000","last_fullsized":"2024-05-07T11:12:46.045154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051665+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:12:45.051665+0000","last_peered":"2024-05-07T11:12:45.051665+0000","last_clean":"2024-05-07T11:12:45.051665+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:12:45.051665+0000","last_undegraded":"2024-05-07T11:12:45.051665+0000","last_fullsized":"2024-05-07T11:12:45.051665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051165+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:12:45.051165+0000","last_peered":"2024-05-07T11:12:45.051165+0000","last_clean":"2024-05-07T11:12:45.051165+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:12:45.051165+0000","last_undegraded":"2024-05-07T11:12:45.051165+0000","last_fullsized":"2024-05-07T11:12:45.051165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052504+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:12:45.052504+0000","last_peered":"2024-05-07T11:12:45.052504+0000","last_clean":"2024-05-07T11:12:45.052504+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:12:45.052504+0000","last_undegraded":"2024-05-07T11:12:45.052504+0000","last_fullsized":"2024-05-07T11:12:45.052504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044918+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:12:46.044918+0000","last_peered":"2024-05-07T11:12:46.044918+0000","last_clean":"2024-05-07T11:12:46.044918+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:12:46.044918+0000","last_undegraded":"2024-05-07T11:12:46.044918+0000","last_fullsized":"2024-05-07T11:12:46.044918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052615+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:12:45.052615+0000","last_peered":"2024-05-07T11:12:45.052615+0000","last_clean":"2024-05-07T11:12:45.052615+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:12:45.052615+0000","last_undegraded":"2024-05-07T11:12:45.052615+0000","last_fullsized":"2024-05-07T11:12:45.052615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":638861,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":638245,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:12:56.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:12:56.809 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:56.815 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:12:56.819 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-07T11:12:54.940226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81628,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033892,"statfs":{"total":289910292480,"available":289826705408,"internally_reserved":0,"allocated":573440,"data_stored":1323805,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002141"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051518+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:12:45.051518+0000","last_peered":"2024-05-07T11:12:45.051518+0000","last_clean":"2024-05-07T11:12:45.051518+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:12:45.051518+0000","last_undegraded":"2024-05-07T11:12:45.051518+0000","last_fullsized":"2024-05-07T11:12:45.051518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051016+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:12:45.051016+0000","last_peered":"2024-05-07T11:12:45.051016+0000","last_clean":"2024-05-07T11:12:45.051016+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:12:45.051016+0000","last_undegraded":"2024-05-07T11:12:45.051016+0000","last_fullsized":"2024-05-07T11:12:45.051016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044931+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:12:46.044931+0000","last_peered":"2024-05-07T11:12:46.044931+0000","last_clean":"2024-05-07T11:12:46.044931+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:12:46.044931+0000","last_undegraded":"2024-05-07T11:12:46.044931+0000","last_fullsized":"2024-05-07T11:12:46.044931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051123+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:12:45.051123+0000","last_peered":"2024-05-07T11:12:45.051123+0000","last_clean":"2024-05-07T11:12:45.051123+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:12:45.051123+0000","last_undegraded":"2024-05-07T11:12:45.051123+0000","last_fullsized":"2024-05-07T11:12:45.051123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044619+0000","last_change":"2024-05-07T11:12:44.054002+0000","last_active":"2024-05-07T11:12:46.044619+0000","last_peered":"2024-05-07T11:12:46.044619+0000","last_clean":"2024-05-07T11:12:46.044619+0000","last_became_active":"2024-05-07T11:12:44.053275+0000","last_became_peered":"2024-05-07T11:12:44.053275+0000","last_unstale":"2024-05-07T11:12:46.044619+0000","last_undegraded":"2024-05-07T11:12:46.044619+0000","last_fullsized":"2024-05-07T11:12:46.044619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044470+0000","last_change":"2024-05-07T11:12:44.053753+0000","last_active":"2024-05-07T11:12:46.044470+0000","last_peered":"2024-05-07T11:12:46.044470+0000","last_clean":"2024-05-07T11:12:46.044470+0000","last_became_active":"2024-05-07T11:12:44.052991+0000","last_became_peered":"2024-05-07T11:12:44.052991+0000","last_unstale":"2024-05-07T11:12:46.044470+0000","last_undegraded":"2024-05-07T11:12:46.044470+0000","last_fullsized":"2024-05-07T11:12:46.044470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044203+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:12:46.044203+0000","last_peered":"2024-05-07T11:12:46.044203+0000","last_clean":"2024-05-07T11:12:46.044203+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:12:46.044203+0000","last_undegraded":"2024-05-07T11:12:46.044203+0000","last_fullsized":"2024-05-07T11:12:46.044203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052288+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:12:45.052288+0000","last_peered":"2024-05-07T11:12:45.052288+0000","last_clean":"2024-05-07T11:12:45.052288+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:12:45.052288+0000","last_undegraded":"2024-05-07T11:12:45.052288+0000","last_fullsized":"2024-05-07T11:12:45.052288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051125+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:12:45.051125+0000","last_peered":"2024-05-07T11:12:45.051125+0000","last_clean":"2024-05-07T11:12:45.051125+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:12:45.051125+0000","last_undegraded":"2024-05-07T11:12:45.051125+0000","last_fullsized":"2024-05-07T11:12:45.051125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045295+0000","last_change":"2024-05-07T11:12:44.054308+0000","last_active":"2024-05-07T11:12:46.045295+0000","last_peered":"2024-05-07T11:12:46.045295+0000","last_clean":"2024-05-07T11:12:46.045295+0000","last_became_active":"2024-05-07T11:12:44.053809+0000","last_became_peered":"2024-05-07T11:12:44.053809+0000","last_unstale":"2024-05-07T11:12:46.045295+0000","last_undegraded":"2024-05-07T11:12:46.045295+0000","last_fullsized":"2024-05-07T11:12:46.045295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:22.261724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051159+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:12:45.051159+0000","last_peered":"2024-05-07T11:12:45.051159+0000","last_clean":"2024-05-07T11:12:45.051159+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:12:45.051159+0000","last_undegraded":"2024-05-07T11:12:45.051159+0000","last_fullsized":"2024-05-07T11:12:45.051159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050678+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:12:45.050678+0000","last_peered":"2024-05-07T11:12:45.050678+0000","last_clean":"2024-05-07T11:12:45.050678+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:12:45.050678+0000","last_undegraded":"2024-05-07T11:12:45.050678+0000","last_fullsized":"2024-05-07T11:12:45.050678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044673+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:12:46.044673+0000","last_peered":"2024-05-07T11:12:46.044673+0000","last_clean":"2024-05-07T11:12:46.044673+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:12:46.044673+0000","last_undegraded":"2024-05-07T11:12:46.044673+0000","last_fullsized":"2024-05-07T11:12:46.044673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044712+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:12:46.044712+0000","last_peered":"2024-05-07T11:12:46.044712+0000","last_clean":"2024-05-07T11:12:46.044712+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:12:46.044712+0000","last_undegraded":"2024-05-07T11:12:46.044712+0000","last_fullsized":"2024-05-07T11:12:46.044712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044199+0000","last_change":"2024-05-07T11:12:44.057719+0000","last_active":"2024-05-07T11:12:46.044199+0000","last_peered":"2024-05-07T11:12:46.044199+0000","last_clean":"2024-05-07T11:12:46.044199+0000","last_became_active":"2024-05-07T11:12:44.055208+0000","last_became_peered":"2024-05-07T11:12:44.055208+0000","last_unstale":"2024-05-07T11:12:46.044199+0000","last_undegraded":"2024-05-07T11:12:46.044199+0000","last_fullsized":"2024-05-07T11:12:46.044199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052775+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:12:45.052775+0000","last_peered":"2024-05-07T11:12:45.052775+0000","last_clean":"2024-05-07T11:12:45.052775+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:12:45.052775+0000","last_undegraded":"2024-05-07T11:12:45.052775+0000","last_fullsized":"2024-05-07T11:12:45.052775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051527+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:12:45.051527+0000","last_peered":"2024-05-07T11:12:45.051527+0000","last_clean":"2024-05-07T11:12:45.051527+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:12:45.051527+0000","last_undegraded":"2024-05-07T11:12:45.051527+0000","last_fullsized":"2024-05-07T11:12:45.051527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052169+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:12:45.052169+0000","last_peered":"2024-05-07T11:12:45.052169+0000","last_clean":"2024-05-07T11:12:45.052169+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:12:45.052169+0000","last_undegraded":"2024-05-07T11:12:45.052169+0000","last_fullsized":"2024-05-07T11:12:45.052169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045083+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:12:46.045083+0000","last_peered":"2024-05-07T11:12:46.045083+0000","last_clean":"2024-05-07T11:12:46.045083+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:12:46.045083+0000","last_undegraded":"2024-05-07T11:12:46.045083+0000","last_fullsized":"2024-05-07T11:12:46.045083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044990+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:12:46.044990+0000","last_peered":"2024-05-07T11:12:46.044990+0000","last_clean":"2024-05-07T11:12:46.044990+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:12:46.044990+0000","last_undegraded":"2024-05-07T11:12:46.044990+0000","last_fullsized":"2024-05-07T11:12:46.044990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050573+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:12:45.050573+0000","last_peered":"2024-05-07T11:12:45.050573+0000","last_clean":"2024-05-07T11:12:45.050573+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:12:45.050573+0000","last_undegraded":"2024-05-07T11:12:45.050573+0000","last_fullsized":"2024-05-07T11:12:45.050573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051210+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:12:45.051210+0000","last_peered":"2024-05-07T11:12:45.051210+0000","last_clean":"2024-05-07T11:12:45.051210+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:12:45.051210+0000","last_undegraded":"2024-05-07T11:12:45.051210+0000","last_fullsized":"2024-05-07T11:12:45.051210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050292+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:12:45.050292+0000","last_peered":"2024-05-07T11:12:45.050292+0000","last_clean":"2024-05-07T11:12:45.050292+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:12:45.050292+0000","last_undegraded":"2024-05-07T11:12:45.050292+0000","last_fullsized":"2024-05-07T11:12:45.050292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051631+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:12:45.051631+0000","last_peered":"2024-05-07T11:12:45.051631+0000","last_clean":"2024-05-07T11:12:45.051631+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:12:45.051631+0000","last_undegraded":"2024-05-07T11:12:45.051631+0000","last_fullsized":"2024-05-07T11:12:45.051631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052426+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:12:45.052426+0000","last_peered":"2024-05-07T11:12:45.052426+0000","last_clean":"2024-05-07T11:12:45.052426+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:12:45.052426+0000","last_undegraded":"2024-05-07T11:12:45.052426+0000","last_fullsized":"2024-05-07T11:12:45.052426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045205+0000","last_change":"2024-05-07T11:12:44.059023+0000","last_active":"2024-05-07T11:12:46.045205+0000","last_peered":"2024-05-07T11:12:46.045205+0000","last_clean":"2024-05-07T11:12:46.045205+0000","last_became_active":"2024-05-07T11:12:44.057224+0000","last_became_peered":"2024-05-07T11:12:44.057224+0000","last_unstale":"2024-05-07T11:12:46.045205+0000","last_undegraded":"2024-05-07T11:12:46.045205+0000","last_fullsized":"2024-05-07T11:12:46.045205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:42.813261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051596+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:12:45.051596+0000","last_peered":"2024-05-07T11:12:45.051596+0000","last_clean":"2024-05-07T11:12:45.051596+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:12:45.051596+0000","last_undegraded":"2024-05-07T11:12:45.051596+0000","last_fullsized":"2024-05-07T11:12:45.051596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051768+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:12:45.051768+0000","last_peered":"2024-05-07T11:12:45.051768+0000","last_clean":"2024-05-07T11:12:45.051768+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:12:45.051768+0000","last_undegraded":"2024-05-07T11:12:45.051768+0000","last_fullsized":"2024-05-07T11:12:45.051768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050877+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:12:45.050877+0000","last_peered":"2024-05-07T11:12:45.050877+0000","last_clean":"2024-05-07T11:12:45.050877+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:12:45.050877+0000","last_undegraded":"2024-05-07T11:12:45.050877+0000","last_fullsized":"2024-05-07T11:12:45.050877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051253+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:12:45.051253+0000","last_peered":"2024-05-07T11:12:45.051253+0000","last_clean":"2024-05-07T11:12:45.051253+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:12:45.051253+0000","last_undegraded":"2024-05-07T11:12:45.051253+0000","last_fullsized":"2024-05-07T11:12:45.051253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044454+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:12:46.044454+0000","last_peered":"2024-05-07T11:12:46.044454+0000","last_clean":"2024-05-07T11:12:46.044454+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:12:46.044454+0000","last_undegraded":"2024-05-07T11:12:46.044454+0000","last_fullsized":"2024-05-07T11:12:46.044454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051364+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:12:45.051364+0000","last_peered":"2024-05-07T11:12:45.051364+0000","last_clean":"2024-05-07T11:12:45.051364+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:12:45.051364+0000","last_undegraded":"2024-05-07T11:12:45.051364+0000","last_fullsized":"2024-05-07T11:12:45.051364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045693+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:12:46.045693+0000","last_peered":"2024-05-07T11:12:46.045693+0000","last_clean":"2024-05-07T11:12:46.045693+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:12:46.045693+0000","last_undegraded":"2024-05-07T11:12:46.045693+0000","last_fullsized":"2024-05-07T11:12:46.045693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051592+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:12:45.051592+0000","last_peered":"2024-05-07T11:12:45.051592+0000","last_clean":"2024-05-07T11:12:45.051592+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:12:45.051592+0000","last_undegraded":"2024-05-07T11:12:45.051592+0000","last_fullsized":"2024-05-07T11:12:45.051592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051735+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:12:45.051735+0000","last_peered":"2024-05-07T11:12:45.051735+0000","last_clean":"2024-05-07T11:12:45.051735+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:12:45.051735+0000","last_undegraded":"2024-05-07T11:12:45.051735+0000","last_fullsized":"2024-05-07T11:12:45.051735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052590+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:12:45.052590+0000","last_peered":"2024-05-07T11:12:45.052590+0000","last_clean":"2024-05-07T11:12:45.052590+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:12:45.052590+0000","last_undegraded":"2024-05-07T11:12:45.052590+0000","last_fullsized":"2024-05-07T11:12:45.052590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050501+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:12:45.050501+0000","last_peered":"2024-05-07T11:12:45.050501+0000","last_clean":"2024-05-07T11:12:45.050501+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:12:45.050501+0000","last_undegraded":"2024-05-07T11:12:45.050501+0000","last_fullsized":"2024-05-07T11:12:45.050501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052285+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:12:45.052285+0000","last_peered":"2024-05-07T11:12:45.052285+0000","last_clean":"2024-05-07T11:12:45.052285+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:12:45.052285+0000","last_undegraded":"2024-05-07T11:12:45.052285+0000","last_fullsized":"2024-05-07T11:12:45.052285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044458+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:12:46.044458+0000","last_peered":"2024-05-07T11:12:46.044458+0000","last_clean":"2024-05-07T11:12:46.044458+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:12:46.044458+0000","last_undegraded":"2024-05-07T11:12:46.044458+0000","last_fullsized":"2024-05-07T11:12:46.044458+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045265+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:12:46.045265+0000","last_peered":"2024-05-07T11:12:46.045265+0000","last_clean":"2024-05-07T11:12:46.045265+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:12:46.045265+0000","last_undegraded":"2024-05-07T11:12:46.045265+0000","last_fullsized":"2024-05-07T11:12:46.045265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051383+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:12:45.051383+0000","last_peered":"2024-05-07T11:12:45.051383+0000","last_clean":"2024-05-07T11:12:45.051383+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:12:45.051383+0000","last_undegraded":"2024-05-07T11:12:45.051383+0000","last_fullsized":"2024-05-07T11:12:45.051383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051540+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:12:45.051540+0000","last_peered":"2024-05-07T11:12:45.051540+0000","last_clean":"2024-05-07T11:12:45.051540+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:12:45.051540+0000","last_undegraded":"2024-05-07T11:12:45.051540+0000","last_fullsized":"2024-05-07T11:12:45.051540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050384+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:12:45.050384+0000","last_peered":"2024-05-07T11:12:45.050384+0000","last_clean":"2024-05-07T11:12:45.050384+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:12:45.050384+0000","last_undegraded":"2024-05-07T11:12:45.050384+0000","last_fullsized":"2024-05-07T11:12:45.050384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045798+0000","last_change":"2024-05-07T11:12:43.054017+0000","last_active":"2024-05-07T11:12:46.045798+0000","last_peered":"2024-05-07T11:12:46.045798+0000","last_clean":"2024-05-07T11:12:46.045798+0000","last_became_active":"2024-05-07T11:12:43.053655+0000","last_became_peered":"2024-05-07T11:12:43.053655+0000","last_unstale":"2024-05-07T11:12:46.045798+0000","last_undegraded":"2024-05-07T11:12:46.045798+0000","last_fullsized":"2024-05-07T11:12:46.045798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044896+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:12:46.044896+0000","last_peered":"2024-05-07T11:12:46.044896+0000","last_clean":"2024-05-07T11:12:46.044896+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:12:46.044896+0000","last_undegraded":"2024-05-07T11:12:46.044896+0000","last_fullsized":"2024-05-07T11:12:46.044896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045701+0000","last_change":"2024-05-07T11:12:43.053040+0000","last_active":"2024-05-07T11:12:46.045701+0000","last_peered":"2024-05-07T11:12:46.045701+0000","last_clean":"2024-05-07T11:12:46.045701+0000","last_became_active":"2024-05-07T11:12:43.052641+0000","last_became_peered":"2024-05-07T11:12:43.052641+0000","last_unstale":"2024-05-07T11:12:46.045701+0000","last_undegraded":"2024-05-07T11:12:46.045701+0000","last_fullsized":"2024-05-07T11:12:46.045701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:56:26.393747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051649+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:12:45.051649+0000","last_peered":"2024-05-07T11:12:45.051649+0000","last_clean":"2024-05-07T11:12:45.051649+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:12:45.051649+0000","last_undegraded":"2024-05-07T11:12:45.051649+0000","last_fullsized":"2024-05-07T11:12:45.051649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051857+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:12:45.051857+0000","last_peered":"2024-05-07T11:12:45.051857+0000","last_clean":"2024-05-07T11:12:45.051857+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:12:45.051857+0000","last_undegraded":"2024-05-07T11:12:45.051857+0000","last_fullsized":"2024-05-07T11:12:45.051857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045603+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:12:46.045603+0000","last_peered":"2024-05-07T11:12:46.045603+0000","last_clean":"2024-05-07T11:12:46.045603+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:12:46.045603+0000","last_undegraded":"2024-05-07T11:12:46.045603+0000","last_fullsized":"2024-05-07T11:12:46.045603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045503+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:12:46.045503+0000","last_peered":"2024-05-07T11:12:46.045503+0000","last_clean":"2024-05-07T11:12:46.045503+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:12:46.045503+0000","last_undegraded":"2024-05-07T11:12:46.045503+0000","last_fullsized":"2024-05-07T11:12:46.045503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045711+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:12:46.045711+0000","last_peered":"2024-05-07T11:12:46.045711+0000","last_clean":"2024-05-07T11:12:46.045711+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:12:46.045711+0000","last_undegraded":"2024-05-07T11:12:46.045711+0000","last_fullsized":"2024-05-07T11:12:46.045711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050653+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:12:45.050653+0000","last_peered":"2024-05-07T11:12:45.050653+0000","last_clean":"2024-05-07T11:12:45.050653+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:12:45.050653+0000","last_undegraded":"2024-05-07T11:12:45.050653+0000","last_fullsized":"2024-05-07T11:12:45.050653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044984+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:12:46.044984+0000","last_peered":"2024-05-07T11:12:46.044984+0000","last_clean":"2024-05-07T11:12:46.044984+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:12:46.044984+0000","last_undegraded":"2024-05-07T11:12:46.044984+0000","last_fullsized":"2024-05-07T11:12:46.044984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050493+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:12:45.050493+0000","last_peered":"2024-05-07T11:12:45.050493+0000","last_clean":"2024-05-07T11:12:45.050493+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:12:45.050493+0000","last_undegraded":"2024-05-07T11:12:45.050493+0000","last_fullsized":"2024-05-07T11:12:45.050493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052487+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:12:45.052487+0000","last_peered":"2024-05-07T11:12:45.052487+0000","last_clean":"2024-05-07T11:12:45.052487+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:12:45.052487+0000","last_undegraded":"2024-05-07T11:12:45.052487+0000","last_fullsized":"2024-05-07T11:12:45.052487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045027+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:12:46.045027+0000","last_peered":"2024-05-07T11:12:46.045027+0000","last_clean":"2024-05-07T11:12:46.045027+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:12:46.045027+0000","last_undegraded":"2024-05-07T11:12:46.045027+0000","last_fullsized":"2024-05-07T11:12:46.045027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045735+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:12:46.045735+0000","last_peered":"2024-05-07T11:12:46.045735+0000","last_clean":"2024-05-07T11:12:46.045735+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:12:46.045735+0000","last_undegraded":"2024-05-07T11:12:46.045735+0000","last_fullsized":"2024-05-07T11:12:46.045735+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051913+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:12:45.051913+0000","last_peered":"2024-05-07T11:12:45.051913+0000","last_clean":"2024-05-07T11:12:45.051913+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:12:45.051913+0000","last_undegraded":"2024-05-07T11:12:45.051913+0000","last_fullsized":"2024-05-07T11:12:45.051913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045790+0000","last_change":"2024-05-07T11:12:44.059544+0000","last_active":"2024-05-07T11:12:46.045790+0000","last_peered":"2024-05-07T11:12:46.045790+0000","last_clean":"2024-05-07T11:12:46.045790+0000","last_became_active":"2024-05-07T11:12:44.058884+0000","last_became_peered":"2024-05-07T11:12:44.058884+0000","last_unstale":"2024-05-07T11:12:46.045790+0000","last_undegraded":"2024-05-07T11:12:46.045790+0000","last_fullsized":"2024-05-07T11:12:46.045790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:46:22.416221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044746+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:12:46.044746+0000","last_peered":"2024-05-07T11:12:46.044746+0000","last_clean":"2024-05-07T11:12:46.044746+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:12:46.044746+0000","last_undegraded":"2024-05-07T11:12:46.044746+0000","last_fullsized":"2024-05-07T11:12:46.044746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051566+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:12:45.051566+0000","last_peered":"2024-05-07T11:12:45.051566+0000","last_clean":"2024-05-07T11:12:45.051566+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:12:45.051566+0000","last_undegraded":"2024-05-07T11:12:45.051566+0000","last_fullsized":"2024-05-07T11:12:45.051566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051280+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:12:45.051280+0000","last_peered":"2024-05-07T11:12:45.051280+0000","last_clean":"2024-05-07T11:12:45.051280+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:12:45.051280+0000","last_undegraded":"2024-05-07T11:12:45.051280+0000","last_fullsized":"2024-05-07T11:12:45.051280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051628+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:12:45.051628+0000","last_peered":"2024-05-07T11:12:45.051628+0000","last_clean":"2024-05-07T11:12:45.051628+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:12:45.051628+0000","last_undegraded":"2024-05-07T11:12:45.051628+0000","last_fullsized":"2024-05-07T11:12:45.051628+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050743+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:12:45.050743+0000","last_peered":"2024-05-07T11:12:45.050743+0000","last_clean":"2024-05-07T11:12:45.050743+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:12:45.050743+0000","last_undegraded":"2024-05-07T11:12:45.050743+0000","last_fullsized":"2024-05-07T11:12:45.050743+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052485+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:12:45.052485+0000","last_peered":"2024-05-07T11:12:45.052485+0000","last_clean":"2024-05-07T11:12:45.052485+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:12:45.052485+0000","last_undegraded":"2024-05-07T11:12:45.052485+0000","last_fullsized":"2024-05-07T11:12:45.052485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045587+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:12:46.045587+0000","last_peered":"2024-05-07T11:12:46.045587+0000","last_clean":"2024-05-07T11:12:46.045587+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:12:46.045587+0000","last_undegraded":"2024-05-07T11:12:46.045587+0000","last_fullsized":"2024-05-07T11:12:46.045587+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045708+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:12:46.045708+0000","last_peered":"2024-05-07T11:12:46.045708+0000","last_clean":"2024-05-07T11:12:46.045708+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:12:46.045708+0000","last_undegraded":"2024-05-07T11:12:46.045708+0000","last_fullsized":"2024-05-07T11:12:46.045708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052318+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:12:45.052318+0000","last_peered":"2024-05-07T11:12:45.052318+0000","last_clean":"2024-05-07T11:12:45.052318+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:12:45.052318+0000","last_undegraded":"2024-05-07T11:12:45.052318+0000","last_fullsized":"2024-05-07T11:12:45.052318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045850+0000","last_change":"2024-05-07T11:12:43.053188+0000","last_active":"2024-05-07T11:12:46.045850+0000","last_peered":"2024-05-07T11:12:46.045850+0000","last_clean":"2024-05-07T11:12:46.045850+0000","last_became_active":"2024-05-07T11:12:43.052570+0000","last_became_peered":"2024-05-07T11:12:43.052570+0000","last_unstale":"2024-05-07T11:12:46.045850+0000","last_undegraded":"2024-05-07T11:12:46.045850+0000","last_fullsized":"2024-05-07T11:12:46.045850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052376+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:12:45.052376+0000","last_peered":"2024-05-07T11:12:45.052376+0000","last_clean":"2024-05-07T11:12:45.052376+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:12:45.052376+0000","last_undegraded":"2024-05-07T11:12:45.052376+0000","last_fullsized":"2024-05-07T11:12:45.052376+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050802+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:12:45.050802+0000","last_peered":"2024-05-07T11:12:45.050802+0000","last_clean":"2024-05-07T11:12:45.050802+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:12:45.050802+0000","last_undegraded":"2024-05-07T11:12:45.050802+0000","last_fullsized":"2024-05-07T11:12:45.050802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052342+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:12:45.052342+0000","last_peered":"2024-05-07T11:12:45.052342+0000","last_clean":"2024-05-07T11:12:45.052342+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:12:45.052342+0000","last_undegraded":"2024-05-07T11:12:45.052342+0000","last_fullsized":"2024-05-07T11:12:45.052342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051790+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:12:45.051790+0000","last_peered":"2024-05-07T11:12:45.051790+0000","last_clean":"2024-05-07T11:12:45.051790+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:12:45.051790+0000","last_undegraded":"2024-05-07T11:12:45.051790+0000","last_fullsized":"2024-05-07T11:12:45.051790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050741+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:12:45.050741+0000","last_peered":"2024-05-07T11:12:45.050741+0000","last_clean":"2024-05-07T11:12:45.050741+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:12:45.050741+0000","last_undegraded":"2024-05-07T11:12:45.050741+0000","last_fullsized":"2024-05-07T11:12:45.050741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052758+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:12:45.052758+0000","last_peered":"2024-05-07T11:12:45.052758+0000","last_clean":"2024-05-07T11:12:45.052758+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:12:45.052758+0000","last_undegraded":"2024-05-07T11:12:45.052758+0000","last_fullsized":"2024-05-07T11:12:45.052758+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052643+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:12:45.052643+0000","last_peered":"2024-05-07T11:12:45.052643+0000","last_clean":"2024-05-07T11:12:45.052643+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:12:45.052643+0000","last_undegraded":"2024-05-07T11:12:45.052643+0000","last_fullsized":"2024-05-07T11:12:45.052643+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051464+0000","last_change":"2024-05-07T11:12:44.056491+0000","last_active":"2024-05-07T11:12:45.051464+0000","last_peered":"2024-05-07T11:12:45.051464+0000","last_clean":"2024-05-07T11:12:45.051464+0000","last_became_active":"2024-05-07T11:12:44.056196+0000","last_became_peered":"2024-05-07T11:12:44.056196+0000","last_unstale":"2024-05-07T11:12:45.051464+0000","last_undegraded":"2024-05-07T11:12:45.051464+0000","last_fullsized":"2024-05-07T11:12:45.051464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.043497+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:12:46.043497+0000","last_peered":"2024-05-07T11:12:46.043497+0000","last_clean":"2024-05-07T11:12:46.043497+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:12:46.043497+0000","last_undegraded":"2024-05-07T11:12:46.043497+0000","last_fullsized":"2024-05-07T11:12:46.043497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045228+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:12:46.045228+0000","last_peered":"2024-05-07T11:12:46.045228+0000","last_clean":"2024-05-07T11:12:46.045228+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:12:46.045228+0000","last_undegraded":"2024-05-07T11:12:46.045228+0000","last_fullsized":"2024-05-07T11:12:46.045228+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050439+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:12:45.050439+0000","last_peered":"2024-05-07T11:12:45.050439+0000","last_clean":"2024-05-07T11:12:45.050439+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:12:45.050439+0000","last_undegraded":"2024-05-07T11:12:45.050439+0000","last_fullsized":"2024-05-07T11:12:45.050439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045214+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:12:46.045214+0000","last_peered":"2024-05-07T11:12:46.045214+0000","last_clean":"2024-05-07T11:12:46.045214+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:12:46.045214+0000","last_undegraded":"2024-05-07T11:12:46.045214+0000","last_fullsized":"2024-05-07T11:12:46.045214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051515+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:12:45.051515+0000","last_peered":"2024-05-07T11:12:45.051515+0000","last_clean":"2024-05-07T11:12:45.051515+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:12:45.051515+0000","last_undegraded":"2024-05-07T11:12:45.051515+0000","last_fullsized":"2024-05-07T11:12:45.051515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051787+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:12:45.051787+0000","last_peered":"2024-05-07T11:12:45.051787+0000","last_clean":"2024-05-07T11:12:45.051787+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:12:45.051787+0000","last_undegraded":"2024-05-07T11:12:45.051787+0000","last_fullsized":"2024-05-07T11:12:45.051787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053163+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.052490+0000","last_became_peered":"2024-05-07T11:12:43.052490+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051421+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:12:45.051421+0000","last_peered":"2024-05-07T11:12:45.051421+0000","last_clean":"2024-05-07T11:12:45.051421+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:12:45.051421+0000","last_undegraded":"2024-05-07T11:12:45.051421+0000","last_fullsized":"2024-05-07T11:12:45.051421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052690+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:12:45.052690+0000","last_peered":"2024-05-07T11:12:45.052690+0000","last_clean":"2024-05-07T11:12:45.052690+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:12:45.052690+0000","last_undegraded":"2024-05-07T11:12:45.052690+0000","last_fullsized":"2024-05-07T11:12:45.052690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051438+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:12:45.051438+0000","last_peered":"2024-05-07T11:12:45.051438+0000","last_clean":"2024-05-07T11:12:45.051438+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:12:45.051438+0000","last_undegraded":"2024-05-07T11:12:45.051438+0000","last_fullsized":"2024-05-07T11:12:45.051438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051706+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:12:45.051706+0000","last_peered":"2024-05-07T11:12:45.051706+0000","last_clean":"2024-05-07T11:12:45.051706+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:12:45.051706+0000","last_undegraded":"2024-05-07T11:12:45.051706+0000","last_fullsized":"2024-05-07T11:12:45.051706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051696+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:12:45.051696+0000","last_peered":"2024-05-07T11:12:45.051696+0000","last_clean":"2024-05-07T11:12:45.051696+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:12:45.051696+0000","last_undegraded":"2024-05-07T11:12:45.051696+0000","last_fullsized":"2024-05-07T11:12:45.051696+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052275+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:12:45.052275+0000","last_peered":"2024-05-07T11:12:45.052275+0000","last_clean":"2024-05-07T11:12:45.052275+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:12:45.052275+0000","last_undegraded":"2024-05-07T11:12:45.052275+0000","last_fullsized":"2024-05-07T11:12:45.052275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051505+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:12:45.051505+0000","last_peered":"2024-05-07T11:12:45.051505+0000","last_clean":"2024-05-07T11:12:45.051505+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:12:45.051505+0000","last_undegraded":"2024-05-07T11:12:45.051505+0000","last_fullsized":"2024-05-07T11:12:45.051505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051445+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:12:45.051445+0000","last_peered":"2024-05-07T11:12:45.051445+0000","last_clean":"2024-05-07T11:12:45.051445+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:12:45.051445+0000","last_undegraded":"2024-05-07T11:12:45.051445+0000","last_fullsized":"2024-05-07T11:12:45.051445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050944+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:12:45.050944+0000","last_peered":"2024-05-07T11:12:45.050944+0000","last_clean":"2024-05-07T11:12:45.050944+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:12:45.050944+0000","last_undegraded":"2024-05-07T11:12:45.050944+0000","last_fullsized":"2024-05-07T11:12:45.050944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051008+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:12:45.051008+0000","last_peered":"2024-05-07T11:12:45.051008+0000","last_clean":"2024-05-07T11:12:45.051008+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:12:45.051008+0000","last_undegraded":"2024-05-07T11:12:45.051008+0000","last_fullsized":"2024-05-07T11:12:45.051008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051044+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:12:45.051044+0000","last_peered":"2024-05-07T11:12:45.051044+0000","last_clean":"2024-05-07T11:12:45.051044+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:12:45.051044+0000","last_undegraded":"2024-05-07T11:12:45.051044+0000","last_fullsized":"2024-05-07T11:12:45.051044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045230+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:12:46.045230+0000","last_peered":"2024-05-07T11:12:46.045230+0000","last_clean":"2024-05-07T11:12:46.045230+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:12:46.045230+0000","last_undegraded":"2024-05-07T11:12:46.045230+0000","last_fullsized":"2024-05-07T11:12:46.045230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045154+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:12:46.045154+0000","last_peered":"2024-05-07T11:12:46.045154+0000","last_clean":"2024-05-07T11:12:46.045154+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:12:46.045154+0000","last_undegraded":"2024-05-07T11:12:46.045154+0000","last_fullsized":"2024-05-07T11:12:46.045154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051665+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:12:45.051665+0000","last_peered":"2024-05-07T11:12:45.051665+0000","last_clean":"2024-05-07T11:12:45.051665+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:12:45.051665+0000","last_undegraded":"2024-05-07T11:12:45.051665+0000","last_fullsized":"2024-05-07T11:12:45.051665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051165+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:12:45.051165+0000","last_peered":"2024-05-07T11:12:45.051165+0000","last_clean":"2024-05-07T11:12:45.051165+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:12:45.051165+0000","last_undegraded":"2024-05-07T11:12:45.051165+0000","last_fullsized":"2024-05-07T11:12:45.051165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052504+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:12:45.052504+0000","last_peered":"2024-05-07T11:12:45.052504+0000","last_clean":"2024-05-07T11:12:45.052504+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:12:45.052504+0000","last_undegraded":"2024-05-07T11:12:45.052504+0000","last_fullsized":"2024-05-07T11:12:45.052504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044918+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:12:46.044918+0000","last_peered":"2024-05-07T11:12:46.044918+0000","last_clean":"2024-05-07T11:12:46.044918+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:12:46.044918+0000","last_undegraded":"2024-05-07T11:12:46.044918+0000","last_fullsized":"2024-05-07T11:12:46.044918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052615+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:12:45.052615+0000","last_peered":"2024-05-07T11:12:45.052615+0000","last_clean":"2024-05-07T11:12:45.052615+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:12:45.052615+0000","last_undegraded":"2024-05-07T11:12:45.052615+0000","last_fullsized":"2024-05-07T11:12:45.052615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":638861,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":638245,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:12:56.824 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-07T11:12:56.824 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-07T11:12:56.824 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-07T11:12:56.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-07T11:12:57.199 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:57.199 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-07T11:12:57.211 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-07T11:12:57.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:57.508 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:57.508 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":15,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:45.043439+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:57.521 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-07T11:12:41.627365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-05-07T11:12:42.384664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-07T11:12:57.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-07T11:12:57.822 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-05-07T11:12:57.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-05-07T11:12:58.138 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2024-05-07T11:12:58.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-07T11:12:58.451 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2024-05-07T11:12:58.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-07T11:12:58.760 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2024-05-07T11:12:58.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-07T11:12:59.114 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:59.114 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-07T11:12:43.398023+0000","modified":"2024-05-07T11:12:45.405916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6803/1691847174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1691847174},{"type":"v1","addr":"172.21.15.62:6803","nonce":1691847174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4190,"qdb_cluster":[4190]},"id":1}]} 2024-05-07T11:12:59.114 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2024-05-07T11:12:59.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:12:59.425 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:12:59.425 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":15,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:45.043439+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:12:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-07T11:12:41.627365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-05-07T11:12:42.384664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-07T11:12:59.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-07T11:12:59.739 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-05-07T11:12:59.752 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-05-07T11:13:00.053 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2024-05-07T11:13:00.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-07T11:13:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2024-05-07T11:13:00.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-07T11:13:00.680 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2024-05-07T11:13:00.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-07T11:13:01.028 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-07T11:12:43.398023+0000","modified":"2024-05-07T11:12:45.405916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6803/1691847174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1691847174},{"type":"v1","addr":"172.21.15.62:6803","nonce":1691847174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4190,"qdb_cluster":[4190]},"id":1}]} 2024-05-07T11:13:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2024-05-07T11:13:01.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:13:01.345 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:01.345 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":15,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:12:45.043439+0000","last_up_change":"2024-05-07T11:12:36.689723+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:13:01.358 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-07T11:13:01.699 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:01.700 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-07T11:12:43.398023+0000","modified":"2024-05-07T11:12:45.405916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6803/1691847174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1691847174},{"type":"v1","addr":"172.21.15.62:6803","nonce":1691847174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4190,"qdb_cluster":[4190]},"id":1}]} 2024-05-07T11:13:01.700 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2024-05-07T11:13:01.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-07T11:12:43.398023+0000', 'modified': '2024-05-07T11:12:45.405916+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6803/1691847174', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6802', 'nonce': 1691847174}, {'type': 'v1', 'addr': '172.21.15.62:6803', 'nonce': 1691847174}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4190, 'qdb_cluster': [4190]} 2024-05-07T11:13:01.814 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-07T11:13:01.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-07T11:13:01.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:01.930+0000 7f172ffff640 0 client.4686 ms_handle_reset on v2:172.21.15.62:6802/1691847174 2024-05-07T11:13:01.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:01.953+0000 7f172ffff640 0 client.4692 ms_handle_reset on v2:172.21.15.62:6802/1691847174 2024-05-07T11:13:01.954 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:13:01.955 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "712a8431-2ac1-4386-a81f-c899bab82549", 2024-05-07T11:13:01.955 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2024-05-07T11:13:01.955 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4190, 2024-05-07T11:13:01.955 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2024-05-07T11:13:01.955 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2024-05-07T11:13:01.955 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2024-05-07T11:13:01.956 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 17.916134775, 2024-05-07T11:13:01.956 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 5, 2024-05-07T11:13:01.956 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 15, 2024-05-07T11:13:01.956 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 15, 2024-05-07T11:13:01.956 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 23.143259827000001 2024-05-07T11:13:01.957 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:13:01.966 INFO:teuthology.run_tasks:Running task thrashosds... 2024-05-07T11:13:01.985 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-05-07T11:13:01.985 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b05eb2754514c6559f7c34d831877d418ea3a9c7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '510b35d4b766757579df5fd9efd2f892309f09e1'}} 2024-05-07T11:13:01.985 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-05-07T11:13:01.985 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-05-07T11:13:01.986 DEBUG:teuthology.orchestra.run.smithi062:> sync 2024-05-07T11:13:02.110 DEBUG:teuthology.orchestra.run.smithi088:> sync 2024-05-07T11:13:02.210 DEBUG:teuthology.orchestra.run.smithi149:> sync 2024-05-07T11:13:02.533 DEBUG:teuthology.orchestra.run.smithi175:> sync 2024-05-07T11:13:02.657 DEBUG:tasks.thrashosds:checking console status of smithi062 2024-05-07T11:13:02.658 DEBUG:teuthology.orchestra.console.smithi062:Waiting for login prompt 2024-05-07T11:13:02.658 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi062 2024-05-07T11:13:02.789 DEBUG:teuthology.orchestra.console.smithi062:expect before: [Enter `^Ec?' for help] 2024-05-07T11:13:02.790 DEBUG:teuthology.orchestra.console.smithi062:expect after: smithi062 login: 2024-05-07T11:13:02.842 DEBUG:teuthology.orchestra.console.smithi062:console disconnect output: [Enter `^Ec?' for help] smithi062 login: [disconnect] 2024-05-07T11:13:02.943 DEBUG:tasks.thrashosds:checking console status of smithi088 2024-05-07T11:13:02.943 DEBUG:teuthology.orchestra.console.smithi088:Waiting for login prompt 2024-05-07T11:13:02.943 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi088 2024-05-07T11:13:03.115 DEBUG:teuthology.orchestra.console.smithi088:expect before: [Enter `^Ec?' for help] 2024-05-07T11:13:03.115 DEBUG:teuthology.orchestra.console.smithi088:expect after: smithi088 login: 2024-05-07T11:13:03.167 DEBUG:teuthology.orchestra.console.smithi088:console disconnect output: [Enter `^Ec?' for help] smithi088 login: [disconnect] 2024-05-07T11:13:03.269 DEBUG:tasks.thrashosds:checking console status of smithi149 2024-05-07T11:13:03.269 DEBUG:teuthology.orchestra.console.smithi149:Waiting for login prompt 2024-05-07T11:13:03.269 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi149 2024-05-07T11:13:03.433 DEBUG:teuthology.orchestra.console.smithi149:expect before: [Enter `^Ec?' for help] 2024-05-07T11:13:03.433 DEBUG:teuthology.orchestra.console.smithi149:expect after: smithi149 login: 2024-05-07T11:13:03.486 DEBUG:teuthology.orchestra.console.smithi149:console disconnect output: [Enter `^Ec?' for help] smithi149 login: [disconnect] 2024-05-07T11:13:03.589 DEBUG:tasks.thrashosds:checking console status of smithi175 2024-05-07T11:13:03.590 DEBUG:teuthology.orchestra.console.smithi175:Waiting for login prompt 2024-05-07T11:13:03.590 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi175 2024-05-07T11:13:03.695 DEBUG:teuthology.orchestra.console.smithi175:expect before: [Enter `^Ec?' for help] 2024-05-07T11:13:03.696 DEBUG:teuthology.orchestra.console.smithi175:expect after: smithi175 login: 2024-05-07T11:13:03.750 DEBUG:teuthology.orchestra.console.smithi175:console disconnect output: [Enter `^Ec?' for help] smithi175 login: [disconnect] 2024-05-07T11:13:03.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-05-07T11:13:04.182 INFO:tasks.thrashosds:Beginning thrashosds... 2024-05-07T11:13:04.182 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-07T11:13:04.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:13:04.488 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:04.490 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:13:04.499 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-05-07T11:13:02.941734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81628,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033892,"statfs":{"total":289910292480,"available":289826705408,"internally_reserved":0,"allocated":573440,"data_stored":1323805,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002498"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051518+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:12:45.051518+0000","last_peered":"2024-05-07T11:12:45.051518+0000","last_clean":"2024-05-07T11:12:45.051518+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:12:45.051518+0000","last_undegraded":"2024-05-07T11:12:45.051518+0000","last_fullsized":"2024-05-07T11:12:45.051518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051016+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:12:45.051016+0000","last_peered":"2024-05-07T11:12:45.051016+0000","last_clean":"2024-05-07T11:12:45.051016+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:12:45.051016+0000","last_undegraded":"2024-05-07T11:12:45.051016+0000","last_fullsized":"2024-05-07T11:12:45.051016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044931+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:12:46.044931+0000","last_peered":"2024-05-07T11:12:46.044931+0000","last_clean":"2024-05-07T11:12:46.044931+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:12:46.044931+0000","last_undegraded":"2024-05-07T11:12:46.044931+0000","last_fullsized":"2024-05-07T11:12:46.044931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051123+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:12:45.051123+0000","last_peered":"2024-05-07T11:12:45.051123+0000","last_clean":"2024-05-07T11:12:45.051123+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:12:45.051123+0000","last_undegraded":"2024-05-07T11:12:45.051123+0000","last_fullsized":"2024-05-07T11:12:45.051123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044619+0000","last_change":"2024-05-07T11:12:44.054002+0000","last_active":"2024-05-07T11:12:46.044619+0000","last_peered":"2024-05-07T11:12:46.044619+0000","last_clean":"2024-05-07T11:12:46.044619+0000","last_became_active":"2024-05-07T11:12:44.053275+0000","last_became_peered":"2024-05-07T11:12:44.053275+0000","last_unstale":"2024-05-07T11:12:46.044619+0000","last_undegraded":"2024-05-07T11:12:46.044619+0000","last_fullsized":"2024-05-07T11:12:46.044619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044470+0000","last_change":"2024-05-07T11:12:44.053753+0000","last_active":"2024-05-07T11:12:46.044470+0000","last_peered":"2024-05-07T11:12:46.044470+0000","last_clean":"2024-05-07T11:12:46.044470+0000","last_became_active":"2024-05-07T11:12:44.052991+0000","last_became_peered":"2024-05-07T11:12:44.052991+0000","last_unstale":"2024-05-07T11:12:46.044470+0000","last_undegraded":"2024-05-07T11:12:46.044470+0000","last_fullsized":"2024-05-07T11:12:46.044470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044203+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:12:46.044203+0000","last_peered":"2024-05-07T11:12:46.044203+0000","last_clean":"2024-05-07T11:12:46.044203+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:12:46.044203+0000","last_undegraded":"2024-05-07T11:12:46.044203+0000","last_fullsized":"2024-05-07T11:12:46.044203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052288+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:12:45.052288+0000","last_peered":"2024-05-07T11:12:45.052288+0000","last_clean":"2024-05-07T11:12:45.052288+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:12:45.052288+0000","last_undegraded":"2024-05-07T11:12:45.052288+0000","last_fullsized":"2024-05-07T11:12:45.052288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051125+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:12:45.051125+0000","last_peered":"2024-05-07T11:12:45.051125+0000","last_clean":"2024-05-07T11:12:45.051125+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:12:45.051125+0000","last_undegraded":"2024-05-07T11:12:45.051125+0000","last_fullsized":"2024-05-07T11:12:45.051125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045295+0000","last_change":"2024-05-07T11:12:44.054308+0000","last_active":"2024-05-07T11:12:46.045295+0000","last_peered":"2024-05-07T11:12:46.045295+0000","last_clean":"2024-05-07T11:12:46.045295+0000","last_became_active":"2024-05-07T11:12:44.053809+0000","last_became_peered":"2024-05-07T11:12:44.053809+0000","last_unstale":"2024-05-07T11:12:46.045295+0000","last_undegraded":"2024-05-07T11:12:46.045295+0000","last_fullsized":"2024-05-07T11:12:46.045295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:22.261724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051159+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:12:45.051159+0000","last_peered":"2024-05-07T11:12:45.051159+0000","last_clean":"2024-05-07T11:12:45.051159+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:12:45.051159+0000","last_undegraded":"2024-05-07T11:12:45.051159+0000","last_fullsized":"2024-05-07T11:12:45.051159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050678+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:12:45.050678+0000","last_peered":"2024-05-07T11:12:45.050678+0000","last_clean":"2024-05-07T11:12:45.050678+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:12:45.050678+0000","last_undegraded":"2024-05-07T11:12:45.050678+0000","last_fullsized":"2024-05-07T11:12:45.050678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044673+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:12:46.044673+0000","last_peered":"2024-05-07T11:12:46.044673+0000","last_clean":"2024-05-07T11:12:46.044673+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:12:46.044673+0000","last_undegraded":"2024-05-07T11:12:46.044673+0000","last_fullsized":"2024-05-07T11:12:46.044673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044712+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:12:46.044712+0000","last_peered":"2024-05-07T11:12:46.044712+0000","last_clean":"2024-05-07T11:12:46.044712+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:12:46.044712+0000","last_undegraded":"2024-05-07T11:12:46.044712+0000","last_fullsized":"2024-05-07T11:12:46.044712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044199+0000","last_change":"2024-05-07T11:12:44.057719+0000","last_active":"2024-05-07T11:12:46.044199+0000","last_peered":"2024-05-07T11:12:46.044199+0000","last_clean":"2024-05-07T11:12:46.044199+0000","last_became_active":"2024-05-07T11:12:44.055208+0000","last_became_peered":"2024-05-07T11:12:44.055208+0000","last_unstale":"2024-05-07T11:12:46.044199+0000","last_undegraded":"2024-05-07T11:12:46.044199+0000","last_fullsized":"2024-05-07T11:12:46.044199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052775+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:12:45.052775+0000","last_peered":"2024-05-07T11:12:45.052775+0000","last_clean":"2024-05-07T11:12:45.052775+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:12:45.052775+0000","last_undegraded":"2024-05-07T11:12:45.052775+0000","last_fullsized":"2024-05-07T11:12:45.052775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051527+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:12:45.051527+0000","last_peered":"2024-05-07T11:12:45.051527+0000","last_clean":"2024-05-07T11:12:45.051527+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:12:45.051527+0000","last_undegraded":"2024-05-07T11:12:45.051527+0000","last_fullsized":"2024-05-07T11:12:45.051527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052169+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:12:45.052169+0000","last_peered":"2024-05-07T11:12:45.052169+0000","last_clean":"2024-05-07T11:12:45.052169+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:12:45.052169+0000","last_undegraded":"2024-05-07T11:12:45.052169+0000","last_fullsized":"2024-05-07T11:12:45.052169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045083+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:12:46.045083+0000","last_peered":"2024-05-07T11:12:46.045083+0000","last_clean":"2024-05-07T11:12:46.045083+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:12:46.045083+0000","last_undegraded":"2024-05-07T11:12:46.045083+0000","last_fullsized":"2024-05-07T11:12:46.045083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044990+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:12:46.044990+0000","last_peered":"2024-05-07T11:12:46.044990+0000","last_clean":"2024-05-07T11:12:46.044990+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:12:46.044990+0000","last_undegraded":"2024-05-07T11:12:46.044990+0000","last_fullsized":"2024-05-07T11:12:46.044990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050573+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:12:45.050573+0000","last_peered":"2024-05-07T11:12:45.050573+0000","last_clean":"2024-05-07T11:12:45.050573+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:12:45.050573+0000","last_undegraded":"2024-05-07T11:12:45.050573+0000","last_fullsized":"2024-05-07T11:12:45.050573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051210+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:12:45.051210+0000","last_peered":"2024-05-07T11:12:45.051210+0000","last_clean":"2024-05-07T11:12:45.051210+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:12:45.051210+0000","last_undegraded":"2024-05-07T11:12:45.051210+0000","last_fullsized":"2024-05-07T11:12:45.051210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050292+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:12:45.050292+0000","last_peered":"2024-05-07T11:12:45.050292+0000","last_clean":"2024-05-07T11:12:45.050292+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:12:45.050292+0000","last_undegraded":"2024-05-07T11:12:45.050292+0000","last_fullsized":"2024-05-07T11:12:45.050292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051631+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:12:45.051631+0000","last_peered":"2024-05-07T11:12:45.051631+0000","last_clean":"2024-05-07T11:12:45.051631+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:12:45.051631+0000","last_undegraded":"2024-05-07T11:12:45.051631+0000","last_fullsized":"2024-05-07T11:12:45.051631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052426+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:12:45.052426+0000","last_peered":"2024-05-07T11:12:45.052426+0000","last_clean":"2024-05-07T11:12:45.052426+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:12:45.052426+0000","last_undegraded":"2024-05-07T11:12:45.052426+0000","last_fullsized":"2024-05-07T11:12:45.052426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045205+0000","last_change":"2024-05-07T11:12:44.059023+0000","last_active":"2024-05-07T11:12:46.045205+0000","last_peered":"2024-05-07T11:12:46.045205+0000","last_clean":"2024-05-07T11:12:46.045205+0000","last_became_active":"2024-05-07T11:12:44.057224+0000","last_became_peered":"2024-05-07T11:12:44.057224+0000","last_unstale":"2024-05-07T11:12:46.045205+0000","last_undegraded":"2024-05-07T11:12:46.045205+0000","last_fullsized":"2024-05-07T11:12:46.045205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:42.813261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051596+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:12:45.051596+0000","last_peered":"2024-05-07T11:12:45.051596+0000","last_clean":"2024-05-07T11:12:45.051596+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:12:45.051596+0000","last_undegraded":"2024-05-07T11:12:45.051596+0000","last_fullsized":"2024-05-07T11:12:45.051596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051768+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:12:45.051768+0000","last_peered":"2024-05-07T11:12:45.051768+0000","last_clean":"2024-05-07T11:12:45.051768+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:12:45.051768+0000","last_undegraded":"2024-05-07T11:12:45.051768+0000","last_fullsized":"2024-05-07T11:12:45.051768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050877+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:12:45.050877+0000","last_peered":"2024-05-07T11:12:45.050877+0000","last_clean":"2024-05-07T11:12:45.050877+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:12:45.050877+0000","last_undegraded":"2024-05-07T11:12:45.050877+0000","last_fullsized":"2024-05-07T11:12:45.050877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051253+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:12:45.051253+0000","last_peered":"2024-05-07T11:12:45.051253+0000","last_clean":"2024-05-07T11:12:45.051253+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:12:45.051253+0000","last_undegraded":"2024-05-07T11:12:45.051253+0000","last_fullsized":"2024-05-07T11:12:45.051253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044454+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:12:46.044454+0000","last_peered":"2024-05-07T11:12:46.044454+0000","last_clean":"2024-05-07T11:12:46.044454+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:12:46.044454+0000","last_undegraded":"2024-05-07T11:12:46.044454+0000","last_fullsized":"2024-05-07T11:12:46.044454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051364+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:12:45.051364+0000","last_peered":"2024-05-07T11:12:45.051364+0000","last_clean":"2024-05-07T11:12:45.051364+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:12:45.051364+0000","last_undegraded":"2024-05-07T11:12:45.051364+0000","last_fullsized":"2024-05-07T11:12:45.051364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045693+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:12:46.045693+0000","last_peered":"2024-05-07T11:12:46.045693+0000","last_clean":"2024-05-07T11:12:46.045693+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:12:46.045693+0000","last_undegraded":"2024-05-07T11:12:46.045693+0000","last_fullsized":"2024-05-07T11:12:46.045693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051592+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:12:45.051592+0000","last_peered":"2024-05-07T11:12:45.051592+0000","last_clean":"2024-05-07T11:12:45.051592+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:12:45.051592+0000","last_undegraded":"2024-05-07T11:12:45.051592+0000","last_fullsized":"2024-05-07T11:12:45.051592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051735+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:12:45.051735+0000","last_peered":"2024-05-07T11:12:45.051735+0000","last_clean":"2024-05-07T11:12:45.051735+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:12:45.051735+0000","last_undegraded":"2024-05-07T11:12:45.051735+0000","last_fullsized":"2024-05-07T11:12:45.051735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052590+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:12:45.052590+0000","last_peered":"2024-05-07T11:12:45.052590+0000","last_clean":"2024-05-07T11:12:45.052590+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:12:45.052590+0000","last_undegraded":"2024-05-07T11:12:45.052590+0000","last_fullsized":"2024-05-07T11:12:45.052590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050501+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:12:45.050501+0000","last_peered":"2024-05-07T11:12:45.050501+0000","last_clean":"2024-05-07T11:12:45.050501+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:12:45.050501+0000","last_undegraded":"2024-05-07T11:12:45.050501+0000","last_fullsized":"2024-05-07T11:12:45.050501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052285+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:12:45.052285+0000","last_peered":"2024-05-07T11:12:45.052285+0000","last_clean":"2024-05-07T11:12:45.052285+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:12:45.052285+0000","last_undegraded":"2024-05-07T11:12:45.052285+0000","last_fullsized":"2024-05-07T11:12:45.052285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044458+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:12:46.044458+0000","last_peered":"2024-05-07T11:12:46.044458+0000","last_clean":"2024-05-07T11:12:46.044458+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:12:46.044458+0000","last_undegraded":"2024-05-07T11:12:46.044458+0000","last_fullsized":"2024-05-07T11:12:46.044458+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045265+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:12:46.045265+0000","last_peered":"2024-05-07T11:12:46.045265+0000","last_clean":"2024-05-07T11:12:46.045265+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:12:46.045265+0000","last_undegraded":"2024-05-07T11:12:46.045265+0000","last_fullsized":"2024-05-07T11:12:46.045265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051383+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:12:45.051383+0000","last_peered":"2024-05-07T11:12:45.051383+0000","last_clean":"2024-05-07T11:12:45.051383+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:12:45.051383+0000","last_undegraded":"2024-05-07T11:12:45.051383+0000","last_fullsized":"2024-05-07T11:12:45.051383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051540+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:12:45.051540+0000","last_peered":"2024-05-07T11:12:45.051540+0000","last_clean":"2024-05-07T11:12:45.051540+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:12:45.051540+0000","last_undegraded":"2024-05-07T11:12:45.051540+0000","last_fullsized":"2024-05-07T11:12:45.051540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050384+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:12:45.050384+0000","last_peered":"2024-05-07T11:12:45.050384+0000","last_clean":"2024-05-07T11:12:45.050384+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:12:45.050384+0000","last_undegraded":"2024-05-07T11:12:45.050384+0000","last_fullsized":"2024-05-07T11:12:45.050384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045798+0000","last_change":"2024-05-07T11:12:43.054017+0000","last_active":"2024-05-07T11:12:46.045798+0000","last_peered":"2024-05-07T11:12:46.045798+0000","last_clean":"2024-05-07T11:12:46.045798+0000","last_became_active":"2024-05-07T11:12:43.053655+0000","last_became_peered":"2024-05-07T11:12:43.053655+0000","last_unstale":"2024-05-07T11:12:46.045798+0000","last_undegraded":"2024-05-07T11:12:46.045798+0000","last_fullsized":"2024-05-07T11:12:46.045798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044896+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:12:46.044896+0000","last_peered":"2024-05-07T11:12:46.044896+0000","last_clean":"2024-05-07T11:12:46.044896+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:12:46.044896+0000","last_undegraded":"2024-05-07T11:12:46.044896+0000","last_fullsized":"2024-05-07T11:12:46.044896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045701+0000","last_change":"2024-05-07T11:12:43.053040+0000","last_active":"2024-05-07T11:12:46.045701+0000","last_peered":"2024-05-07T11:12:46.045701+0000","last_clean":"2024-05-07T11:12:46.045701+0000","last_became_active":"2024-05-07T11:12:43.052641+0000","last_became_peered":"2024-05-07T11:12:43.052641+0000","last_unstale":"2024-05-07T11:12:46.045701+0000","last_undegraded":"2024-05-07T11:12:46.045701+0000","last_fullsized":"2024-05-07T11:12:46.045701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:56:26.393747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051649+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:12:45.051649+0000","last_peered":"2024-05-07T11:12:45.051649+0000","last_clean":"2024-05-07T11:12:45.051649+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:12:45.051649+0000","last_undegraded":"2024-05-07T11:12:45.051649+0000","last_fullsized":"2024-05-07T11:12:45.051649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051857+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:12:45.051857+0000","last_peered":"2024-05-07T11:12:45.051857+0000","last_clean":"2024-05-07T11:12:45.051857+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:12:45.051857+0000","last_undegraded":"2024-05-07T11:12:45.051857+0000","last_fullsized":"2024-05-07T11:12:45.051857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045603+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:12:46.045603+0000","last_peered":"2024-05-07T11:12:46.045603+0000","last_clean":"2024-05-07T11:12:46.045603+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:12:46.045603+0000","last_undegraded":"2024-05-07T11:12:46.045603+0000","last_fullsized":"2024-05-07T11:12:46.045603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045503+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:12:46.045503+0000","last_peered":"2024-05-07T11:12:46.045503+0000","last_clean":"2024-05-07T11:12:46.045503+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:12:46.045503+0000","last_undegraded":"2024-05-07T11:12:46.045503+0000","last_fullsized":"2024-05-07T11:12:46.045503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045711+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:12:46.045711+0000","last_peered":"2024-05-07T11:12:46.045711+0000","last_clean":"2024-05-07T11:12:46.045711+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:12:46.045711+0000","last_undegraded":"2024-05-07T11:12:46.045711+0000","last_fullsized":"2024-05-07T11:12:46.045711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050653+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:12:45.050653+0000","last_peered":"2024-05-07T11:12:45.050653+0000","last_clean":"2024-05-07T11:12:45.050653+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:12:45.050653+0000","last_undegraded":"2024-05-07T11:12:45.050653+0000","last_fullsized":"2024-05-07T11:12:45.050653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044984+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:12:46.044984+0000","last_peered":"2024-05-07T11:12:46.044984+0000","last_clean":"2024-05-07T11:12:46.044984+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:12:46.044984+0000","last_undegraded":"2024-05-07T11:12:46.044984+0000","last_fullsized":"2024-05-07T11:12:46.044984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050493+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:12:45.050493+0000","last_peered":"2024-05-07T11:12:45.050493+0000","last_clean":"2024-05-07T11:12:45.050493+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:12:45.050493+0000","last_undegraded":"2024-05-07T11:12:45.050493+0000","last_fullsized":"2024-05-07T11:12:45.050493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052487+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:12:45.052487+0000","last_peered":"2024-05-07T11:12:45.052487+0000","last_clean":"2024-05-07T11:12:45.052487+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:12:45.052487+0000","last_undegraded":"2024-05-07T11:12:45.052487+0000","last_fullsized":"2024-05-07T11:12:45.052487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045027+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:12:46.045027+0000","last_peered":"2024-05-07T11:12:46.045027+0000","last_clean":"2024-05-07T11:12:46.045027+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:12:46.045027+0000","last_undegraded":"2024-05-07T11:12:46.045027+0000","last_fullsized":"2024-05-07T11:12:46.045027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045735+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:12:46.045735+0000","last_peered":"2024-05-07T11:12:46.045735+0000","last_clean":"2024-05-07T11:12:46.045735+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:12:46.045735+0000","last_undegraded":"2024-05-07T11:12:46.045735+0000","last_fullsized":"2024-05-07T11:12:46.045735+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051913+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:12:45.051913+0000","last_peered":"2024-05-07T11:12:45.051913+0000","last_clean":"2024-05-07T11:12:45.051913+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:12:45.051913+0000","last_undegraded":"2024-05-07T11:12:45.051913+0000","last_fullsized":"2024-05-07T11:12:45.051913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045790+0000","last_change":"2024-05-07T11:12:44.059544+0000","last_active":"2024-05-07T11:12:46.045790+0000","last_peered":"2024-05-07T11:12:46.045790+0000","last_clean":"2024-05-07T11:12:46.045790+0000","last_became_active":"2024-05-07T11:12:44.058884+0000","last_became_peered":"2024-05-07T11:12:44.058884+0000","last_unstale":"2024-05-07T11:12:46.045790+0000","last_undegraded":"2024-05-07T11:12:46.045790+0000","last_fullsized":"2024-05-07T11:12:46.045790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:46:22.416221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044746+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:12:46.044746+0000","last_peered":"2024-05-07T11:12:46.044746+0000","last_clean":"2024-05-07T11:12:46.044746+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:12:46.044746+0000","last_undegraded":"2024-05-07T11:12:46.044746+0000","last_fullsized":"2024-05-07T11:12:46.044746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051566+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:12:45.051566+0000","last_peered":"2024-05-07T11:12:45.051566+0000","last_clean":"2024-05-07T11:12:45.051566+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:12:45.051566+0000","last_undegraded":"2024-05-07T11:12:45.051566+0000","last_fullsized":"2024-05-07T11:12:45.051566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051280+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:12:45.051280+0000","last_peered":"2024-05-07T11:12:45.051280+0000","last_clean":"2024-05-07T11:12:45.051280+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:12:45.051280+0000","last_undegraded":"2024-05-07T11:12:45.051280+0000","last_fullsized":"2024-05-07T11:12:45.051280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051628+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:12:45.051628+0000","last_peered":"2024-05-07T11:12:45.051628+0000","last_clean":"2024-05-07T11:12:45.051628+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:12:45.051628+0000","last_undegraded":"2024-05-07T11:12:45.051628+0000","last_fullsized":"2024-05-07T11:12:45.051628+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050743+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:12:45.050743+0000","last_peered":"2024-05-07T11:12:45.050743+0000","last_clean":"2024-05-07T11:12:45.050743+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:12:45.050743+0000","last_undegraded":"2024-05-07T11:12:45.050743+0000","last_fullsized":"2024-05-07T11:12:45.050743+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052485+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:12:45.052485+0000","last_peered":"2024-05-07T11:12:45.052485+0000","last_clean":"2024-05-07T11:12:45.052485+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:12:45.052485+0000","last_undegraded":"2024-05-07T11:12:45.052485+0000","last_fullsized":"2024-05-07T11:12:45.052485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045587+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:12:46.045587+0000","last_peered":"2024-05-07T11:12:46.045587+0000","last_clean":"2024-05-07T11:12:46.045587+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:12:46.045587+0000","last_undegraded":"2024-05-07T11:12:46.045587+0000","last_fullsized":"2024-05-07T11:12:46.045587+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045708+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:12:46.045708+0000","last_peered":"2024-05-07T11:12:46.045708+0000","last_clean":"2024-05-07T11:12:46.045708+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:12:46.045708+0000","last_undegraded":"2024-05-07T11:12:46.045708+0000","last_fullsized":"2024-05-07T11:12:46.045708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052318+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:12:45.052318+0000","last_peered":"2024-05-07T11:12:45.052318+0000","last_clean":"2024-05-07T11:12:45.052318+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:12:45.052318+0000","last_undegraded":"2024-05-07T11:12:45.052318+0000","last_fullsized":"2024-05-07T11:12:45.052318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045850+0000","last_change":"2024-05-07T11:12:43.053188+0000","last_active":"2024-05-07T11:12:46.045850+0000","last_peered":"2024-05-07T11:12:46.045850+0000","last_clean":"2024-05-07T11:12:46.045850+0000","last_became_active":"2024-05-07T11:12:43.052570+0000","last_became_peered":"2024-05-07T11:12:43.052570+0000","last_unstale":"2024-05-07T11:12:46.045850+0000","last_undegraded":"2024-05-07T11:12:46.045850+0000","last_fullsized":"2024-05-07T11:12:46.045850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052376+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:12:45.052376+0000","last_peered":"2024-05-07T11:12:45.052376+0000","last_clean":"2024-05-07T11:12:45.052376+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:12:45.052376+0000","last_undegraded":"2024-05-07T11:12:45.052376+0000","last_fullsized":"2024-05-07T11:12:45.052376+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050802+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:12:45.050802+0000","last_peered":"2024-05-07T11:12:45.050802+0000","last_clean":"2024-05-07T11:12:45.050802+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:12:45.050802+0000","last_undegraded":"2024-05-07T11:12:45.050802+0000","last_fullsized":"2024-05-07T11:12:45.050802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052342+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:12:45.052342+0000","last_peered":"2024-05-07T11:12:45.052342+0000","last_clean":"2024-05-07T11:12:45.052342+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:12:45.052342+0000","last_undegraded":"2024-05-07T11:12:45.052342+0000","last_fullsized":"2024-05-07T11:12:45.052342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051790+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:12:45.051790+0000","last_peered":"2024-05-07T11:12:45.051790+0000","last_clean":"2024-05-07T11:12:45.051790+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:12:45.051790+0000","last_undegraded":"2024-05-07T11:12:45.051790+0000","last_fullsized":"2024-05-07T11:12:45.051790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050741+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:12:45.050741+0000","last_peered":"2024-05-07T11:12:45.050741+0000","last_clean":"2024-05-07T11:12:45.050741+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:12:45.050741+0000","last_undegraded":"2024-05-07T11:12:45.050741+0000","last_fullsized":"2024-05-07T11:12:45.050741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052758+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:12:45.052758+0000","last_peered":"2024-05-07T11:12:45.052758+0000","last_clean":"2024-05-07T11:12:45.052758+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:12:45.052758+0000","last_undegraded":"2024-05-07T11:12:45.052758+0000","last_fullsized":"2024-05-07T11:12:45.052758+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052643+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:12:45.052643+0000","last_peered":"2024-05-07T11:12:45.052643+0000","last_clean":"2024-05-07T11:12:45.052643+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:12:45.052643+0000","last_undegraded":"2024-05-07T11:12:45.052643+0000","last_fullsized":"2024-05-07T11:12:45.052643+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051464+0000","last_change":"2024-05-07T11:12:44.056491+0000","last_active":"2024-05-07T11:12:45.051464+0000","last_peered":"2024-05-07T11:12:45.051464+0000","last_clean":"2024-05-07T11:12:45.051464+0000","last_became_active":"2024-05-07T11:12:44.056196+0000","last_became_peered":"2024-05-07T11:12:44.056196+0000","last_unstale":"2024-05-07T11:12:45.051464+0000","last_undegraded":"2024-05-07T11:12:45.051464+0000","last_fullsized":"2024-05-07T11:12:45.051464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.043497+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:12:46.043497+0000","last_peered":"2024-05-07T11:12:46.043497+0000","last_clean":"2024-05-07T11:12:46.043497+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:12:46.043497+0000","last_undegraded":"2024-05-07T11:12:46.043497+0000","last_fullsized":"2024-05-07T11:12:46.043497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045228+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:12:46.045228+0000","last_peered":"2024-05-07T11:12:46.045228+0000","last_clean":"2024-05-07T11:12:46.045228+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:12:46.045228+0000","last_undegraded":"2024-05-07T11:12:46.045228+0000","last_fullsized":"2024-05-07T11:12:46.045228+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050439+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:12:45.050439+0000","last_peered":"2024-05-07T11:12:45.050439+0000","last_clean":"2024-05-07T11:12:45.050439+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:12:45.050439+0000","last_undegraded":"2024-05-07T11:12:45.050439+0000","last_fullsized":"2024-05-07T11:12:45.050439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045214+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:12:46.045214+0000","last_peered":"2024-05-07T11:12:46.045214+0000","last_clean":"2024-05-07T11:12:46.045214+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:12:46.045214+0000","last_undegraded":"2024-05-07T11:12:46.045214+0000","last_fullsized":"2024-05-07T11:12:46.045214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051515+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:12:45.051515+0000","last_peered":"2024-05-07T11:12:45.051515+0000","last_clean":"2024-05-07T11:12:45.051515+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:12:45.051515+0000","last_undegraded":"2024-05-07T11:12:45.051515+0000","last_fullsized":"2024-05-07T11:12:45.051515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051787+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:12:45.051787+0000","last_peered":"2024-05-07T11:12:45.051787+0000","last_clean":"2024-05-07T11:12:45.051787+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:12:45.051787+0000","last_undegraded":"2024-05-07T11:12:45.051787+0000","last_fullsized":"2024-05-07T11:12:45.051787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053163+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.052490+0000","last_became_peered":"2024-05-07T11:12:43.052490+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051421+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:12:45.051421+0000","last_peered":"2024-05-07T11:12:45.051421+0000","last_clean":"2024-05-07T11:12:45.051421+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:12:45.051421+0000","last_undegraded":"2024-05-07T11:12:45.051421+0000","last_fullsized":"2024-05-07T11:12:45.051421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052690+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:12:45.052690+0000","last_peered":"2024-05-07T11:12:45.052690+0000","last_clean":"2024-05-07T11:12:45.052690+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:12:45.052690+0000","last_undegraded":"2024-05-07T11:12:45.052690+0000","last_fullsized":"2024-05-07T11:12:45.052690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051438+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:12:45.051438+0000","last_peered":"2024-05-07T11:12:45.051438+0000","last_clean":"2024-05-07T11:12:45.051438+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:12:45.051438+0000","last_undegraded":"2024-05-07T11:12:45.051438+0000","last_fullsized":"2024-05-07T11:12:45.051438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051706+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:12:45.051706+0000","last_peered":"2024-05-07T11:12:45.051706+0000","last_clean":"2024-05-07T11:12:45.051706+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:12:45.051706+0000","last_undegraded":"2024-05-07T11:12:45.051706+0000","last_fullsized":"2024-05-07T11:12:45.051706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051696+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:12:45.051696+0000","last_peered":"2024-05-07T11:12:45.051696+0000","last_clean":"2024-05-07T11:12:45.051696+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:12:45.051696+0000","last_undegraded":"2024-05-07T11:12:45.051696+0000","last_fullsized":"2024-05-07T11:12:45.051696+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052275+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:12:45.052275+0000","last_peered":"2024-05-07T11:12:45.052275+0000","last_clean":"2024-05-07T11:12:45.052275+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:12:45.052275+0000","last_undegraded":"2024-05-07T11:12:45.052275+0000","last_fullsized":"2024-05-07T11:12:45.052275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051505+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:12:45.051505+0000","last_peered":"2024-05-07T11:12:45.051505+0000","last_clean":"2024-05-07T11:12:45.051505+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:12:45.051505+0000","last_undegraded":"2024-05-07T11:12:45.051505+0000","last_fullsized":"2024-05-07T11:12:45.051505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051445+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:12:45.051445+0000","last_peered":"2024-05-07T11:12:45.051445+0000","last_clean":"2024-05-07T11:12:45.051445+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:12:45.051445+0000","last_undegraded":"2024-05-07T11:12:45.051445+0000","last_fullsized":"2024-05-07T11:12:45.051445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050944+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:12:45.050944+0000","last_peered":"2024-05-07T11:12:45.050944+0000","last_clean":"2024-05-07T11:12:45.050944+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:12:45.050944+0000","last_undegraded":"2024-05-07T11:12:45.050944+0000","last_fullsized":"2024-05-07T11:12:45.050944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051008+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:12:45.051008+0000","last_peered":"2024-05-07T11:12:45.051008+0000","last_clean":"2024-05-07T11:12:45.051008+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:12:45.051008+0000","last_undegraded":"2024-05-07T11:12:45.051008+0000","last_fullsized":"2024-05-07T11:12:45.051008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051044+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:12:45.051044+0000","last_peered":"2024-05-07T11:12:45.051044+0000","last_clean":"2024-05-07T11:12:45.051044+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:12:45.051044+0000","last_undegraded":"2024-05-07T11:12:45.051044+0000","last_fullsized":"2024-05-07T11:12:45.051044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045230+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:12:46.045230+0000","last_peered":"2024-05-07T11:12:46.045230+0000","last_clean":"2024-05-07T11:12:46.045230+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:12:46.045230+0000","last_undegraded":"2024-05-07T11:12:46.045230+0000","last_fullsized":"2024-05-07T11:12:46.045230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045154+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:12:46.045154+0000","last_peered":"2024-05-07T11:12:46.045154+0000","last_clean":"2024-05-07T11:12:46.045154+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:12:46.045154+0000","last_undegraded":"2024-05-07T11:12:46.045154+0000","last_fullsized":"2024-05-07T11:12:46.045154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051665+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:12:45.051665+0000","last_peered":"2024-05-07T11:12:45.051665+0000","last_clean":"2024-05-07T11:12:45.051665+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:12:45.051665+0000","last_undegraded":"2024-05-07T11:12:45.051665+0000","last_fullsized":"2024-05-07T11:12:45.051665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051165+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:12:45.051165+0000","last_peered":"2024-05-07T11:12:45.051165+0000","last_clean":"2024-05-07T11:12:45.051165+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:12:45.051165+0000","last_undegraded":"2024-05-07T11:12:45.051165+0000","last_fullsized":"2024-05-07T11:12:45.051165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052504+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:12:45.052504+0000","last_peered":"2024-05-07T11:12:45.052504+0000","last_clean":"2024-05-07T11:12:45.052504+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:12:45.052504+0000","last_undegraded":"2024-05-07T11:12:45.052504+0000","last_fullsized":"2024-05-07T11:12:45.052504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044918+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:12:46.044918+0000","last_peered":"2024-05-07T11:12:46.044918+0000","last_clean":"2024-05-07T11:12:46.044918+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:12:46.044918+0000","last_undegraded":"2024-05-07T11:12:46.044918+0000","last_fullsized":"2024-05-07T11:12:46.044918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052615+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:12:45.052615+0000","last_peered":"2024-05-07T11:12:45.052615+0000","last_clean":"2024-05-07T11:12:45.052615+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:12:45.052615+0000","last_undegraded":"2024-05-07T11:12:45.052615+0000","last_fullsized":"2024-05-07T11:12:45.052615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":638861,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":638245,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:13:04.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:13:04.843 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:04.845 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:13:04.854 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-05-07T11:13:02.941734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81628,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033892,"statfs":{"total":289910292480,"available":289826705408,"internally_reserved":0,"allocated":573440,"data_stored":1323805,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002498"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051518+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:12:45.051518+0000","last_peered":"2024-05-07T11:12:45.051518+0000","last_clean":"2024-05-07T11:12:45.051518+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:12:45.051518+0000","last_undegraded":"2024-05-07T11:12:45.051518+0000","last_fullsized":"2024-05-07T11:12:45.051518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051016+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:12:45.051016+0000","last_peered":"2024-05-07T11:12:45.051016+0000","last_clean":"2024-05-07T11:12:45.051016+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:12:45.051016+0000","last_undegraded":"2024-05-07T11:12:45.051016+0000","last_fullsized":"2024-05-07T11:12:45.051016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044931+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:12:46.044931+0000","last_peered":"2024-05-07T11:12:46.044931+0000","last_clean":"2024-05-07T11:12:46.044931+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:12:46.044931+0000","last_undegraded":"2024-05-07T11:12:46.044931+0000","last_fullsized":"2024-05-07T11:12:46.044931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051123+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:12:45.051123+0000","last_peered":"2024-05-07T11:12:45.051123+0000","last_clean":"2024-05-07T11:12:45.051123+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:12:45.051123+0000","last_undegraded":"2024-05-07T11:12:45.051123+0000","last_fullsized":"2024-05-07T11:12:45.051123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044619+0000","last_change":"2024-05-07T11:12:44.054002+0000","last_active":"2024-05-07T11:12:46.044619+0000","last_peered":"2024-05-07T11:12:46.044619+0000","last_clean":"2024-05-07T11:12:46.044619+0000","last_became_active":"2024-05-07T11:12:44.053275+0000","last_became_peered":"2024-05-07T11:12:44.053275+0000","last_unstale":"2024-05-07T11:12:46.044619+0000","last_undegraded":"2024-05-07T11:12:46.044619+0000","last_fullsized":"2024-05-07T11:12:46.044619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044470+0000","last_change":"2024-05-07T11:12:44.053753+0000","last_active":"2024-05-07T11:12:46.044470+0000","last_peered":"2024-05-07T11:12:46.044470+0000","last_clean":"2024-05-07T11:12:46.044470+0000","last_became_active":"2024-05-07T11:12:44.052991+0000","last_became_peered":"2024-05-07T11:12:44.052991+0000","last_unstale":"2024-05-07T11:12:46.044470+0000","last_undegraded":"2024-05-07T11:12:46.044470+0000","last_fullsized":"2024-05-07T11:12:46.044470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044203+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:12:46.044203+0000","last_peered":"2024-05-07T11:12:46.044203+0000","last_clean":"2024-05-07T11:12:46.044203+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:12:46.044203+0000","last_undegraded":"2024-05-07T11:12:46.044203+0000","last_fullsized":"2024-05-07T11:12:46.044203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052288+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:12:45.052288+0000","last_peered":"2024-05-07T11:12:45.052288+0000","last_clean":"2024-05-07T11:12:45.052288+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:12:45.052288+0000","last_undegraded":"2024-05-07T11:12:45.052288+0000","last_fullsized":"2024-05-07T11:12:45.052288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051125+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:12:45.051125+0000","last_peered":"2024-05-07T11:12:45.051125+0000","last_clean":"2024-05-07T11:12:45.051125+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:12:45.051125+0000","last_undegraded":"2024-05-07T11:12:45.051125+0000","last_fullsized":"2024-05-07T11:12:45.051125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045295+0000","last_change":"2024-05-07T11:12:44.054308+0000","last_active":"2024-05-07T11:12:46.045295+0000","last_peered":"2024-05-07T11:12:46.045295+0000","last_clean":"2024-05-07T11:12:46.045295+0000","last_became_active":"2024-05-07T11:12:44.053809+0000","last_became_peered":"2024-05-07T11:12:44.053809+0000","last_unstale":"2024-05-07T11:12:46.045295+0000","last_undegraded":"2024-05-07T11:12:46.045295+0000","last_fullsized":"2024-05-07T11:12:46.045295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:22.261724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051159+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:12:45.051159+0000","last_peered":"2024-05-07T11:12:45.051159+0000","last_clean":"2024-05-07T11:12:45.051159+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:12:45.051159+0000","last_undegraded":"2024-05-07T11:12:45.051159+0000","last_fullsized":"2024-05-07T11:12:45.051159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050678+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:12:45.050678+0000","last_peered":"2024-05-07T11:12:45.050678+0000","last_clean":"2024-05-07T11:12:45.050678+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:12:45.050678+0000","last_undegraded":"2024-05-07T11:12:45.050678+0000","last_fullsized":"2024-05-07T11:12:45.050678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044673+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:12:46.044673+0000","last_peered":"2024-05-07T11:12:46.044673+0000","last_clean":"2024-05-07T11:12:46.044673+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:12:46.044673+0000","last_undegraded":"2024-05-07T11:12:46.044673+0000","last_fullsized":"2024-05-07T11:12:46.044673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044712+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:12:46.044712+0000","last_peered":"2024-05-07T11:12:46.044712+0000","last_clean":"2024-05-07T11:12:46.044712+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:12:46.044712+0000","last_undegraded":"2024-05-07T11:12:46.044712+0000","last_fullsized":"2024-05-07T11:12:46.044712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044199+0000","last_change":"2024-05-07T11:12:44.057719+0000","last_active":"2024-05-07T11:12:46.044199+0000","last_peered":"2024-05-07T11:12:46.044199+0000","last_clean":"2024-05-07T11:12:46.044199+0000","last_became_active":"2024-05-07T11:12:44.055208+0000","last_became_peered":"2024-05-07T11:12:44.055208+0000","last_unstale":"2024-05-07T11:12:46.044199+0000","last_undegraded":"2024-05-07T11:12:46.044199+0000","last_fullsized":"2024-05-07T11:12:46.044199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052775+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:12:45.052775+0000","last_peered":"2024-05-07T11:12:45.052775+0000","last_clean":"2024-05-07T11:12:45.052775+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:12:45.052775+0000","last_undegraded":"2024-05-07T11:12:45.052775+0000","last_fullsized":"2024-05-07T11:12:45.052775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051527+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:12:45.051527+0000","last_peered":"2024-05-07T11:12:45.051527+0000","last_clean":"2024-05-07T11:12:45.051527+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:12:45.051527+0000","last_undegraded":"2024-05-07T11:12:45.051527+0000","last_fullsized":"2024-05-07T11:12:45.051527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052169+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:12:45.052169+0000","last_peered":"2024-05-07T11:12:45.052169+0000","last_clean":"2024-05-07T11:12:45.052169+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:12:45.052169+0000","last_undegraded":"2024-05-07T11:12:45.052169+0000","last_fullsized":"2024-05-07T11:12:45.052169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045083+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:12:46.045083+0000","last_peered":"2024-05-07T11:12:46.045083+0000","last_clean":"2024-05-07T11:12:46.045083+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:12:46.045083+0000","last_undegraded":"2024-05-07T11:12:46.045083+0000","last_fullsized":"2024-05-07T11:12:46.045083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044990+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:12:46.044990+0000","last_peered":"2024-05-07T11:12:46.044990+0000","last_clean":"2024-05-07T11:12:46.044990+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:12:46.044990+0000","last_undegraded":"2024-05-07T11:12:46.044990+0000","last_fullsized":"2024-05-07T11:12:46.044990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050573+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:12:45.050573+0000","last_peered":"2024-05-07T11:12:45.050573+0000","last_clean":"2024-05-07T11:12:45.050573+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:12:45.050573+0000","last_undegraded":"2024-05-07T11:12:45.050573+0000","last_fullsized":"2024-05-07T11:12:45.050573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051210+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:12:45.051210+0000","last_peered":"2024-05-07T11:12:45.051210+0000","last_clean":"2024-05-07T11:12:45.051210+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:12:45.051210+0000","last_undegraded":"2024-05-07T11:12:45.051210+0000","last_fullsized":"2024-05-07T11:12:45.051210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050292+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:12:45.050292+0000","last_peered":"2024-05-07T11:12:45.050292+0000","last_clean":"2024-05-07T11:12:45.050292+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:12:45.050292+0000","last_undegraded":"2024-05-07T11:12:45.050292+0000","last_fullsized":"2024-05-07T11:12:45.050292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051631+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:12:45.051631+0000","last_peered":"2024-05-07T11:12:45.051631+0000","last_clean":"2024-05-07T11:12:45.051631+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:12:45.051631+0000","last_undegraded":"2024-05-07T11:12:45.051631+0000","last_fullsized":"2024-05-07T11:12:45.051631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052426+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:12:45.052426+0000","last_peered":"2024-05-07T11:12:45.052426+0000","last_clean":"2024-05-07T11:12:45.052426+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:12:45.052426+0000","last_undegraded":"2024-05-07T11:12:45.052426+0000","last_fullsized":"2024-05-07T11:12:45.052426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045205+0000","last_change":"2024-05-07T11:12:44.059023+0000","last_active":"2024-05-07T11:12:46.045205+0000","last_peered":"2024-05-07T11:12:46.045205+0000","last_clean":"2024-05-07T11:12:46.045205+0000","last_became_active":"2024-05-07T11:12:44.057224+0000","last_became_peered":"2024-05-07T11:12:44.057224+0000","last_unstale":"2024-05-07T11:12:46.045205+0000","last_undegraded":"2024-05-07T11:12:46.045205+0000","last_fullsized":"2024-05-07T11:12:46.045205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:42.813261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051596+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:12:45.051596+0000","last_peered":"2024-05-07T11:12:45.051596+0000","last_clean":"2024-05-07T11:12:45.051596+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:12:45.051596+0000","last_undegraded":"2024-05-07T11:12:45.051596+0000","last_fullsized":"2024-05-07T11:12:45.051596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051768+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:12:45.051768+0000","last_peered":"2024-05-07T11:12:45.051768+0000","last_clean":"2024-05-07T11:12:45.051768+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:12:45.051768+0000","last_undegraded":"2024-05-07T11:12:45.051768+0000","last_fullsized":"2024-05-07T11:12:45.051768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050877+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:12:45.050877+0000","last_peered":"2024-05-07T11:12:45.050877+0000","last_clean":"2024-05-07T11:12:45.050877+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:12:45.050877+0000","last_undegraded":"2024-05-07T11:12:45.050877+0000","last_fullsized":"2024-05-07T11:12:45.050877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051253+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:12:45.051253+0000","last_peered":"2024-05-07T11:12:45.051253+0000","last_clean":"2024-05-07T11:12:45.051253+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:12:45.051253+0000","last_undegraded":"2024-05-07T11:12:45.051253+0000","last_fullsized":"2024-05-07T11:12:45.051253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044454+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:12:46.044454+0000","last_peered":"2024-05-07T11:12:46.044454+0000","last_clean":"2024-05-07T11:12:46.044454+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:12:46.044454+0000","last_undegraded":"2024-05-07T11:12:46.044454+0000","last_fullsized":"2024-05-07T11:12:46.044454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051364+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:12:45.051364+0000","last_peered":"2024-05-07T11:12:45.051364+0000","last_clean":"2024-05-07T11:12:45.051364+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:12:45.051364+0000","last_undegraded":"2024-05-07T11:12:45.051364+0000","last_fullsized":"2024-05-07T11:12:45.051364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045693+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:12:46.045693+0000","last_peered":"2024-05-07T11:12:46.045693+0000","last_clean":"2024-05-07T11:12:46.045693+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:12:46.045693+0000","last_undegraded":"2024-05-07T11:12:46.045693+0000","last_fullsized":"2024-05-07T11:12:46.045693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051592+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:12:45.051592+0000","last_peered":"2024-05-07T11:12:45.051592+0000","last_clean":"2024-05-07T11:12:45.051592+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:12:45.051592+0000","last_undegraded":"2024-05-07T11:12:45.051592+0000","last_fullsized":"2024-05-07T11:12:45.051592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051735+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:12:45.051735+0000","last_peered":"2024-05-07T11:12:45.051735+0000","last_clean":"2024-05-07T11:12:45.051735+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:12:45.051735+0000","last_undegraded":"2024-05-07T11:12:45.051735+0000","last_fullsized":"2024-05-07T11:12:45.051735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052590+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:12:45.052590+0000","last_peered":"2024-05-07T11:12:45.052590+0000","last_clean":"2024-05-07T11:12:45.052590+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:12:45.052590+0000","last_undegraded":"2024-05-07T11:12:45.052590+0000","last_fullsized":"2024-05-07T11:12:45.052590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050501+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:12:45.050501+0000","last_peered":"2024-05-07T11:12:45.050501+0000","last_clean":"2024-05-07T11:12:45.050501+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:12:45.050501+0000","last_undegraded":"2024-05-07T11:12:45.050501+0000","last_fullsized":"2024-05-07T11:12:45.050501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052285+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:12:45.052285+0000","last_peered":"2024-05-07T11:12:45.052285+0000","last_clean":"2024-05-07T11:12:45.052285+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:12:45.052285+0000","last_undegraded":"2024-05-07T11:12:45.052285+0000","last_fullsized":"2024-05-07T11:12:45.052285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044458+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:12:46.044458+0000","last_peered":"2024-05-07T11:12:46.044458+0000","last_clean":"2024-05-07T11:12:46.044458+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:12:46.044458+0000","last_undegraded":"2024-05-07T11:12:46.044458+0000","last_fullsized":"2024-05-07T11:12:46.044458+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045265+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:12:46.045265+0000","last_peered":"2024-05-07T11:12:46.045265+0000","last_clean":"2024-05-07T11:12:46.045265+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:12:46.045265+0000","last_undegraded":"2024-05-07T11:12:46.045265+0000","last_fullsized":"2024-05-07T11:12:46.045265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051383+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:12:45.051383+0000","last_peered":"2024-05-07T11:12:45.051383+0000","last_clean":"2024-05-07T11:12:45.051383+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:12:45.051383+0000","last_undegraded":"2024-05-07T11:12:45.051383+0000","last_fullsized":"2024-05-07T11:12:45.051383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051540+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:12:45.051540+0000","last_peered":"2024-05-07T11:12:45.051540+0000","last_clean":"2024-05-07T11:12:45.051540+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:12:45.051540+0000","last_undegraded":"2024-05-07T11:12:45.051540+0000","last_fullsized":"2024-05-07T11:12:45.051540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050384+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:12:45.050384+0000","last_peered":"2024-05-07T11:12:45.050384+0000","last_clean":"2024-05-07T11:12:45.050384+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:12:45.050384+0000","last_undegraded":"2024-05-07T11:12:45.050384+0000","last_fullsized":"2024-05-07T11:12:45.050384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045798+0000","last_change":"2024-05-07T11:12:43.054017+0000","last_active":"2024-05-07T11:12:46.045798+0000","last_peered":"2024-05-07T11:12:46.045798+0000","last_clean":"2024-05-07T11:12:46.045798+0000","last_became_active":"2024-05-07T11:12:43.053655+0000","last_became_peered":"2024-05-07T11:12:43.053655+0000","last_unstale":"2024-05-07T11:12:46.045798+0000","last_undegraded":"2024-05-07T11:12:46.045798+0000","last_fullsized":"2024-05-07T11:12:46.045798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044896+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:12:46.044896+0000","last_peered":"2024-05-07T11:12:46.044896+0000","last_clean":"2024-05-07T11:12:46.044896+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:12:46.044896+0000","last_undegraded":"2024-05-07T11:12:46.044896+0000","last_fullsized":"2024-05-07T11:12:46.044896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045701+0000","last_change":"2024-05-07T11:12:43.053040+0000","last_active":"2024-05-07T11:12:46.045701+0000","last_peered":"2024-05-07T11:12:46.045701+0000","last_clean":"2024-05-07T11:12:46.045701+0000","last_became_active":"2024-05-07T11:12:43.052641+0000","last_became_peered":"2024-05-07T11:12:43.052641+0000","last_unstale":"2024-05-07T11:12:46.045701+0000","last_undegraded":"2024-05-07T11:12:46.045701+0000","last_fullsized":"2024-05-07T11:12:46.045701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:56:26.393747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051649+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:12:45.051649+0000","last_peered":"2024-05-07T11:12:45.051649+0000","last_clean":"2024-05-07T11:12:45.051649+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:12:45.051649+0000","last_undegraded":"2024-05-07T11:12:45.051649+0000","last_fullsized":"2024-05-07T11:12:45.051649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051857+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:12:45.051857+0000","last_peered":"2024-05-07T11:12:45.051857+0000","last_clean":"2024-05-07T11:12:45.051857+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:12:45.051857+0000","last_undegraded":"2024-05-07T11:12:45.051857+0000","last_fullsized":"2024-05-07T11:12:45.051857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045603+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:12:46.045603+0000","last_peered":"2024-05-07T11:12:46.045603+0000","last_clean":"2024-05-07T11:12:46.045603+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:12:46.045603+0000","last_undegraded":"2024-05-07T11:12:46.045603+0000","last_fullsized":"2024-05-07T11:12:46.045603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045503+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:12:46.045503+0000","last_peered":"2024-05-07T11:12:46.045503+0000","last_clean":"2024-05-07T11:12:46.045503+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:12:46.045503+0000","last_undegraded":"2024-05-07T11:12:46.045503+0000","last_fullsized":"2024-05-07T11:12:46.045503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045711+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:12:46.045711+0000","last_peered":"2024-05-07T11:12:46.045711+0000","last_clean":"2024-05-07T11:12:46.045711+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:12:46.045711+0000","last_undegraded":"2024-05-07T11:12:46.045711+0000","last_fullsized":"2024-05-07T11:12:46.045711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050653+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:12:45.050653+0000","last_peered":"2024-05-07T11:12:45.050653+0000","last_clean":"2024-05-07T11:12:45.050653+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:12:45.050653+0000","last_undegraded":"2024-05-07T11:12:45.050653+0000","last_fullsized":"2024-05-07T11:12:45.050653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044984+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:12:46.044984+0000","last_peered":"2024-05-07T11:12:46.044984+0000","last_clean":"2024-05-07T11:12:46.044984+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:12:46.044984+0000","last_undegraded":"2024-05-07T11:12:46.044984+0000","last_fullsized":"2024-05-07T11:12:46.044984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050493+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:12:45.050493+0000","last_peered":"2024-05-07T11:12:45.050493+0000","last_clean":"2024-05-07T11:12:45.050493+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:12:45.050493+0000","last_undegraded":"2024-05-07T11:12:45.050493+0000","last_fullsized":"2024-05-07T11:12:45.050493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052487+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:12:45.052487+0000","last_peered":"2024-05-07T11:12:45.052487+0000","last_clean":"2024-05-07T11:12:45.052487+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:12:45.052487+0000","last_undegraded":"2024-05-07T11:12:45.052487+0000","last_fullsized":"2024-05-07T11:12:45.052487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045027+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:12:46.045027+0000","last_peered":"2024-05-07T11:12:46.045027+0000","last_clean":"2024-05-07T11:12:46.045027+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:12:46.045027+0000","last_undegraded":"2024-05-07T11:12:46.045027+0000","last_fullsized":"2024-05-07T11:12:46.045027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045735+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:12:46.045735+0000","last_peered":"2024-05-07T11:12:46.045735+0000","last_clean":"2024-05-07T11:12:46.045735+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:12:46.045735+0000","last_undegraded":"2024-05-07T11:12:46.045735+0000","last_fullsized":"2024-05-07T11:12:46.045735+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051913+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:12:45.051913+0000","last_peered":"2024-05-07T11:12:45.051913+0000","last_clean":"2024-05-07T11:12:45.051913+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:12:45.051913+0000","last_undegraded":"2024-05-07T11:12:45.051913+0000","last_fullsized":"2024-05-07T11:12:45.051913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045790+0000","last_change":"2024-05-07T11:12:44.059544+0000","last_active":"2024-05-07T11:12:46.045790+0000","last_peered":"2024-05-07T11:12:46.045790+0000","last_clean":"2024-05-07T11:12:46.045790+0000","last_became_active":"2024-05-07T11:12:44.058884+0000","last_became_peered":"2024-05-07T11:12:44.058884+0000","last_unstale":"2024-05-07T11:12:46.045790+0000","last_undegraded":"2024-05-07T11:12:46.045790+0000","last_fullsized":"2024-05-07T11:12:46.045790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:46:22.416221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044746+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:12:46.044746+0000","last_peered":"2024-05-07T11:12:46.044746+0000","last_clean":"2024-05-07T11:12:46.044746+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:12:46.044746+0000","last_undegraded":"2024-05-07T11:12:46.044746+0000","last_fullsized":"2024-05-07T11:12:46.044746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051566+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:12:45.051566+0000","last_peered":"2024-05-07T11:12:45.051566+0000","last_clean":"2024-05-07T11:12:45.051566+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:12:45.051566+0000","last_undegraded":"2024-05-07T11:12:45.051566+0000","last_fullsized":"2024-05-07T11:12:45.051566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051280+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:12:45.051280+0000","last_peered":"2024-05-07T11:12:45.051280+0000","last_clean":"2024-05-07T11:12:45.051280+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:12:45.051280+0000","last_undegraded":"2024-05-07T11:12:45.051280+0000","last_fullsized":"2024-05-07T11:12:45.051280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051628+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:12:45.051628+0000","last_peered":"2024-05-07T11:12:45.051628+0000","last_clean":"2024-05-07T11:12:45.051628+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:12:45.051628+0000","last_undegraded":"2024-05-07T11:12:45.051628+0000","last_fullsized":"2024-05-07T11:12:45.051628+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050743+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:12:45.050743+0000","last_peered":"2024-05-07T11:12:45.050743+0000","last_clean":"2024-05-07T11:12:45.050743+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:12:45.050743+0000","last_undegraded":"2024-05-07T11:12:45.050743+0000","last_fullsized":"2024-05-07T11:12:45.050743+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052485+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:12:45.052485+0000","last_peered":"2024-05-07T11:12:45.052485+0000","last_clean":"2024-05-07T11:12:45.052485+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:12:45.052485+0000","last_undegraded":"2024-05-07T11:12:45.052485+0000","last_fullsized":"2024-05-07T11:12:45.052485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045587+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:12:46.045587+0000","last_peered":"2024-05-07T11:12:46.045587+0000","last_clean":"2024-05-07T11:12:46.045587+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:12:46.045587+0000","last_undegraded":"2024-05-07T11:12:46.045587+0000","last_fullsized":"2024-05-07T11:12:46.045587+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045708+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:12:46.045708+0000","last_peered":"2024-05-07T11:12:46.045708+0000","last_clean":"2024-05-07T11:12:46.045708+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:12:46.045708+0000","last_undegraded":"2024-05-07T11:12:46.045708+0000","last_fullsized":"2024-05-07T11:12:46.045708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052318+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:12:45.052318+0000","last_peered":"2024-05-07T11:12:45.052318+0000","last_clean":"2024-05-07T11:12:45.052318+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:12:45.052318+0000","last_undegraded":"2024-05-07T11:12:45.052318+0000","last_fullsized":"2024-05-07T11:12:45.052318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045850+0000","last_change":"2024-05-07T11:12:43.053188+0000","last_active":"2024-05-07T11:12:46.045850+0000","last_peered":"2024-05-07T11:12:46.045850+0000","last_clean":"2024-05-07T11:12:46.045850+0000","last_became_active":"2024-05-07T11:12:43.052570+0000","last_became_peered":"2024-05-07T11:12:43.052570+0000","last_unstale":"2024-05-07T11:12:46.045850+0000","last_undegraded":"2024-05-07T11:12:46.045850+0000","last_fullsized":"2024-05-07T11:12:46.045850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052376+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:12:45.052376+0000","last_peered":"2024-05-07T11:12:45.052376+0000","last_clean":"2024-05-07T11:12:45.052376+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:12:45.052376+0000","last_undegraded":"2024-05-07T11:12:45.052376+0000","last_fullsized":"2024-05-07T11:12:45.052376+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050802+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:12:45.050802+0000","last_peered":"2024-05-07T11:12:45.050802+0000","last_clean":"2024-05-07T11:12:45.050802+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:12:45.050802+0000","last_undegraded":"2024-05-07T11:12:45.050802+0000","last_fullsized":"2024-05-07T11:12:45.050802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052342+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:12:45.052342+0000","last_peered":"2024-05-07T11:12:45.052342+0000","last_clean":"2024-05-07T11:12:45.052342+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:12:45.052342+0000","last_undegraded":"2024-05-07T11:12:45.052342+0000","last_fullsized":"2024-05-07T11:12:45.052342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051790+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:12:45.051790+0000","last_peered":"2024-05-07T11:12:45.051790+0000","last_clean":"2024-05-07T11:12:45.051790+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:12:45.051790+0000","last_undegraded":"2024-05-07T11:12:45.051790+0000","last_fullsized":"2024-05-07T11:12:45.051790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050741+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:12:45.050741+0000","last_peered":"2024-05-07T11:12:45.050741+0000","last_clean":"2024-05-07T11:12:45.050741+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:12:45.050741+0000","last_undegraded":"2024-05-07T11:12:45.050741+0000","last_fullsized":"2024-05-07T11:12:45.050741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052758+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:12:45.052758+0000","last_peered":"2024-05-07T11:12:45.052758+0000","last_clean":"2024-05-07T11:12:45.052758+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:12:45.052758+0000","last_undegraded":"2024-05-07T11:12:45.052758+0000","last_fullsized":"2024-05-07T11:12:45.052758+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052643+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:12:45.052643+0000","last_peered":"2024-05-07T11:12:45.052643+0000","last_clean":"2024-05-07T11:12:45.052643+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:12:45.052643+0000","last_undegraded":"2024-05-07T11:12:45.052643+0000","last_fullsized":"2024-05-07T11:12:45.052643+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051464+0000","last_change":"2024-05-07T11:12:44.056491+0000","last_active":"2024-05-07T11:12:45.051464+0000","last_peered":"2024-05-07T11:12:45.051464+0000","last_clean":"2024-05-07T11:12:45.051464+0000","last_became_active":"2024-05-07T11:12:44.056196+0000","last_became_peered":"2024-05-07T11:12:44.056196+0000","last_unstale":"2024-05-07T11:12:45.051464+0000","last_undegraded":"2024-05-07T11:12:45.051464+0000","last_fullsized":"2024-05-07T11:12:45.051464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.043497+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:12:46.043497+0000","last_peered":"2024-05-07T11:12:46.043497+0000","last_clean":"2024-05-07T11:12:46.043497+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:12:46.043497+0000","last_undegraded":"2024-05-07T11:12:46.043497+0000","last_fullsized":"2024-05-07T11:12:46.043497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045228+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:12:46.045228+0000","last_peered":"2024-05-07T11:12:46.045228+0000","last_clean":"2024-05-07T11:12:46.045228+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:12:46.045228+0000","last_undegraded":"2024-05-07T11:12:46.045228+0000","last_fullsized":"2024-05-07T11:12:46.045228+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050439+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:12:45.050439+0000","last_peered":"2024-05-07T11:12:45.050439+0000","last_clean":"2024-05-07T11:12:45.050439+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:12:45.050439+0000","last_undegraded":"2024-05-07T11:12:45.050439+0000","last_fullsized":"2024-05-07T11:12:45.050439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045214+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:12:46.045214+0000","last_peered":"2024-05-07T11:12:46.045214+0000","last_clean":"2024-05-07T11:12:46.045214+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:12:46.045214+0000","last_undegraded":"2024-05-07T11:12:46.045214+0000","last_fullsized":"2024-05-07T11:12:46.045214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051515+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:12:45.051515+0000","last_peered":"2024-05-07T11:12:45.051515+0000","last_clean":"2024-05-07T11:12:45.051515+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:12:45.051515+0000","last_undegraded":"2024-05-07T11:12:45.051515+0000","last_fullsized":"2024-05-07T11:12:45.051515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051787+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:12:45.051787+0000","last_peered":"2024-05-07T11:12:45.051787+0000","last_clean":"2024-05-07T11:12:45.051787+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:12:45.051787+0000","last_undegraded":"2024-05-07T11:12:45.051787+0000","last_fullsized":"2024-05-07T11:12:45.051787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053163+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.052490+0000","last_became_peered":"2024-05-07T11:12:43.052490+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051421+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:12:45.051421+0000","last_peered":"2024-05-07T11:12:45.051421+0000","last_clean":"2024-05-07T11:12:45.051421+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:12:45.051421+0000","last_undegraded":"2024-05-07T11:12:45.051421+0000","last_fullsized":"2024-05-07T11:12:45.051421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052690+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:12:45.052690+0000","last_peered":"2024-05-07T11:12:45.052690+0000","last_clean":"2024-05-07T11:12:45.052690+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:12:45.052690+0000","last_undegraded":"2024-05-07T11:12:45.052690+0000","last_fullsized":"2024-05-07T11:12:45.052690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051438+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:12:45.051438+0000","last_peered":"2024-05-07T11:12:45.051438+0000","last_clean":"2024-05-07T11:12:45.051438+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:12:45.051438+0000","last_undegraded":"2024-05-07T11:12:45.051438+0000","last_fullsized":"2024-05-07T11:12:45.051438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051706+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:12:45.051706+0000","last_peered":"2024-05-07T11:12:45.051706+0000","last_clean":"2024-05-07T11:12:45.051706+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:12:45.051706+0000","last_undegraded":"2024-05-07T11:12:45.051706+0000","last_fullsized":"2024-05-07T11:12:45.051706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051696+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:12:45.051696+0000","last_peered":"2024-05-07T11:12:45.051696+0000","last_clean":"2024-05-07T11:12:45.051696+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:12:45.051696+0000","last_undegraded":"2024-05-07T11:12:45.051696+0000","last_fullsized":"2024-05-07T11:12:45.051696+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052275+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:12:45.052275+0000","last_peered":"2024-05-07T11:12:45.052275+0000","last_clean":"2024-05-07T11:12:45.052275+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:12:45.052275+0000","last_undegraded":"2024-05-07T11:12:45.052275+0000","last_fullsized":"2024-05-07T11:12:45.052275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051505+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:12:45.051505+0000","last_peered":"2024-05-07T11:12:45.051505+0000","last_clean":"2024-05-07T11:12:45.051505+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:12:45.051505+0000","last_undegraded":"2024-05-07T11:12:45.051505+0000","last_fullsized":"2024-05-07T11:12:45.051505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051445+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:12:45.051445+0000","last_peered":"2024-05-07T11:12:45.051445+0000","last_clean":"2024-05-07T11:12:45.051445+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:12:45.051445+0000","last_undegraded":"2024-05-07T11:12:45.051445+0000","last_fullsized":"2024-05-07T11:12:45.051445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050944+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:12:45.050944+0000","last_peered":"2024-05-07T11:12:45.050944+0000","last_clean":"2024-05-07T11:12:45.050944+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:12:45.050944+0000","last_undegraded":"2024-05-07T11:12:45.050944+0000","last_fullsized":"2024-05-07T11:12:45.050944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051008+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:12:45.051008+0000","last_peered":"2024-05-07T11:12:45.051008+0000","last_clean":"2024-05-07T11:12:45.051008+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:12:45.051008+0000","last_undegraded":"2024-05-07T11:12:45.051008+0000","last_fullsized":"2024-05-07T11:12:45.051008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051044+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:12:45.051044+0000","last_peered":"2024-05-07T11:12:45.051044+0000","last_clean":"2024-05-07T11:12:45.051044+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:12:45.051044+0000","last_undegraded":"2024-05-07T11:12:45.051044+0000","last_fullsized":"2024-05-07T11:12:45.051044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045230+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:12:46.045230+0000","last_peered":"2024-05-07T11:12:46.045230+0000","last_clean":"2024-05-07T11:12:46.045230+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:12:46.045230+0000","last_undegraded":"2024-05-07T11:12:46.045230+0000","last_fullsized":"2024-05-07T11:12:46.045230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045154+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:12:46.045154+0000","last_peered":"2024-05-07T11:12:46.045154+0000","last_clean":"2024-05-07T11:12:46.045154+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:12:46.045154+0000","last_undegraded":"2024-05-07T11:12:46.045154+0000","last_fullsized":"2024-05-07T11:12:46.045154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051665+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:12:45.051665+0000","last_peered":"2024-05-07T11:12:45.051665+0000","last_clean":"2024-05-07T11:12:45.051665+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:12:45.051665+0000","last_undegraded":"2024-05-07T11:12:45.051665+0000","last_fullsized":"2024-05-07T11:12:45.051665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051165+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:12:45.051165+0000","last_peered":"2024-05-07T11:12:45.051165+0000","last_clean":"2024-05-07T11:12:45.051165+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:12:45.051165+0000","last_undegraded":"2024-05-07T11:12:45.051165+0000","last_fullsized":"2024-05-07T11:12:45.051165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052504+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:12:45.052504+0000","last_peered":"2024-05-07T11:12:45.052504+0000","last_clean":"2024-05-07T11:12:45.052504+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:12:45.052504+0000","last_undegraded":"2024-05-07T11:12:45.052504+0000","last_fullsized":"2024-05-07T11:12:45.052504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044918+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:12:46.044918+0000","last_peered":"2024-05-07T11:12:46.044918+0000","last_clean":"2024-05-07T11:12:46.044918+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:12:46.044918+0000","last_undegraded":"2024-05-07T11:12:46.044918+0000","last_fullsized":"2024-05-07T11:12:46.044918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052615+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:12:45.052615+0000","last_peered":"2024-05-07T11:12:45.052615+0000","last_clean":"2024-05-07T11:12:45.052615+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:12:45.052615+0000","last_undegraded":"2024-05-07T11:12:45.052615+0000","last_fullsized":"2024-05-07T11:12:45.052615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":638861,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":638245,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:13:04.859 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-07T11:13:04.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-05-07T11:13:05.194 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 15 2024-05-07T11:13:05.194 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 712a8431-2ac1-4386-a81f-c899bab82549 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-07T11:12:28.567931+0000 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-07T11:12:45.043439+0000 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:crush_version 4 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:full_ratio 0.95 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:backfillfull_ratio 0.9 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:nearfull_ratio 0.85 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:require_min_compat_client luminous 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:min_compat_client jewel 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:require_osd_release squid 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:stretch_mode_enabled false 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-05-07T11:13:05.195 INFO:teuthology.orchestra.run.smithi062.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-05-07T11:13:05.196 INFO:teuthology.orchestra.run.smithi062.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-05-07T11:13:05.196 INFO:teuthology.orchestra.run.smithi062.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-05-07T11:13:05.196 INFO:teuthology.orchestra.run.smithi062.stdout:max_osd 3 2024-05-07T11:13:05.196 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6800/1378788154,v1:172.21.15.88:6801/1378788154] [v2:172.21.15.88:6802/1378788154,v1:172.21.15.88:6803/1378788154] exists,up cd7246e2-0069-4df7-a669-4abe038a28ad 2024-05-07T11:13:05.196 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6800/3051775179,v1:172.21.15.149:6801/3051775179] [v2:172.21.15.149:6802/3051775179,v1:172.21.15.149:6803/3051775179] exists,up 7df5bb74-60c0-4a46-a3d1-494f777a4f88 2024-05-07T11:13:05.196 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/2659225388,v1:172.21.15.175:6801/2659225388] [v2:172.21.15.175:6802/2659225388,v1:172.21.15.175:6803/2659225388] exists,up ebed6b16-fba7-4b8a-a78e-1f84a500c31f 2024-05-07T11:13:05.207 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6800/1378788154,v1:172.21.15.88:6801/1378788154] [v2:172.21.15.88:6802/1378788154,v1:172.21.15.88:6803/1378788154] exists,up cd7246e2-0069-4df7-a669-4abe038a28ad', 'osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6800/3051775179,v1:172.21.15.149:6801/3051775179] [v2:172.21.15.149:6802/3051775179,v1:172.21.15.149:6803/3051775179] exists,up 7df5bb74-60c0-4a46-a3d1-494f777a4f88', 'osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/2659225388,v1:172.21.15.175:6801/2659225388] [v2:172.21.15.175:6802/2659225388,v1:172.21.15.175:6803/2659225388] exists,up ebed6b16-fba7-4b8a-a78e-1f84a500c31f'] 2024-05-07T11:13:05.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-05-07T11:13:05.311 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:13:05.311 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mon.a", 2024-05-07T11:13:05.311 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster": "ceph", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "admin_socket_mode": "", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_client_required": "cephx, none", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_cluster_required": "cephx", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_debug": "true", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_service_required": "cephx", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_service_ticket_ttl": "240.000000", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_supported": "cephx", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_aio": "true", 2024-05-07T11:13:05.312 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_aio_max_queue_depth": "1024", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_aio_poll_ms": "250", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_aio_reap_max": "16", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_async_discard": "false", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_block_size": "4096", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_debug_aio": "false", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_debug_inflight_ios": "false", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_enable_discard": "false", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_flock_retry": "3", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_flock_retry_interval": "0.100000", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_inject_crash": "0", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_inject_crash_flush_delay": "2", 2024-05-07T11:13:05.313 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_ioring": "false", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_ioring_hipri": "false", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_ioring_sqthread_poll": "false", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_read_buffer_alignment": "4096", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_type": "", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_alloc_size": "1048576", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_allocator": "hybrid", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_buffered_io": "true", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_check_for_zeros": "false", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_check_volume_selector_often": "false", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_compact_log_sync": "false", 2024-05-07T11:13:05.314 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_log_compact_min_size": "16777216", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_log_replay_check_allocations": "true", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_max_log_runway": "4194304", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_max_prefetch": "1048576", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_min_flush_size": "524288", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_min_log_runway": "1048576", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_replay_recovery": "false", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_shared_alloc_size": "65536", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_sync_write": "false", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-05-07T11:13:05.315 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_allocation_from_file": "true", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_allocator": "hybrid", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blobid_prealloc": "10240", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_create": "true", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_db_create": "false", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_db_path": "", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_db_size": "0", 2024-05-07T11:13:05.316 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_path": "", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_preallocate_file": "false", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_size": "107374182400", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_wal_create": "false", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_wal_path": "", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_wal_size": "100663296", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bluefs": "true", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bluefs_env_mirror": "false", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-05-07T11:13:05.317 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_autotune": "true", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_size": "0", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_type": "2q", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_clone_cow": "true", 2024-05-07T11:13:05.318 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_algorithm": "snappy", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_max_blob_size": "0", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_min_blob_size": "0", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_mode": "none", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_csum_type": "crc32c", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_enforce_settings": "default", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_freelist": "false", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_fsck_abort": "false", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-05-07T11:13:05.319 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_inject_read_err": "false", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_legacy_omap": "false", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_prefill": "0.000000", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_small_allocations": "0", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_default_buffered_read": "true", 2024-05-07T11:13:05.320 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_default_buffered_write": "false", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_deferred_batch_ops": "0", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_elastic_shared_blobs": "true", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fail_eio": "false", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-05-07T11:13:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_mkfs": "true", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_mount": "false", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_umount": "false", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-05-07T11:13:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_ignore_data_csum": "false", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_kvbackend": "rocksdb", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_log_op_age": "5.000000", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_alloc_size": "0", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_blob_size": "0", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_defer_interval": "3.000000", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_deferred_txc": "32", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_min_alloc_size": "0", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-05-07T11:13:05.323 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_nid_prealloc": "1024", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_prefer_deferred_size": "0", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_qfsck_on_mount": "true", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_retry_disk_reads": "3", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_rocksdb_cf": "true", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_rocksdb_options_annex": "", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_spdk_coremask": "0x1", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_spdk_io_sleep": "5", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_spdk_max_io_completion": "0", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_spdk_mem": "512", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_sync_submit_transaction": "false", 2024-05-07T11:13:05.324 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_bytes": "67108864", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_cost_per_io": "0", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_tracing": "false", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_volume_selection_reserved": "0", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-05-07T11:13:05.325 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_zero_block_detection": "false", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_action_update_interval": "2", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_mount_timeout": "10", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-05-07T11:13:05.326 INFO:teuthology.orchestra.run.smithi062.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_cluster_require_signatures": "false", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_cluster_require_version": "2", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_require_signatures": "false", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_require_version": "2", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_service_require_signatures": "false", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_service_require_version": "2", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_sign_messages": "true", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "chdir": "", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "client_acl_type": "", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "client_asio_thread_count": "2", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "client_cache_mid": "0.750000", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "client_cache_size": "16384", 2024-05-07T11:13:05.327 INFO:teuthology.orchestra.run.smithi062.stdout: "client_caps_release_delay": "5", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_check_pool_perm": "true", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_collect_and_send_global_metrics": "false", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_debug_force_sync_read": "false", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_debug_getattr_caps": "false", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_debug_inject_tick_delay": "0", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_die_on_failed_remount": "false", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_dirsize_rbytes": "true", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_force_lazyio": "false", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_fs": "", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_inject_fixed_oldest_tid": "false", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_inject_release_failure": "false", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_max_inline_size": "4096", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_max_retries_on_remount_failure": "5", 2024-05-07T11:13:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: "client_mds_namespace": "", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_metadata": "", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_mount_gid": "-1", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_mount_timeout": "300", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_mount_uid": "-1", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_mountpoint": "/", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_notify_timeout": "10", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc": "true", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc_max_dirty": "104857600", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc_max_dirty_age": "5.000000", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc_max_objects": "1000", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc_size": "209715200", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc_target_dirty": "8388608", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_permissions": "true", 2024-05-07T11:13:05.329 INFO:teuthology.orchestra.run.smithi062.stdout: "client_quota": "true", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_quota_df": "true", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_readahead_max_bytes": "0", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_readahead_max_periods": "4", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_readahead_min": "131072", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_reconnect_stale": "false", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_shutdown_timeout": "30", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_snapdir": ".snap", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_tick_interval": "1", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_trace": "", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_try_dentry_invalidate": "false", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_use_faked_inos": "false", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "client_use_random_mds": "false", 2024-05-07T11:13:05.330 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_graylog": "false", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_graylog_port": "12201", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_monitors": "default=true", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_syslog": "false", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_syslog_level": "info", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "-", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_network": "", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_network_interface": "", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "compressor_zlib_isal": "false", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "compressor_zlib_level": "5", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "compressor_zlib_winsize": "-15", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "compressor_zstd_level": "1", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-05-07T11:13:05.331 INFO:teuthology.orchestra.run.smithi062.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_alien_op_num_threads": "6", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_alien_thread_cpu_cores": "", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_osd_obc_lru_size": "512", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_seastar_cpu_cores": "", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_location": "", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_location_hook": "", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_location_hook_timeout": "10", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "daemonize": "false", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "daos_pool": "tank", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "dbstore_db_name_prefix": "dbstore", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_alienstore": "0/5", 2024-05-07T11:13:05.332 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_allow_any_pool_priority": "false", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_asok": "1/5", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_asok_assert_abort": "false", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_asserts_on_shutdown": "true", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_auth": "20/20", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_bdev": "1/3", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_bluefs": "1/5", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_bluestore": "1/5", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_buffer": "0/1", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_ceph_exporter": "1/5", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_cephfs_mirror": "0/5", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_cephsqlite": "0/5", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_client": "0/5", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_compressor": "1/5", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_context": "0/1", 2024-05-07T11:13:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_crimson_interrupt": "0/5", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_crush": "1/1", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_crypto": "1/5", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_cyanstore": "0/5", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_deliberately_leak_memory": "false", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_disable_randomized_ping": "false", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_dpdk": "1/5", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_eventtrace": "1/5", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_filer": "0/1", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_filestore": "1/3", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_finisher": "1/1", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_fuse": "1/5", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_heartbeat_testing_span": "0", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_heartbeatmap": "1/5", 2024-05-07T11:13:05.334 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_immutable_obj_cache": "0/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_javaclient": "1/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_journal": "1/3", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_journaler": "0/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_kstore": "1/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_lockdep": "0/1", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mclock": "1/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds": "1/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_balancer": "1/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_locker": "1/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_log": "1/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_log_expire": "1/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_migrator": "1/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_quiesce": "3/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_memstore": "1/5", 2024-05-07T11:13:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mgr": "2/5", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mgrc": "1/5", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mon": "20/20", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_monc": "0/10", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_ms": "1/1", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_none": "0/5", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_objclass": "0/5", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_objectcacher": "0/5", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_objecter": "0/1", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_optracker": "0/5", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_osd": "1/5", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_paxos": "20/20", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_perfcounter": "1/5", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_prioritycache": "1/5", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rados": "0/5", 2024-05-07T11:13:05.336 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rbd": "0/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rbd_mirror": "0/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rbd_pwl": "0/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rbd_replay": "0/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_refs": "0/0", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_reserver": "1/1", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw": "1/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_access": "1/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_datacache": "1/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_dbstore": "1/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_flight": "1/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_lifecycle": "1/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_sync": "1/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rocksdb": "4/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore": "0/5", 2024-05-07T11:13:05.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_backref": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_cache": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_cleaner": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_device": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_epm": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_journal": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_lba": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_odata": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_omap": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_onode": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_t": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_tm": "0/5", 2024-05-07T11:13:05.338 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_striper": "0/1", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_test": "0/5", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_throttle": "1/1", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_timer": "0/1", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_tp": "0/5", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_trace": "1/5", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "device_failure_prediction_mode": "none", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "err_to_graylog": "false", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "err_to_journald": "false", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "err_to_stderr": "true", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "err_to_syslog": "false", 2024-05-07T11:13:05.339 INFO:teuthology.orchestra.run.smithi062.stdout: "event_tracing": "false", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_addr": "0.0.0.0", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_http_port": "9926", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_prio_limit": "5", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_sort_metrics": "true", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_stats_period": "5", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "fake_statfs_for_testing": "0", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "fatal_signal_handlers": "true", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "filer_max_purge_ops": "10", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "filer_max_truncate_ops": "128", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_apply_finisher_threads": "1", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_blackhole": "false", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_btrfs_clone_range": "true", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_btrfs_snap": "true", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_caller_concurrency": "10", 2024-05-07T11:13:05.340 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_collect_device_partition_information": "true", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_commit_timeout": "600.000000", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_debug_inject_read_err": "false", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_debug_omap_check": "false", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_debug_random_read_err": "0.000000", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_debug_verify_split": "false", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_dump_file": "", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fadvise": "true", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fail_eio": "true", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fd_cache_shards": "16", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fd_cache_size": "128", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fiemap": "false", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fiemap_threshold": "4096", 2024-05-07T11:13:05.341 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_index_retry_probability": "0.000000", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_inject_stall": "0", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_journal_parallel": "false", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_journal_trailing": "false", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_journal_writeahead": "false", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_kill_at": "0", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattr_size": "0", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattrs": "0", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-05-07T11:13:05.342 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattrs_other": "2", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_sync_interval": "5.000000", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_xattr_value_size": "0", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_merge_threshold": "-10", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_min_sync_interval": "0.010000", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_odsync_write": "false", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_omap_backend": "rocksdb", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_omap_backend_path": "", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_omap_header_cache_size": "1024", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_ondisk_finisher_threads": "1", 2024-05-07T11:13:05.343 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_op_thread_timeout": "60", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_op_threads": "2", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_punch_hole": "false", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_max_bytes": "104857600", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_max_ops": "50", 2024-05-07T11:13:05.344 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_seek_data_hole": "false", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_sloppy_crc": "false", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_splice": "false", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_split_multiple": "2", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_split_rand_factor": "20", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_update_to": "1000", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_enable": "true", 2024-05-07T11:13:05.345 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-05-07T11:13:05.346 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-05-07T11:13:05.346 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-05-07T11:13:05.346 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-05-07T11:13:05.346 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-05-07T11:13:05.346 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-05-07T11:13:05.346 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_xfs_extsize": "false", 2024-05-07T11:13:05.346 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_zfs_snap": "false", 2024-05-07T11:13:05.346 INFO:teuthology.orchestra.run.smithi062.stdout: "fio_dir": "/tmp/fio", 2024-05-07T11:13:05.346 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "712a8431-2ac1-4386-a81f-c899bab82549", 2024-05-07T11:13:05.346 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_allow_other": "true", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_atomic_o_trunc": "true", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_big_writes": "true", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_debug": "false", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_default_permissions": "false", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_disable_pagecache": "false", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_max_write": "0", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_multithreaded": "true", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_require_active_mds": "true", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_set_user_groups": "true", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_splice_move": "true", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_splice_read": "true", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_splice_write": "true", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_syncfs_on_mksnap": "true", 2024-05-07T11:13:05.347 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_use_invalidate_cb": "true", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "gss_target_name": "ceph", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_file": "", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_inject_failure": "0", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_interval": "5", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "host": "smithi062", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_max_size": "1073741824", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-05-07T11:13:05.348 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_watermark": "0.900000", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "inject_early_sigterm": "false", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "jaeger_agent_port": "6799", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "jaeger_tracing_enable": "false", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_aio": "true", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_align_min_size": "65536", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_block_align": "true", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_block_size": "4096", 2024-05-07T11:13:05.349 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_dio": "true", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_discard": "false", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_force_aio": "false", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_ignore_corruption": "false", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_max_write_bytes": "10485760", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_max_write_entries": "100", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_replay_from": "0", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_throttle_high_multiple": "0.000000", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_throttle_max_multiple": "0.000000", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_write_header_frequency": "0", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_zero_on_create": "false", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journaler_prefetch_periods": "10", 2024-05-07T11:13:05.350 INFO:teuthology.orchestra.run.smithi062.stdout: "journaler_prezero_periods": "5", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "journaler_write_head_interval": "15", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "keyfile": "", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_backend": "rocksdb", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_default_stripe_size": "65536", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_fsck_on_mount": "false", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_fsck_on_mount_deep": "true", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_max_bytes": "67108864", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_max_ops": "512", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_nid_prealloc": "1024", 2024-05-07T11:13:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_onode_map_size": "1024", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_sync_submit_transaction": "false", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_sync_transaction": "false", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "librados_thread_count": "2", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "lockdep": "false", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "lockdep_force_backtrace": "false", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "log_coarse_timestamps": "true", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "log_flush_on_exit": "false", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "log_graylog_host": "127.0.0.1", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "log_graylog_port": "12201", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "log_max_new": "1000", 2024-05-07T11:13:05.352 INFO:teuthology.orchestra.run.smithi062.stdout: "log_max_recent": "10000", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "log_stderr_prefix": "", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "log_stop_at_utilization": "0.970000", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": "true", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_graylog": "false", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_journald": "false", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_stderr": "false", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_syslog": "false", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "max_rotating_auth_attempts": "10", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_action_on_write_error": "1", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_alternate_name_max": "8192", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_asio_thread_count": "2", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_export_pin": "true", 2024-05-07T11:13:05.353 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_fragment_dirs": "true", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_fragment_interval": "5", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_fragment_size_max": "100000", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_idle_threshold": "0.000000", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_interval": "10", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_max": "-1", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_max_until": "-1", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_merge_size": "50", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_midchunk": "0.300000", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_min_rebalance": "0.100000", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_min_start": "0.200000", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_minchunk": "0.001000", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_mode": "0", 2024-05-07T11:13:05.354 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_need_max": "1.200000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_need_min": "0.800000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_overload_epochs": "2", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_sample_interval": "3.000000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_split_bits": "3", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_split_rd": "25000.000000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_split_size": "10000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_split_wr": "10000.000000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_target_decay": "10.000000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_beacon_grace": "15.000000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_beacon_interval": "4.000000", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_beacon_mon_down_grace": "60", 2024-05-07T11:13:05.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_memory_limit": "4294967296", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_mid": "0.700000", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_quiesce_delay": "0", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_quiesce_sleep": "200", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_quiesce_splitauth": "true", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_quiesce_threshold": "524288", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_release_free_interval": "10", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_reservation": "0.050000", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_trim_interval": "1", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_trim_threshold": "262144", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_client_delegate_inos_pct": "50", 2024-05-07T11:13:05.356 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_client_prealloc_inos": "1000", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_connect_bootstrapping": "false", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_damage_table_max_entries": "10000", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_debug_auth_pins": "false", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_debug_frag": "false", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_debug_scatterstat": "false", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_debug_subtrees": "false", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_decay_halflife": "5.000000", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_default_dir_hash": "2", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_defer_session_stale": "true", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_deny_all_reconnect": "false", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dir_keys_per_op": "16384", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dir_max_commit_size": "10", 2024-05-07T11:13:05.357 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dir_max_entries": "0", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dir_prefetch": "true", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dirstat_min_interval": "1.000000", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dump_cache_after_rejoin": "false", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dump_cache_on_map": "false", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dump_cache_threshold_file": "0", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_early_reply": "true", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_enable_op_tracker": "true", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_enforce_unique_name": "true", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_export_ephemeral_distributed": "true", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_export_ephemeral_random": "true", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-05-07T11:13:05.358 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_forward_all_requests_to_auth": "false", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_health_cache_threshold": "1.500000", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_health_summarize_threshold": "10", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_heartbeat_grace": "15.000000", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_heartbeat_reset_grace": "1000", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_health_dummy": "false", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_migrator_session_race": "false", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-05-07T11:13:05.359 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_join_fs": "", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_journal_format": "1", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_create_at": "0", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_export_at": "0", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_import_at": "0", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_journal_at": "0", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_journal_expire_at": "0", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_journal_replay_at": "0", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_link_at": "0", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_mdstable_at": "0", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_openc_at": "0", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_rename_at": "0", 2024-05-07T11:13:05.360 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_shutdown_at": "0", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_event_large_threshold": "524288", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_events_per_segment": "1024", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_major_segment_event_ratio": "12", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_max_events": "-1", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_max_segments": "128", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_pause": "false", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_segment_size": "0", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_skip_corrupt_events": "false", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_skip_unbounded_events": "false", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_trim_threshold": "128", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_warn_factor": "2.000000", 2024-05-07T11:13:05.361 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_caps_per_client": "1048576", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_completed_flushes": "100000", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_completed_requests": "100000", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_export_size": "20971520", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_file_recover": "32", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_purge_files": "64", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_purge_ops": "8192", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_snaps_per_dir": "100", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_metrics_update_interval": "2", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_min_caps_per_client": "100", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_min_caps_working_set": "10000", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-05-07T11:13:05.362 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_numa_node": "-1", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_complaint_time": "30.000000", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_history_duration": "600", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_history_size": "20", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_history_slow_op_size": "20", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_history_slow_op_threshold": "10", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_log_threshold": "5", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_ping_grace": "15", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_ping_interval": "5", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_max_caps": "30000", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_max_decay_threshold": "131072", 2024-05-07T11:13:05.363 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_warning_threshold": "262144", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_reconnect_timeout": "45.000000", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_replay_interval": "1.000000", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_root_ino_gid": "0", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_root_ino_uid": "0", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_blocklist_on_evict": "true", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_blocklist_on_timeout": "true", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-05-07T11:13:05.364 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_metadata_threshold": "16777216", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_shutdown_check": "0", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_skip_ino": "0", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sleep_rank_change": "0.000000", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_snap_max_uid": "4294967294", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_snap_min_uid": "0", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_snap_rstat": "false", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_standby_replay_damaged": "false", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_symlink_recovery": "true", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_task_status_update_interval": "2.000000", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_thrash_exports": "0", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_thrash_fragments": "0", 2024-05-07T11:13:05.365 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_tick_interval": "5.000000", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_valgrind_exit": "false", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_verify_backtrace": "1", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_verify_scatter": "false", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_wipe_ino_prealloc": "false", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_wipe_sessions": "false", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool_debug": "false", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "memstore_debug_omit_block_device_write": "false", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "memstore_device_bytes": "1073741824", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "memstore_page_set": "false", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "memstore_page_size": "65536", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_client_bytes": "134217728", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_client_messages": "512", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-05-07T11:13:05.366 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_connect_retry_interval": "1.000000", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_disabled_modules": "", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_max_pg_num_change": "128", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_mds_bytes": "134217728", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_mds_messages": "128", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_mon_bytes": "134217728", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_mon_messages": "128", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_osd_bytes": "536870912", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_osd_messages": "8192", 2024-05-07T11:13:05.367 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_pool": "true", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_service_beacon_grace": "60.000000", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_standby_modules": "true", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_stats_period": "5", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_stats_threshold": "5", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_tick_period": "2", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_accept_timeout_factor": "2.000000", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_allow_pool_delete": "true", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_allow_pool_size_one": "true", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_auth_validate_all_caps": "true", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_bytes": "104857600", 2024-05-07T11:13:05.368 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_directed_command_retry": "2", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_hunt_interval": "3.000000", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_hunt_parallel": "3", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_log_interval": "1.000000", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_ping_interval": "10.000000", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_ping_timeout": "30.000000", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_target_rank": "-1", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_clock_drift_allowed": "1.000000", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_file_level": "debug", 2024-05-07T11:13:05.369 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_file": "true", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_graylog": "false", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_journald": "false", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_stderr": "false", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_compact_on_bootstrap": "false", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_compact_on_start": "false", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_compact_on_trim": "true", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_con_tracker_persist_interval": "10", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_con_tracker_score_halflife": "43200", 2024-05-07T11:13:05.370 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_config_key_max_entry_size": "65536", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cpu_threads": "4", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_crush_min_required_version": "hammer", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_daemon_bytes": "419430400", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_data_avail_crit": "5", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_data_avail_warn": "5", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_data_size_warn": "16106127360", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_block_osdmap_trim": "false", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_dump_json": "false", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_dump_transactions": "false", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_extra_checks": "false", 2024-05-07T11:13:05.371 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_no_require_reef": "false", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_no_require_squid": "false", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_delta_reset_interval": "10.000000", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_dns_srv_name": "ceph-mon", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_down_mkfs_grace": "120", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_down_uptime_grace": "60", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_election_default_strategy": "1", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_election_timeout": "5.000000", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_elector_ping_divisor": "2", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_elector_ping_timeout": "2.000000", 2024-05-07T11:13:05.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_enable_op_tracker": "true", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_fake_pool_delete": "false", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_force_quorum_join": "false", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_globalid_prealloc": "10000", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_detail_to_clog": "false", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_log_update_period": "5", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_max_detail": "50", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_to_clog": "true", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_to_clog_interval": "600", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_host": "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_host_override": "", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_initial_members": "", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-05-07T11:13:05.373 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_keyvaluedb": "rocksdb", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_lease": "5.000000", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_log_full_interval": "50", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_log_max": "10000", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_log_max_summary": "50", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_log_entries_per_event": "4096", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_log_epochs": "500", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_mdsmap_epochs": "500", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_mgrmap_epochs": "500", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_osd": "10000", 2024-05-07T11:13:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_pg_per_osd": "10000", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_pool_pg_num": "65536", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mds_force_trim_to": "0", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mds_skip_sanity": "false", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_memory_autotune": "true", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_memory_target": "2147483648", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_beacon_grace": "30", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_digest_period": "5", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_inactive_grace": "60", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_mkfs_grace": "240", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-05-07T11:13:05.375 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_min_osdmap_epochs": "500", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_complaint_time": "30", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_history_duration": "600", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_history_size": "20", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_history_slow_op_size": "20", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_history_slow_op_threshold": "10", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_log_threshold": "5", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_auto_mark_in": "false", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_auto_mark_new_in": "true", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-05-07T11:13:05.376 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_cache_size": "500", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_cache_size_min": "134217728", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_crush_smoke_test": "true", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_destroyed_out_interval": "600", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_down_out_interval": "600", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_force_trim_to": "0", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_full_ratio": "0.950000", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_laggy_halflife": "3600", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_laggy_max_interval": "300", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_laggy_weight": "0.300000", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_max_creating_pgs": "1024", 2024-05-07T11:13:05.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_max_initial_pgs": "1024", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_min_down_reporters": "2", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_prime_pg_temp": "true", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_report_timeout": "900", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_warn_num_repaired": "10", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_warn_op_age": "32.000000", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osdmap_full_prune_interval": "10", 2024-05-07T11:13:05.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osdmap_full_prune_min": "10000", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_stuck_threshold": "60", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_warn_min_objects": "10000", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_warn_min_per_osd": "0", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pool_quota_crit_threshold": "0", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pool_quota_warn_threshold": "0", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_probe_timeout": "2.000000", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_reweight_max_change": "0.050000", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_reweight_max_osds": "4", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-05-07T11:13:05.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_scrub_interval": "86400", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_scrub_max_keys": "100", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_scrub_timeout": "300", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_session_timeout": "300", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_smart_report_timeout": "5", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_stat_smooth_intervals": "6", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_stretch_pool_min_size": "2", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_stretch_pool_size": "4", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_subscribe_interval": "86400.000000", 2024-05-07T11:13:05.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_debug": "false", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_max_payload_keys": "2000", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_max_payload_size": "1048576", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_provider_kill_at": "0", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_requester_kill_at": "0", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_timeout": "60.000000", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_target_pg_per_osd": "100", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_tick_interval": "5", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_timecheck_interval": "300.000000", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_use_min_delay_socket": "false", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_older_version_delay": "604800", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-05-07T11:13:05.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_filestore_osds": "false", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_misplaced": "false", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_older_version": "true", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_pool_no_app": "true", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_too_few_osds": "false", 2024-05-07T11:13:05.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "monmap": "", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_tracing_enabled": "false", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_op_threads": "3", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_buffer_size": "131072", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_cm": "false", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_device_name": "", 2024-05-07T11:13:05.383 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_dscp": "96", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_gid_idx": "0", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_local_gid": "", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_polling_us": "1000", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_port_num": "1", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_roce_ver": "1", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_send_buffers": "1024", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_sl": "3", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_support_srq": "true", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_type": "ib", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_reap_threshold": "5", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_before_connect": "false", 2024-05-07T11:13:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_ipv4": "true", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_ipv6": "false", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_msgr1": "true", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_msgr2": "true", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_port_max": "7568", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_port_min": "6800", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_prefer_ipv4": "false", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_retry_count": "3", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_retry_delay": "5", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_blackhole_client": "false", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_blackhole_mds": "false", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_blackhole_mgr": "false", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_blackhole_mon": "false", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_blackhole_osd": "false", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_client_mode": "crc secure", 2024-05-07T11:13:05.385 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_cluster_mode": "crc secure", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_cluster_type": "", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_compress_secure": "false", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_connection_idle_timeout": "900", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_connection_ready_timeout": "10", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_crc_data": "true", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_crc_header": "true", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_die_on_bad_msg": "false", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_die_on_bug": "true", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_die_on_old_message": "true", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_die_on_skipped_message": "false", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_die_on_unhandled_msg": "false", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_coremask": "0xF", 2024-05-07T11:13:05.386 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_devs_allowlist": "", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_enable_tso": "true", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_hugepages": "", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_hw_flow_control": "true", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_lro": "true", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_memory_channel": "4", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_pmd": "", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_port_id": "0", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dump_corrupt_message_level": "1", 2024-05-07T11:13:05.387 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dump_on_send": "false", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_initial_backoff": "0.200000", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_delay_max": "1.000000", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_delay_probability": "0.000000", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_delay_type": "", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_internal_delays": "0.000000", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_network_congestion": "0", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_socket_failures": "0", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_learn_addr_from_peer": "true", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_max_accept_failures": "4", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_max_backoff": "15.000000", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_mon_client_mode": "secure crc", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_mon_cluster_mode": "secure crc", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_mon_service_mode": "secure crc", 2024-05-07T11:13:05.388 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_osd_compress_min_size": "1024", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_osd_compress_mode": "none", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_osd_compression_algorithm": "snappy", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_pq_min_cost": "65536", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_public_type": "", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_service_mode": "crc secure", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_tcp_listen_backlog": "512", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_tcp_nodelay": "true", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_tcp_rcvbuf": "0", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_type": "async+posix", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "no_config_file": "false", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_completion_locks_per_session": "32", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_debug_inject_relock_delay": "false", 2024-05-07T11:13:05.389 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_inflight_op_bytes": "104857600", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_inflight_ops": "1024", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_inject_no_watch_ping": "false", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_tick_interval": "5.000000", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_timeout": "10.000000", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "objectstore_blackhole": "false", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "openssl_engine_opts": "", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_delay_time": "5.000000", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_hist_halflife": "1000", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_max_low_ops": "2", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_max_ops": "4", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-05-07T11:13:05.390 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_quantize_effort": "0.100000", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_slop": "0.020000", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_allow_recovery_below_min_size": "true", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_asio_thread_count": "2", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_async_recovery_min_cost": "100", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_auto_mark_unfound_lost": "false", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backfill_retry_interval": "30.000000", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backfill_scan_max": "512", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backfill_scan_min": "64", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backoff_on_degraded": "false", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backoff_on_peering": "false", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backoff_on_unfound": "true", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_beacon_report_interval": "300", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bench_duration": "30", 2024-05-07T11:13:05.391 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bench_max_block_size": "67108864", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bench_small_size_max_iops": "100", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_blkin_trace_all": "false", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_blocked_scrub_grace_period": "120", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_check_for_log_corruption": "false", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_class_update_on_start": "true", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_client_message_cap": "256", 2024-05-07T11:13:05.392 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_client_message_size_cap": "524288000", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_client_op_priority": "63", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_client_watch_timeout": "30", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_command_max_records": "256", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_compact_on_start": "false", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_crush_chooseleaf_type": "0", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_crush_initial_weight": "-1.000000", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_crush_update_on_start": "true", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_crush_update_weight_set": "true", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_drop_ping_duration": "0", 2024-05-07T11:13:05.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_feed_pullee": "-1", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_misdirected_ops": "false", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_no_acting_change": "false", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_no_purge_strays": "false", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_op_order": "false", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_pg_log_writeout": "false", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_pretend_recovery_active": "false", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_shutdown": "false", 2024-05-07T11:13:05.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_trim_objects": "false", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_verify_cached_snaps": "false", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_verify_missing_on_start": "false", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_verify_snaps": "false", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_keys": "1024", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_stride": "524288", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-05-07T11:13:05.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_default_data_pool_replay_window": "5", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_default_notify_timeout": "30", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_delete_sleep": "0.000000", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_discard_disconnected_ops": "true", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_enable_op_tracker": "true", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_extblkdev_plugins": "vdo", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_fast_info": "true", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_fast_shutdown": "true", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-05-07T11:13:05.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_fast_shutdown_timeout": "15", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_function_tracing": "false", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_grace": "20", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_interval": "6", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_min_peers": "10", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_min_size": "2000", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_stale": "600", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_hit_set_max_size": "100000", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_hit_set_min_size": "1000", 2024-05-07T11:13:05.397 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_journal_flush_on_shutdown": "true", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_journal_size": "5120", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_kill_backfill_at": "0", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_loop_before_reset_tphandle": "64", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_map_cache_size": "50", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_map_dedup": "true", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_map_message_max": "40", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_map_message_max_bytes": "10485760", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_map_share_max_epochs": "40", 2024-05-07T11:13:05.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_attr_name_len": "100", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_attr_size": "0", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_backfills": "1", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_markdown_count": "5", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_markdown_period": "600", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_object_name_len": "2048", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_object_namespace_len": "256", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_object_size": "134217728", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_omap_entries_per_request": "1024", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_pg_blocked_by": "16", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_pg_log_entries": "10000", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_pgls": "1024", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_push_cost": "8388608", 2024-05-07T11:13:05.399 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_push_objects": "10", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_scrubs": "3", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_trimming_pgs": "2", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_write_op_reply_len": "64", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_write_size": "90", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_override_recovery_settings": "false", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_profile": "balanced", 2024-05-07T11:13:05.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_skip_benchmark": "false", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_base": "805306368", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_cache_min": "134217728", 2024-05-07T11:13:05.401 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_target": "4294967296", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_target_autotune": "false", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_min_pg_log_entries": "250", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_min_recovery_priority": "0", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mon_heartbeat_interval": "30", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mon_report_interval": "5", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mon_report_max_in_flight": "2", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_num_cache_shards": "32", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_num_op_tracker_shard": "32", 2024-05-07T11:13:05.402 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_numa_auto_affinity": "true", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_numa_node": "-1", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_numa_prefer_iface": "true", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_objecter_finishers": "1", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_objectstore": "bluestore", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_objectstore_fuse": "false", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_objectstore_tracing": "false", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_complaint_time": "30.000000", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_history_duration": "600", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_history_size": "20", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_history_slow_op_size": "20", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_log_threshold": "5", 2024-05-07T11:13:05.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_shards": "0", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_shards_hdd": "5", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_shards_ssd": "8", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_threads_per_shard": "0", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_pq_min_cost": "65536", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_queue": "mclock_scheduler", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_queue_cut_off": "high", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_thread_suicide_timeout": "150", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_thread_timeout": "15", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_open_classes_on_start": "true", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_os_flags": "0", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_peering_op_priority": "255", 2024-05-07T11:13:05.404 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_delete_cost": "1048576", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_delete_priority": "5", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_log_dups_tracked": "3000", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_log_trim_max": "10000", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_log_trim_min": "100", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_object_context_cache_count": "64", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-05-07T11:13:05.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_crimson": "false", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_crush_rule": "-1", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_ec_fast_read": "false", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flag_bulk": "false", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flag_nodelete": "false", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flags": "0", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_min_size": "0", 2024-05-07T11:13:05.406 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_pg_num": "32", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_pgp_num": "0", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_read_ratio": "70", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_size": "2", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_type": "replicated", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_use_gmt_hitset": "true", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_push_per_object_cost": "1000", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_read_ec_check_for_errors": "false", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recover_clone_overlap": "true", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recover_clone_overlap_limit": "10", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_cost": "20971520", 2024-05-07T11:13:05.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_delay_start": "0.000000", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_active": "0", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_active_hdd": "3", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_active_ssd": "10", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_chunk": "8388608", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_single_start": "1", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_op_priority": "3", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_op_warn_multiple": "16", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_priority": "5", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_retry_interval": "30.000000", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_sleep": "0.000000", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-05-07T11:13:05.408 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_repair_during_recovery": "false", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_requested_scrub_priority": "120", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_rollback_to_cluster_snap": "", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_auto_repair": "false", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_begin_hour": "0", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_begin_week_day": "0", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_chunk_max": "25", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_chunk_min": "5", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_cost": "52428800", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_disable_reservation_queuing": "true", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_during_recovery": "false", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_end_hour": "0", 2024-05-07T11:13:05.409 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_end_week_day": "0", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_event_cost": "4096", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_invalid_stats": "true", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_load_threshold": "0.500000", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_max_interval": "604800.000000", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_max_preemptions": "5", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_min_interval": "86400.000000", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_priority": "5", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_sleep": "0.000000", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_shutdown_pgref_assert": "false", 2024-05-07T11:13:05.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_skip_data_digest": "false", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_smart_report_timeout": "5", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_cost": "1048576", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_priority": "5", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_sleep": "0.000000", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_stats_update_period_scrubbing": "15", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_target_transaction_size": "30", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-05-07T11:13:05.411 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_mode": "writeback", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tracing": "false", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_use_stale_snap": "false", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "osdc_blkin_trace_all": "false", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_kill_at": "0", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_max_join_drift": "10", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_min": "500", 2024-05-07T11:13:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_min_wait": "0.050000", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_propose_interval": "1.000000", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_service_trim_max": "500", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_service_trim_max_multiplier": "20", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_service_trim_min": "250", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_stash_full_interval": "25", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_trim_max": "500", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_trim_min": "250", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "perf": "true", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "-", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrv": "", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "public_bind_addr": "-", 2024-05-07T11:13:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: "public_network": "", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "public_network_interface": "", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "qat_compressor_enabled": "false", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "qat_compressor_session_max_number": "256", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rados_mon_op_timeout": "0", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rados_osd_op_timeout": "0", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rados_tracing": "false", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_atime_update_interval": "60", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_balance_parent_reads": "false", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_balance_snap_reads": "false", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_blkin_trace_all": "false", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_blocklist_expire_seconds": "0", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_blocklist_on_break_lock": "true", 2024-05-07T11:13:05.414 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache": "true", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_block_writes_upfront": "false", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_max_dirty": "25165824", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_max_dirty_object": "0", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_policy": "writearound", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_size": "33554432", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_target_dirty": "16777216", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_clone_copy_on_read": "false", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_compression_hint": "none", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_concurrent_management_ops": "10", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_clone_format": "auto", 2024-05-07T11:13:05.415 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_data_pool": "", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_features": "61", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_format": "2", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_map_options": "", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_order": "22", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_pool": "rbd", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_stripe_count": "0", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_stripe_unit": "0", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_disable_zero_copy_writes": "true", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_discard_granularity_bytes": "65536", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_enable_alloc_hint": "true", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_io_scheduler": "simple", 2024-05-07T11:13:05.416 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_commit_age": "5.000000", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_object_flush_interval": "0", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_order": "24", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_pool": "", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_splay_width": "4", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_localize_parent_reads": "false", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_localize_snap_reads": "false", 2024-05-07T11:13:05.417 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_policy_type": "simple", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_autotune": "true", 2024-05-07T11:13:05.418 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_base": "805306368", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_target": "4294967296", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirroring_delete_delay": "0", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirroring_replay_delay": "0", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-05-07T11:13:05.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_move_to_trash_on_remove": "false", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mtime_update_interval": "60", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_non_blocking_aio": "true", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_op_thread_timeout": "60", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_op_threads": "1", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_parent_cache_enabled": "false", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_persistent_cache_mode": "disabled", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_persistent_cache_path": "/tmp", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_persistent_cache_size": "1073741824", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_plugins": "", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_bps_burst": "0", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_bps_limit": "0", 2024-05-07T11:13:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_exclude_ops": "0", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_iops_burst": "0", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_iops_limit": "0", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_bps_burst": "0", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_bps_limit": "0", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_iops_burst": "0", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_iops_limit": "0", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_schedule_tick_min": "50", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_bps_burst": "0", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_bps_limit": "0", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_iops_burst": "0", 2024-05-07T11:13:05.421 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_iops_limit": "0", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_quiesce_notification_attempts": "10", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_read_from_replica_policy": "default", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_readahead_max_bytes": "524288", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_readahead_trigger_requests": "10", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_request_timed_out_seconds": "30", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_skip_partial_discard": "true", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_tracing": "false", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_validate_names": "true", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_validate_pool": "true", 2024-05-07T11:13:05.422 INFO:teuthology.orchestra.run.smithi062.stdout: "restapi_base_url": "", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "restapi_log_level": "", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_account_default_quota_max_size": "-1", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_acl_grants_max_num": "100", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_admin_entry": "admin", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_backend_store": "rados", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_barbican_url": "", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_beast_enable_async": "true", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_counters_cache": "false", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_index_max_aio": "128", 2024-05-07T11:13:05.423 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_quota_ttl": "600", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_cache_enabled": "true", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_cache_expiry_interval": "900", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_cache_lru_size": "25000", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_config_store": "rados", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_content_length_compat": "false", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_copy_obj_progress": "true", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_cors_rules_max_num": "100", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_cross_domain_policy": "", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_default_encryption_key": "", 2024-05-07T11:13:05.424 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_addr": "", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_ca_path": "", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_client_cert": "", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_client_key": "", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_password": "", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_username": "", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_require_ssl": "true", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-05-07T11:13:05.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_suppress_logs": "true", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_addr": "", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_auth": "token", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_namespace": "", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_prefix": "", 2024-05-07T11:13:05.426 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-05-07T11:13:05.427 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-05-07T11:13:05.427 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-05-07T11:13:05.427 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-05-07T11:13:05.427 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_token_file": "", 2024-05-07T11:13:05.427 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-05-07T11:13:05.427 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_curl_buffersize": "524288", 2024-05-07T11:13:05.427 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_curl_low_speed_limit": "1024", 2024-05-07T11:13:05.427 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_curl_low_speed_time": "300", 2024-05-07T11:13:05.427 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_curl_tcp_keepalive": "0", 2024-05-07T11:13:05.427 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-05-07T11:13:05.429 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-05-07T11:13:05.429 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_fadvise": "4", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d4n_host": "127.0.0.1", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d4n_port": "6379", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_log_changes_size": "1000", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_log_num_shards": "128", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-05-07T11:13:05.430 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_log_window": "30", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_notify_interval_msec": "0", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_sync_poll_interval": "20", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_sync_spawn_window": "20", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_default_data_log_backing": "fifo", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_default_region_info_oid": "default.region", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_defer_to_bucket_acls": "", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-05-07T11:13:05.431 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_data_res": "500.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dns_name": "", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dns_s3website_name": "", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dynamic_resharding": "true", 2024-05-07T11:13:05.432 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_gc_threads": "true", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_lc_threads": "true", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_ops_log": "false", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_quota_threads": "true", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_static_website": "false", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_usage_log": "false", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enforce_swift_acls": "true", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_exit_timeout_secs": "120", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_expose_bucket": "false", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_extended_http_attrs": "", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_filter": "none", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_frontends": "beast port=7480", 2024-05-07T11:13:05.433 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_concurrent_io": "10", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_deferred": "50", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_objs": "32", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_queue_size": "134213632", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_trim_chunk": "16", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_obj_min_wait": "7200", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_processor_max_time": "3600", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_processor_period": "3600", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_get_obj_window_size": "16777216", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_healthcheck_disabling_path": "", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ignore_get_invalid_range": "false", 2024-05-07T11:13:05.434 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_init_timeout": "300", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_kafka_connection_idle": "300", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_kafka_message_timeout": "5000", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_kafka_sleep_timeout": "10", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_domain": "", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_password": "", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_password_path": "", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_project": "", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_tenant": "", 2024-05-07T11:13:05.435 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_token": "", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_token_path": "", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_user": "", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_api_version": "2", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_barbican_domain": "", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_barbican_password": "", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_barbican_project": "", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_barbican_tenant": "", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_barbican_user": "", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_implicit_tenants": "false", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_service_token_enabled": "false", 2024-05-07T11:13:05.436 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_token_cache_size": "10000", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_url": "", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_verify_ssl": "true", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_debug_interval": "-1", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_lock_max_time": "90", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_max_objs": "32", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_max_rules": "1000", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_max_worker": "3", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_max_wp_worker": "3", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_thread_delay": "0", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_dnattr": "uid", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_searchfilter": "", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-05-07T11:13:05.437 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_uri": "", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_log_http_headers": "", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_log_nonexistent_bucket": "false", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_log_object_name_utc": "false", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_attr_name_len": "0", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_attr_size": "0", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_attrs_num_in_req": "0", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_chunk_size": "4194304", 2024-05-07T11:13:05.438 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_concurrent_requests": "1024", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_dynamic_shards": "1999", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_listing_results": "1000", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_notify_retries": "10", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_objs_per_shard": "100000", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_put_param_size": "1048576", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_put_size": "5368709120", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_slo_entries": "1000", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_md_log_max_shards": "64", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_md_notify_interval_msec": "200", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_meta_sync_poll_interval": "20", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_meta_sync_spawn_window": "20", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_mp_lock_max_time": "600", 2024-05-07T11:13:05.439 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_multipart_min_part_size": "5242880", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_fhcache_size": "2017", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_lru_lanes": "5", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_max_gc": "300", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_run_gc_threads": "false", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_run_lc_threads": "false", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_run_quota_threads": "false", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_run_sync_thread": "false", 2024-05-07T11:13:05.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_num_async_rados_threads": "32", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_num_control_oids": "8", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_numa_node": "-1", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_obj_stripe_size": "4194304", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_objexp_chunk_size": "100", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_objexp_gc_interval": "600", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_objexp_hints_num_shards": "127", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_op_thread_timeout": "600", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_op_tracing": "false", 2024-05-07T11:13:05.441 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_opa_token": "", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_opa_url": "", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_opa_verify_ssl": "true", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ops_log_rados": "false", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ops_log_socket_path": "", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_period_push_interval": "2.000000", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_period_push_interval_max": "30.000000", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_period_root_pool": ".rgw.root", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-05-07T11:13:05.442 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_cache_lanes": "3", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_cache_max_buckets": "100", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_cache_partitions": "3", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_print_continue": "true", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_print_prohibited_content_length": "false", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_rados_tracing": "false", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_realm": "", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_realm_id": "", 2024-05-07T11:13:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_region": "", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_region_root_pool": ".rgw.root", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_relaxed_region_enforcement": "false", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_request_uri": "", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_batch_size": "64", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_max_aio": "128", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_num_logs": "16", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_thread_interval": "600", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_resolve_cname": "false", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_rest_getusage_op_compat": "false", 2024-05-07T11:13:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_run_sync_thread": "true", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_use_keystone": "false", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_use_ldap": "false", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_use_rados": "true", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_use_sts": "false", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_success_create_obj_status": "0", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_scheduler_type": "throttler", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_script_uri": "", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_service_provider_name": "", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_client_id": "", 2024-05-07T11:13:05.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_client_secret": "", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_entry": "sts", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_key": "sts", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_max_session_duration": "43200", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_min_session_duration": "900", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_token_introspection_url": "", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_account_in_url": "false", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_auth_entry": "auth", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_auth_url": "", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_custom_header": "", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_enforce_content_length": "false", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_need_stats": "true", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_tenant_name": "", 2024-05-07T11:13:05.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_token_expiration": "86400", 2024-05-07T11:13:05.447 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_url": "", 2024-05-07T11:13:05.447 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_url_prefix": "swift", 2024-05-07T11:13:05.447 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_versioning_enabled": "false", 2024-05-07T11:13:05.447 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-05-07T11:13:05.447 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-05-07T11:13:05.447 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_lease_period": "120", 2024-05-07T11:13:05.447 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-05-07T11:13:05.447 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_log_trim_interval": "1200", 2024-05-07T11:13:05.447 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_obj_etag_verify": "false", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_trace_history_size": "4096", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_thread_pool_size": "512", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_topic_persistency_max_retries": "0", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_topic_require_publish_policy": "false", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_comment": "", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_createby": "", 2024-05-07T11:13:05.448 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_encoding": "", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_flag": "false", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_max_size": "5368709120", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_origin": "", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_sha_unit": "524288", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_tracker": "", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_trust_forwarded_https": "false", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_usage_log_tick_interval": "30", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_usage_max_shards": "32", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_usage_max_user_shards": "1", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_use_opa_authz": "false", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_counters_cache": "false", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_counters_cache_size": "10000", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-05-07T11:13:05.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_default_quota_max_size": "-1", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_max_buckets": "1000", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_policies_max_num": "100", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_quota_sync_interval": "86400", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_unique_email": "true", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_verify_ssl": "true", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_website_routing_rules_max_num": "50", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zone": "", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zone_id": "", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-05-07T11:13:05.450 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zonegroup": "", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zonegroup_id": "", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rgwlc_auto_session_clear": "true", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rgwlc_skip_bucket_step": "false", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_block_size": "4096", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_shard_bits": "4", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_size": "536870912", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_type": "binned_lru", 2024-05-07T11:13:05.451 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_collect_compaction_stats": "false", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_collect_extended_stats": "false", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_collect_memory_stats": "false", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_index_type": "binary_search", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_log_to_ceph_log": "true", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_metadata_block_size": "4096", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_partition_filters": "false", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_perf": "false", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "rotating_keys_renewal_timeout": "10", 2024-05-07T11:13:05.452 INFO:teuthology.orchestra.run.smithi062.stdout: "run_dir": "/var/run/ceph", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_block_create": "true", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_cache_lru_size": "67108864", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_cbjournal_size": "5368709120", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_data_delta_based_overwrite": "0", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_default_max_object_size": "16777216", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_device_size": "53687091200", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_journal_batch_capacity": "16", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_journal_iodepth_limit": "5", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_main_device_type": "SSD", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_max_concurrent_transactions": "8", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-05-07T11:13:05.453 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_segment_size": "67108864", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "set_keepcaps": "false", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "setgroup": "", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "setuser": "", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "setuser_match_path": "", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_misplaced_ratio": "0.050000", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "thp": "false", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "threadpool_default_timeout": "60", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "threadpool_empty_queue_max_wait": "2", 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout: "throttler_perf_counter": "true" 2024-05-07T11:13:05.454 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:13:05.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-05-07T11:13:05.574 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a: {} 2024-05-07T11:13:05.575 INFO:teuthology.orchestra.run.smithi062.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T11:13:05.583 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b: {} 2024-05-07T11:13:05.583 INFO:teuthology.orchestra.run.smithi062.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T11:13:05.592 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c: {} 2024-05-07T11:13:05.592 INFO:teuthology.orchestra.run.smithi062.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T11:13:05.603 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-05-07T11:13:05.603 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-07T11:13:05.628 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-07T11:13:05.628 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-07T11:13:05.628 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-07T11:13:05.629 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-07T11:13:05.629 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-07T11:13:05.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:05.629 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-05-07T11:13:05.629 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-05-07T11:13:05.629 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:13:05.630 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:13:05.630 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-05-07T11:13:05.630 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-07T11:13:05.630 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-05-07T11:13:05.631 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-05-07T11:13:05.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:05.631 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-05-07T11:13:05.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:05.632 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-05-07T11:13:05.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T11:13:05.633 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:05.631+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:05.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:05.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-05-07T11:13:05.718 INFO:teuthology.orchestra.run.smithi062.stderr:Cannot find device "ceph-brx" 2024-05-07T11:13:05.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:13:05.720 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-07T11:13:05.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-07T11:13:05.732 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:05.732+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:05.750 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:05.750 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:05.759 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:05.775 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:05.775 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:05.794 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:05.794 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:05.812 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:05.812 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:05.833 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:05.833+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:05.864 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:05.864 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:05.873 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:05.935 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:05.935+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:05.949 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 15, 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "712a8431-2ac1-4386-a81f-c899bab82549", 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-05-07T11:12:28.567931+0000", 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-05-07T11:12:45.043439+0000", 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-05-07T11:12:36.689723+0000", 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-05-07T11:12:29.411691+0000", 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-05-07T11:13:05.950 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 4, 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-05-07T11:13:05.951 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:36.979175+0000", 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:05.952 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.953 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.955 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-05-07T11:13:05.956 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.9900000095367432, 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.9900000095367432, 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 2, 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 2, 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:37.110970+0000", 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:05.958 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:05.959 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:05.960 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:05.961 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.962 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.5, 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.5, 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.963 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:41.627365+0000", 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:05.964 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "14", 2024-05-07T11:13:05.965 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:05.966 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:05.967 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-05-07T11:13:05.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-05-07T11:13:05.969 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:42.384664+0000", 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:05.970 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:05.971 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:05.973 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:05.974 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:05.976 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cd7246e2-0069-4df7-a669-4abe038a28ad", 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 13, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:13:05.977 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6800", 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6801", 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:13:05.978 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6802", 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6803", 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.979 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6806", 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6807", 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:13:05.980 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6804", 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6805", 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.88:6801/1378788154", 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.88:6803/1378788154", 2024-05-07T11:13:05.981 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.88:6807/1378788154", 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.88:6805/1378788154", 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "7df5bb74-60c0-4a46-a3d1-494f777a4f88", 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:13:05.982 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 13, 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6800", 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6801", 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6802", 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6803", 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6806", 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.985 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6807", 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6804", 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6805", 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.149:6801/3051775179", 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.149:6803/3051775179", 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.149:6807/3051775179", 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.149:6805/3051775179", 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.987 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "ebed6b16-fba7-4b8a-a78e-1f84a500c31f", 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 13, 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:13:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6800", 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6801", 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.989 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6802", 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6803", 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6806", 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6807", 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6804", 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6805", 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.175:6801/2659225388", 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.175:6803/2659225388", 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.175:6807/2659225388", 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.175:6805/2659225388", 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-05-07T11:13:05.993 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.430581+0000", 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:13:05.994 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.433407+0000", 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.440186+0000", 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.995 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-05-07T11:13:05.996 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:05.997 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:13:05.999 INFO:tasks.thrashosds.thrasher:j is {'epoch': 15, 'fsid': '712a8431-2ac1-4386-a81f-c899bab82549', 'created': '2024-05-07T11:12:28.567931+0000', 'modified': '2024-05-07T11:12:45.043439+0000', 'last_up_change': '2024-05-07T11:12:36.689723+0000', 'last_in_change': '2024-05-07T11:12:29.411691+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-07T11:12:41.627365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-05-07T11:12:42.384664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'cd7246e2-0069-4df7-a669-4abe038a28ad', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6800', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6801', 'nonce': 1378788154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6802', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6803', 'nonce': 1378788154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6806', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6807', 'nonce': 1378788154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6804', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6805', 'nonce': 1378788154}]}, 'public_addr': '172.21.15.88:6801/1378788154', 'cluster_addr': '172.21.15.88:6803/1378788154', 'heartbeat_back_addr': '172.21.15.88:6807/1378788154', 'heartbeat_front_addr': '172.21.15.88:6805/1378788154', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7df5bb74-60c0-4a46-a3d1-494f777a4f88', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 3051775179}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 3051775179}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 3051775179}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 3051775179}]}, 'public_addr': '172.21.15.149:6801/3051775179', 'cluster_addr': '172.21.15.149:6803/3051775179', 'heartbeat_back_addr': '172.21.15.149:6807/3051775179', 'heartbeat_front_addr': '172.21.15.149:6805/3051775179', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'ebed6b16-fba7-4b8a-a78e-1f84a500c31f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6800', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6801', 'nonce': 2659225388}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6802', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6803', 'nonce': 2659225388}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6806', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6807', 'nonce': 2659225388}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6804', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6805', 'nonce': 2659225388}]}, 'public_addr': '172.21.15.175:6801/2659225388', 'cluster_addr': '172.21.15.175:6803/2659225388', 'heartbeat_back_addr': '172.21.15.175:6807/2659225388', 'heartbeat_front_addr': '172.21.15.175:6805/2659225388', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.430581+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.433407+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.440186+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-07T11:13:05.999 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:13:06.022 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:06.023 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:06.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:06.036 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:06.036+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:06.105 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-07T11:13:06.119 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-07T11:13:06.119 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-07T11:13:06.120 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2024-05-07T11:13:06.120 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-07T11:13:06.120 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-07T11:13:06.120 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-07T11:13:06.120 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-07T11:13:06.120 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-07T11:13:06.120 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-07T11:13:06.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:06.120 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2024-05-07T11:13:06.136 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-07T11:13:06.136 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-07T11:13:06.136 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-05-07T11:13:06.136 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-07T11:13:06.136 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-05-07T11:13:06.136 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42710sec preferred_lft 42710sec 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2024-05-07T11:13:06.137 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-07T11:13:06.138 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-07T11:13:06.138 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-07T11:13:06.138 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-07T11:13:06.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2024-05-07T11:13:06.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2024-05-07T11:13:06.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2024-05-07T11:13:06.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-07T11:13:06.138 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-07T11:13:06.139 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:06.139+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:06.147 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:06.148 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:06.157 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:06.178 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-05-07T11:13:06.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-07T11:13:06.241 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:06.241+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:06.265 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:06.265 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:06.274 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:06.312 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:06.313 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:13:06.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-07T11:13:06.324 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-05-07T11:13:06.176174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81628,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033892,"statfs":{"total":289910292480,"available":289826705408,"internally_reserved":0,"allocated":573440,"data_stored":1323805,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.235948"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051518+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:12:45.051518+0000","last_peered":"2024-05-07T11:12:45.051518+0000","last_clean":"2024-05-07T11:12:45.051518+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:12:45.051518+0000","last_undegraded":"2024-05-07T11:12:45.051518+0000","last_fullsized":"2024-05-07T11:12:45.051518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051016+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:12:45.051016+0000","last_peered":"2024-05-07T11:12:45.051016+0000","last_clean":"2024-05-07T11:12:45.051016+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:12:45.051016+0000","last_undegraded":"2024-05-07T11:12:45.051016+0000","last_fullsized":"2024-05-07T11:12:45.051016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044931+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:12:46.044931+0000","last_peered":"2024-05-07T11:12:46.044931+0000","last_clean":"2024-05-07T11:12:46.044931+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:12:46.044931+0000","last_undegraded":"2024-05-07T11:12:46.044931+0000","last_fullsized":"2024-05-07T11:12:46.044931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051123+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:12:45.051123+0000","last_peered":"2024-05-07T11:12:45.051123+0000","last_clean":"2024-05-07T11:12:45.051123+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:12:45.051123+0000","last_undegraded":"2024-05-07T11:12:45.051123+0000","last_fullsized":"2024-05-07T11:12:45.051123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044619+0000","last_change":"2024-05-07T11:12:44.054002+0000","last_active":"2024-05-07T11:12:46.044619+0000","last_peered":"2024-05-07T11:12:46.044619+0000","last_clean":"2024-05-07T11:12:46.044619+0000","last_became_active":"2024-05-07T11:12:44.053275+0000","last_became_peered":"2024-05-07T11:12:44.053275+0000","last_unstale":"2024-05-07T11:12:46.044619+0000","last_undegraded":"2024-05-07T11:12:46.044619+0000","last_fullsized":"2024-05-07T11:12:46.044619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044470+0000","last_change":"2024-05-07T11:12:44.053753+0000","last_active":"2024-05-07T11:12:46.044470+0000","last_peered":"2024-05-07T11:12:46.044470+0000","last_clean":"2024-05-07T11:12:46.044470+0000","last_became_active":"2024-05-07T11:12:44.052991+0000","last_became_peered":"2024-05-07T11:12:44.052991+0000","last_unstale":"2024-05-07T11:12:46.044470+0000","last_undegraded":"2024-05-07T11:12:46.044470+0000","last_fullsized":"2024-05-07T11:12:46.044470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044203+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:12:46.044203+0000","last_peered":"2024-05-07T11:12:46.044203+0000","last_clean":"2024-05-07T11:12:46.044203+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:12:46.044203+0000","last_undegraded":"2024-05-07T11:12:46.044203+0000","last_fullsized":"2024-05-07T11:12:46.044203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052288+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:12:45.052288+0000","last_peered":"2024-05-07T11:12:45.052288+0000","last_clean":"2024-05-07T11:12:45.052288+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:12:45.052288+0000","last_undegraded":"2024-05-07T11:12:45.052288+0000","last_fullsized":"2024-05-07T11:12:45.052288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051125+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:12:45.051125+0000","last_peered":"2024-05-07T11:12:45.051125+0000","last_clean":"2024-05-07T11:12:45.051125+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:12:45.051125+0000","last_undegraded":"2024-05-07T11:12:45.051125+0000","last_fullsized":"2024-05-07T11:12:45.051125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045295+0000","last_change":"2024-05-07T11:12:44.054308+0000","last_active":"2024-05-07T11:12:46.045295+0000","last_peered":"2024-05-07T11:12:46.045295+0000","last_clean":"2024-05-07T11:12:46.045295+0000","last_became_active":"2024-05-07T11:12:44.053809+0000","last_became_peered":"2024-05-07T11:12:44.053809+0000","last_unstale":"2024-05-07T11:12:46.045295+0000","last_undegraded":"2024-05-07T11:12:46.045295+0000","last_fullsized":"2024-05-07T11:12:46.045295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:22.261724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051159+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:12:45.051159+0000","last_peered":"2024-05-07T11:12:45.051159+0000","last_clean":"2024-05-07T11:12:45.051159+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:12:45.051159+0000","last_undegraded":"2024-05-07T11:12:45.051159+0000","last_fullsized":"2024-05-07T11:12:45.051159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050678+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:12:45.050678+0000","last_peered":"2024-05-07T11:12:45.050678+0000","last_clean":"2024-05-07T11:12:45.050678+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:12:45.050678+0000","last_undegraded":"2024-05-07T11:12:45.050678+0000","last_fullsized":"2024-05-07T11:12:45.050678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044673+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:12:46.044673+0000","last_peered":"2024-05-07T11:12:46.044673+0000","last_clean":"2024-05-07T11:12:46.044673+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:12:46.044673+0000","last_undegraded":"2024-05-07T11:12:46.044673+0000","last_fullsized":"2024-05-07T11:12:46.044673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044712+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:12:46.044712+0000","last_peered":"2024-05-07T11:12:46.044712+0000","last_clean":"2024-05-07T11:12:46.044712+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:12:46.044712+0000","last_undegraded":"2024-05-07T11:12:46.044712+0000","last_fullsized":"2024-05-07T11:12:46.044712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044199+0000","last_change":"2024-05-07T11:12:44.057719+0000","last_active":"2024-05-07T11:12:46.044199+0000","last_peered":"2024-05-07T11:12:46.044199+0000","last_clean":"2024-05-07T11:12:46.044199+0000","last_became_active":"2024-05-07T11:12:44.055208+0000","last_became_peered":"2024-05-07T11:12:44.055208+0000","last_unstale":"2024-05-07T11:12:46.044199+0000","last_undegraded":"2024-05-07T11:12:46.044199+0000","last_fullsized":"2024-05-07T11:12:46.044199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052775+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:12:45.052775+0000","last_peered":"2024-05-07T11:12:45.052775+0000","last_clean":"2024-05-07T11:12:45.052775+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:12:45.052775+0000","last_undegraded":"2024-05-07T11:12:45.052775+0000","last_fullsized":"2024-05-07T11:12:45.052775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051527+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:12:45.051527+0000","last_peered":"2024-05-07T11:12:45.051527+0000","last_clean":"2024-05-07T11:12:45.051527+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:12:45.051527+0000","last_undegraded":"2024-05-07T11:12:45.051527+0000","last_fullsized":"2024-05-07T11:12:45.051527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052169+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:12:45.052169+0000","last_peered":"2024-05-07T11:12:45.052169+0000","last_clean":"2024-05-07T11:12:45.052169+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:12:45.052169+0000","last_undegraded":"2024-05-07T11:12:45.052169+0000","last_fullsized":"2024-05-07T11:12:45.052169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045083+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:12:46.045083+0000","last_peered":"2024-05-07T11:12:46.045083+0000","last_clean":"2024-05-07T11:12:46.045083+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:12:46.045083+0000","last_undegraded":"2024-05-07T11:12:46.045083+0000","last_fullsized":"2024-05-07T11:12:46.045083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044990+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:12:46.044990+0000","last_peered":"2024-05-07T11:12:46.044990+0000","last_clean":"2024-05-07T11:12:46.044990+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:12:46.044990+0000","last_undegraded":"2024-05-07T11:12:46.044990+0000","last_fullsized":"2024-05-07T11:12:46.044990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050573+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:12:45.050573+0000","last_peered":"2024-05-07T11:12:45.050573+0000","last_clean":"2024-05-07T11:12:45.050573+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:12:45.050573+0000","last_undegraded":"2024-05-07T11:12:45.050573+0000","last_fullsized":"2024-05-07T11:12:45.050573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051210+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:12:45.051210+0000","last_peered":"2024-05-07T11:12:45.051210+0000","last_clean":"2024-05-07T11:12:45.051210+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:12:45.051210+0000","last_undegraded":"2024-05-07T11:12:45.051210+0000","last_fullsized":"2024-05-07T11:12:45.051210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050292+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:12:45.050292+0000","last_peered":"2024-05-07T11:12:45.050292+0000","last_clean":"2024-05-07T11:12:45.050292+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:12:45.050292+0000","last_undegraded":"2024-05-07T11:12:45.050292+0000","last_fullsized":"2024-05-07T11:12:45.050292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051631+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:12:45.051631+0000","last_peered":"2024-05-07T11:12:45.051631+0000","last_clean":"2024-05-07T11:12:45.051631+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:12:45.051631+0000","last_undegraded":"2024-05-07T11:12:45.051631+0000","last_fullsized":"2024-05-07T11:12:45.051631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052426+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:12:45.052426+0000","last_peered":"2024-05-07T11:12:45.052426+0000","last_clean":"2024-05-07T11:12:45.052426+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:12:45.052426+0000","last_undegraded":"2024-05-07T11:12:45.052426+0000","last_fullsized":"2024-05-07T11:12:45.052426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045205+0000","last_change":"2024-05-07T11:12:44.059023+0000","last_active":"2024-05-07T11:12:46.045205+0000","last_peered":"2024-05-07T11:12:46.045205+0000","last_clean":"2024-05-07T11:12:46.045205+0000","last_became_active":"2024-05-07T11:12:44.057224+0000","last_became_peered":"2024-05-07T11:12:44.057224+0000","last_unstale":"2024-05-07T11:12:46.045205+0000","last_undegraded":"2024-05-07T11:12:46.045205+0000","last_fullsized":"2024-05-07T11:12:46.045205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:42.813261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051596+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:12:45.051596+0000","last_peered":"2024-05-07T11:12:45.051596+0000","last_clean":"2024-05-07T11:12:45.051596+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:12:45.051596+0000","last_undegraded":"2024-05-07T11:12:45.051596+0000","last_fullsized":"2024-05-07T11:12:45.051596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051768+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:12:45.051768+0000","last_peered":"2024-05-07T11:12:45.051768+0000","last_clean":"2024-05-07T11:12:45.051768+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:12:45.051768+0000","last_undegraded":"2024-05-07T11:12:45.051768+0000","last_fullsized":"2024-05-07T11:12:45.051768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050877+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:12:45.050877+0000","last_peered":"2024-05-07T11:12:45.050877+0000","last_clean":"2024-05-07T11:12:45.050877+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:12:45.050877+0000","last_undegraded":"2024-05-07T11:12:45.050877+0000","last_fullsized":"2024-05-07T11:12:45.050877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051253+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:12:45.051253+0000","last_peered":"2024-05-07T11:12:45.051253+0000","last_clean":"2024-05-07T11:12:45.051253+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:12:45.051253+0000","last_undegraded":"2024-05-07T11:12:45.051253+0000","last_fullsized":"2024-05-07T11:12:45.051253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044454+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:12:46.044454+0000","last_peered":"2024-05-07T11:12:46.044454+0000","last_clean":"2024-05-07T11:12:46.044454+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:12:46.044454+0000","last_undegraded":"2024-05-07T11:12:46.044454+0000","last_fullsized":"2024-05-07T11:12:46.044454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051364+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:12:45.051364+0000","last_peered":"2024-05-07T11:12:45.051364+0000","last_clean":"2024-05-07T11:12:45.051364+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:12:45.051364+0000","last_undegraded":"2024-05-07T11:12:45.051364+0000","last_fullsized":"2024-05-07T11:12:45.051364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045693+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:12:46.045693+0000","last_peered":"2024-05-07T11:12:46.045693+0000","last_clean":"2024-05-07T11:12:46.045693+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:12:46.045693+0000","last_undegraded":"2024-05-07T11:12:46.045693+0000","last_fullsized":"2024-05-07T11:12:46.045693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051592+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:12:45.051592+0000","last_peered":"2024-05-07T11:12:45.051592+0000","last_clean":"2024-05-07T11:12:45.051592+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:12:45.051592+0000","last_undegraded":"2024-05-07T11:12:45.051592+0000","last_fullsized":"2024-05-07T11:12:45.051592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051735+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:12:45.051735+0000","last_peered":"2024-05-07T11:12:45.051735+0000","last_clean":"2024-05-07T11:12:45.051735+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:12:45.051735+0000","last_undegraded":"2024-05-07T11:12:45.051735+0000","last_fullsized":"2024-05-07T11:12:45.051735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052590+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:12:45.052590+0000","last_peered":"2024-05-07T11:12:45.052590+0000","last_clean":"2024-05-07T11:12:45.052590+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:12:45.052590+0000","last_undegraded":"2024-05-07T11:12:45.052590+0000","last_fullsized":"2024-05-07T11:12:45.052590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050501+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:12:45.050501+0000","last_peered":"2024-05-07T11:12:45.050501+0000","last_clean":"2024-05-07T11:12:45.050501+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:12:45.050501+0000","last_undegraded":"2024-05-07T11:12:45.050501+0000","last_fullsized":"2024-05-07T11:12:45.050501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052285+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:12:45.052285+0000","last_peered":"2024-05-07T11:12:45.052285+0000","last_clean":"2024-05-07T11:12:45.052285+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:12:45.052285+0000","last_undegraded":"2024-05-07T11:12:45.052285+0000","last_fullsized":"2024-05-07T11:12:45.052285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044458+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:12:46.044458+0000","last_peered":"2024-05-07T11:12:46.044458+0000","last_clean":"2024-05-07T11:12:46.044458+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:12:46.044458+0000","last_undegraded":"2024-05-07T11:12:46.044458+0000","last_fullsized":"2024-05-07T11:12:46.044458+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045265+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:12:46.045265+0000","last_peered":"2024-05-07T11:12:46.045265+0000","last_clean":"2024-05-07T11:12:46.045265+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:12:46.045265+0000","last_undegraded":"2024-05-07T11:12:46.045265+0000","last_fullsized":"2024-05-07T11:12:46.045265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051383+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:12:45.051383+0000","last_peered":"2024-05-07T11:12:45.051383+0000","last_clean":"2024-05-07T11:12:45.051383+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:12:45.051383+0000","last_undegraded":"2024-05-07T11:12:45.051383+0000","last_fullsized":"2024-05-07T11:12:45.051383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051540+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:12:45.051540+0000","last_peered":"2024-05-07T11:12:45.051540+0000","last_clean":"2024-05-07T11:12:45.051540+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:12:45.051540+0000","last_undegraded":"2024-05-07T11:12:45.051540+0000","last_fullsized":"2024-05-07T11:12:45.051540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050384+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:12:45.050384+0000","last_peered":"2024-05-07T11:12:45.050384+0000","last_clean":"2024-05-07T11:12:45.050384+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:12:45.050384+0000","last_undegraded":"2024-05-07T11:12:45.050384+0000","last_fullsized":"2024-05-07T11:12:45.050384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045798+0000","last_change":"2024-05-07T11:12:43.054017+0000","last_active":"2024-05-07T11:12:46.045798+0000","last_peered":"2024-05-07T11:12:46.045798+0000","last_clean":"2024-05-07T11:12:46.045798+0000","last_became_active":"2024-05-07T11:12:43.053655+0000","last_became_peered":"2024-05-07T11:12:43.053655+0000","last_unstale":"2024-05-07T11:12:46.045798+0000","last_undegraded":"2024-05-07T11:12:46.045798+0000","last_fullsized":"2024-05-07T11:12:46.045798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044896+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:12:46.044896+0000","last_peered":"2024-05-07T11:12:46.044896+0000","last_clean":"2024-05-07T11:12:46.044896+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:12:46.044896+0000","last_undegraded":"2024-05-07T11:12:46.044896+0000","last_fullsized":"2024-05-07T11:12:46.044896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045701+0000","last_change":"2024-05-07T11:12:43.053040+0000","last_active":"2024-05-07T11:12:46.045701+0000","last_peered":"2024-05-07T11:12:46.045701+0000","last_clean":"2024-05-07T11:12:46.045701+0000","last_became_active":"2024-05-07T11:12:43.052641+0000","last_became_peered":"2024-05-07T11:12:43.052641+0000","last_unstale":"2024-05-07T11:12:46.045701+0000","last_undegraded":"2024-05-07T11:12:46.045701+0000","last_fullsized":"2024-05-07T11:12:46.045701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:56:26.393747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051649+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:12:45.051649+0000","last_peered":"2024-05-07T11:12:45.051649+0000","last_clean":"2024-05-07T11:12:45.051649+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:12:45.051649+0000","last_undegraded":"2024-05-07T11:12:45.051649+0000","last_fullsized":"2024-05-07T11:12:45.051649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051857+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:12:45.051857+0000","last_peered":"2024-05-07T11:12:45.051857+0000","last_clean":"2024-05-07T11:12:45.051857+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:12:45.051857+0000","last_undegraded":"2024-05-07T11:12:45.051857+0000","last_fullsized":"2024-05-07T11:12:45.051857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045603+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:12:46.045603+0000","last_peered":"2024-05-07T11:12:46.045603+0000","last_clean":"2024-05-07T11:12:46.045603+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:12:46.045603+0000","last_undegraded":"2024-05-07T11:12:46.045603+0000","last_fullsized":"2024-05-07T11:12:46.045603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045503+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:12:46.045503+0000","last_peered":"2024-05-07T11:12:46.045503+0000","last_clean":"2024-05-07T11:12:46.045503+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:12:46.045503+0000","last_undegraded":"2024-05-07T11:12:46.045503+0000","last_fullsized":"2024-05-07T11:12:46.045503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045711+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:12:46.045711+0000","last_peered":"2024-05-07T11:12:46.045711+0000","last_clean":"2024-05-07T11:12:46.045711+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:12:46.045711+0000","last_undegraded":"2024-05-07T11:12:46.045711+0000","last_fullsized":"2024-05-07T11:12:46.045711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050653+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:12:45.050653+0000","last_peered":"2024-05-07T11:12:45.050653+0000","last_clean":"2024-05-07T11:12:45.050653+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:12:45.050653+0000","last_undegraded":"2024-05-07T11:12:45.050653+0000","last_fullsized":"2024-05-07T11:12:45.050653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044984+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:12:46.044984+0000","last_peered":"2024-05-07T11:12:46.044984+0000","last_clean":"2024-05-07T11:12:46.044984+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:12:46.044984+0000","last_undegraded":"2024-05-07T11:12:46.044984+0000","last_fullsized":"2024-05-07T11:12:46.044984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050493+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:12:45.050493+0000","last_peered":"2024-05-07T11:12:45.050493+0000","last_clean":"2024-05-07T11:12:45.050493+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:12:45.050493+0000","last_undegraded":"2024-05-07T11:12:45.050493+0000","last_fullsized":"2024-05-07T11:12:45.050493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052487+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:12:45.052487+0000","last_peered":"2024-05-07T11:12:45.052487+0000","last_clean":"2024-05-07T11:12:45.052487+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:12:45.052487+0000","last_undegraded":"2024-05-07T11:12:45.052487+0000","last_fullsized":"2024-05-07T11:12:45.052487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045027+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:12:46.045027+0000","last_peered":"2024-05-07T11:12:46.045027+0000","last_clean":"2024-05-07T11:12:46.045027+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:12:46.045027+0000","last_undegraded":"2024-05-07T11:12:46.045027+0000","last_fullsized":"2024-05-07T11:12:46.045027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045735+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:12:46.045735+0000","last_peered":"2024-05-07T11:12:46.045735+0000","last_clean":"2024-05-07T11:12:46.045735+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:12:46.045735+0000","last_undegraded":"2024-05-07T11:12:46.045735+0000","last_fullsized":"2024-05-07T11:12:46.045735+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051913+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:12:45.051913+0000","last_peered":"2024-05-07T11:12:45.051913+0000","last_clean":"2024-05-07T11:12:45.051913+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:12:45.051913+0000","last_undegraded":"2024-05-07T11:12:45.051913+0000","last_fullsized":"2024-05-07T11:12:45.051913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045790+0000","last_change":"2024-05-07T11:12:44.059544+0000","last_active":"2024-05-07T11:12:46.045790+0000","last_peered":"2024-05-07T11:12:46.045790+0000","last_clean":"2024-05-07T11:12:46.045790+0000","last_became_active":"2024-05-07T11:12:44.058884+0000","last_became_peered":"2024-05-07T11:12:44.058884+0000","last_unstale":"2024-05-07T11:12:46.045790+0000","last_undegraded":"2024-05-07T11:12:46.045790+0000","last_fullsized":"2024-05-07T11:12:46.045790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:46:22.416221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044746+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:12:46.044746+0000","last_peered":"2024-05-07T11:12:46.044746+0000","last_clean":"2024-05-07T11:12:46.044746+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:12:46.044746+0000","last_undegraded":"2024-05-07T11:12:46.044746+0000","last_fullsized":"2024-05-07T11:12:46.044746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051566+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:12:45.051566+0000","last_peered":"2024-05-07T11:12:45.051566+0000","last_clean":"2024-05-07T11:12:45.051566+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:12:45.051566+0000","last_undegraded":"2024-05-07T11:12:45.051566+0000","last_fullsized":"2024-05-07T11:12:45.051566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051280+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:12:45.051280+0000","last_peered":"2024-05-07T11:12:45.051280+0000","last_clean":"2024-05-07T11:12:45.051280+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:12:45.051280+0000","last_undegraded":"2024-05-07T11:12:45.051280+0000","last_fullsized":"2024-05-07T11:12:45.051280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051628+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:12:45.051628+0000","last_peered":"2024-05-07T11:12:45.051628+0000","last_clean":"2024-05-07T11:12:45.051628+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:12:45.051628+0000","last_undegraded":"2024-05-07T11:12:45.051628+0000","last_fullsized":"2024-05-07T11:12:45.051628+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050743+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:12:45.050743+0000","last_peered":"2024-05-07T11:12:45.050743+0000","last_clean":"2024-05-07T11:12:45.050743+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:12:45.050743+0000","last_undegraded":"2024-05-07T11:12:45.050743+0000","last_fullsized":"2024-05-07T11:12:45.050743+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052485+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:12:45.052485+0000","last_peered":"2024-05-07T11:12:45.052485+0000","last_clean":"2024-05-07T11:12:45.052485+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:12:45.052485+0000","last_undegraded":"2024-05-07T11:12:45.052485+0000","last_fullsized":"2024-05-07T11:12:45.052485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045587+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:12:46.045587+0000","last_peered":"2024-05-07T11:12:46.045587+0000","last_clean":"2024-05-07T11:12:46.045587+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:12:46.045587+0000","last_undegraded":"2024-05-07T11:12:46.045587+0000","last_fullsized":"2024-05-07T11:12:46.045587+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045708+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:12:46.045708+0000","last_peered":"2024-05-07T11:12:46.045708+0000","last_clean":"2024-05-07T11:12:46.045708+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:12:46.045708+0000","last_undegraded":"2024-05-07T11:12:46.045708+0000","last_fullsized":"2024-05-07T11:12:46.045708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052318+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:12:45.052318+0000","last_peered":"2024-05-07T11:12:45.052318+0000","last_clean":"2024-05-07T11:12:45.052318+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:12:45.052318+0000","last_undegraded":"2024-05-07T11:12:45.052318+0000","last_fullsized":"2024-05-07T11:12:45.052318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045850+0000","last_change":"2024-05-07T11:12:43.053188+0000","last_active":"2024-05-07T11:12:46.045850+0000","last_peered":"2024-05-07T11:12:46.045850+0000","last_clean":"2024-05-07T11:12:46.045850+0000","last_became_active":"2024-05-07T11:12:43.052570+0000","last_became_peered":"2024-05-07T11:12:43.052570+0000","last_unstale":"2024-05-07T11:12:46.045850+0000","last_undegraded":"2024-05-07T11:12:46.045850+0000","last_fullsized":"2024-05-07T11:12:46.045850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052376+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:12:45.052376+0000","last_peered":"2024-05-07T11:12:45.052376+0000","last_clean":"2024-05-07T11:12:45.052376+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:12:45.052376+0000","last_undegraded":"2024-05-07T11:12:45.052376+0000","last_fullsized":"2024-05-07T11:12:45.052376+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050802+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:12:45.050802+0000","last_peered":"2024-05-07T11:12:45.050802+0000","last_clean":"2024-05-07T11:12:45.050802+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:12:45.050802+0000","last_undegraded":"2024-05-07T11:12:45.050802+0000","last_fullsized":"2024-05-07T11:12:45.050802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052342+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:12:45.052342+0000","last_peered":"2024-05-07T11:12:45.052342+0000","last_clean":"2024-05-07T11:12:45.052342+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:12:45.052342+0000","last_undegraded":"2024-05-07T11:12:45.052342+0000","last_fullsized":"2024-05-07T11:12:45.052342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051790+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:12:45.051790+0000","last_peered":"2024-05-07T11:12:45.051790+0000","last_clean":"2024-05-07T11:12:45.051790+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:12:45.051790+0000","last_undegraded":"2024-05-07T11:12:45.051790+0000","last_fullsized":"2024-05-07T11:12:45.051790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050741+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:12:45.050741+0000","last_peered":"2024-05-07T11:12:45.050741+0000","last_clean":"2024-05-07T11:12:45.050741+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:12:45.050741+0000","last_undegraded":"2024-05-07T11:12:45.050741+0000","last_fullsized":"2024-05-07T11:12:45.050741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052758+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:12:45.052758+0000","last_peered":"2024-05-07T11:12:45.052758+0000","last_clean":"2024-05-07T11:12:45.052758+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:12:45.052758+0000","last_undegraded":"2024-05-07T11:12:45.052758+0000","last_fullsized":"2024-05-07T11:12:45.052758+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052643+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:12:45.052643+0000","last_peered":"2024-05-07T11:12:45.052643+0000","last_clean":"2024-05-07T11:12:45.052643+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:12:45.052643+0000","last_undegraded":"2024-05-07T11:12:45.052643+0000","last_fullsized":"2024-05-07T11:12:45.052643+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051464+0000","last_change":"2024-05-07T11:12:44.056491+0000","last_active":"2024-05-07T11:12:45.051464+0000","last_peered":"2024-05-07T11:12:45.051464+0000","last_clean":"2024-05-07T11:12:45.051464+0000","last_became_active":"2024-05-07T11:12:44.056196+0000","last_became_peered":"2024-05-07T11:12:44.056196+0000","last_unstale":"2024-05-07T11:12:45.051464+0000","last_undegraded":"2024-05-07T11:12:45.051464+0000","last_fullsized":"2024-05-07T11:12:45.051464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.043497+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:12:46.043497+0000","last_peered":"2024-05-07T11:12:46.043497+0000","last_clean":"2024-05-07T11:12:46.043497+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:12:46.043497+0000","last_undegraded":"2024-05-07T11:12:46.043497+0000","last_fullsized":"2024-05-07T11:12:46.043497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045228+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:12:46.045228+0000","last_peered":"2024-05-07T11:12:46.045228+0000","last_clean":"2024-05-07T11:12:46.045228+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:12:46.045228+0000","last_undegraded":"2024-05-07T11:12:46.045228+0000","last_fullsized":"2024-05-07T11:12:46.045228+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050439+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:12:45.050439+0000","last_peered":"2024-05-07T11:12:45.050439+0000","last_clean":"2024-05-07T11:12:45.050439+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:12:45.050439+0000","last_undegraded":"2024-05-07T11:12:45.050439+0000","last_fullsized":"2024-05-07T11:12:45.050439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045214+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:12:46.045214+0000","last_peered":"2024-05-07T11:12:46.045214+0000","last_clean":"2024-05-07T11:12:46.045214+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:12:46.045214+0000","last_undegraded":"2024-05-07T11:12:46.045214+0000","last_fullsized":"2024-05-07T11:12:46.045214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051515+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:12:45.051515+0000","last_peered":"2024-05-07T11:12:45.051515+0000","last_clean":"2024-05-07T11:12:45.051515+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:12:45.051515+0000","last_undegraded":"2024-05-07T11:12:45.051515+0000","last_fullsized":"2024-05-07T11:12:45.051515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051787+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:12:45.051787+0000","last_peered":"2024-05-07T11:12:45.051787+0000","last_clean":"2024-05-07T11:12:45.051787+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:12:45.051787+0000","last_undegraded":"2024-05-07T11:12:45.051787+0000","last_fullsized":"2024-05-07T11:12:45.051787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045566+0000","last_change":"2024-05-07T11:12:43.053163+0000","last_active":"2024-05-07T11:12:46.045566+0000","last_peered":"2024-05-07T11:12:46.045566+0000","last_clean":"2024-05-07T11:12:46.045566+0000","last_became_active":"2024-05-07T11:12:43.052490+0000","last_became_peered":"2024-05-07T11:12:43.052490+0000","last_unstale":"2024-05-07T11:12:46.045566+0000","last_undegraded":"2024-05-07T11:12:46.045566+0000","last_fullsized":"2024-05-07T11:12:46.045566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051421+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:12:45.051421+0000","last_peered":"2024-05-07T11:12:45.051421+0000","last_clean":"2024-05-07T11:12:45.051421+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:12:45.051421+0000","last_undegraded":"2024-05-07T11:12:45.051421+0000","last_fullsized":"2024-05-07T11:12:45.051421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052690+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:12:45.052690+0000","last_peered":"2024-05-07T11:12:45.052690+0000","last_clean":"2024-05-07T11:12:45.052690+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:12:45.052690+0000","last_undegraded":"2024-05-07T11:12:45.052690+0000","last_fullsized":"2024-05-07T11:12:45.052690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051438+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:12:45.051438+0000","last_peered":"2024-05-07T11:12:45.051438+0000","last_clean":"2024-05-07T11:12:45.051438+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:12:45.051438+0000","last_undegraded":"2024-05-07T11:12:45.051438+0000","last_fullsized":"2024-05-07T11:12:45.051438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051706+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:12:45.051706+0000","last_peered":"2024-05-07T11:12:45.051706+0000","last_clean":"2024-05-07T11:12:45.051706+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:12:45.051706+0000","last_undegraded":"2024-05-07T11:12:45.051706+0000","last_fullsized":"2024-05-07T11:12:45.051706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051696+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:12:45.051696+0000","last_peered":"2024-05-07T11:12:45.051696+0000","last_clean":"2024-05-07T11:12:45.051696+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:12:45.051696+0000","last_undegraded":"2024-05-07T11:12:45.051696+0000","last_fullsized":"2024-05-07T11:12:45.051696+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052275+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:12:45.052275+0000","last_peered":"2024-05-07T11:12:45.052275+0000","last_clean":"2024-05-07T11:12:45.052275+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:12:45.052275+0000","last_undegraded":"2024-05-07T11:12:45.052275+0000","last_fullsized":"2024-05-07T11:12:45.052275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051505+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:12:45.051505+0000","last_peered":"2024-05-07T11:12:45.051505+0000","last_clean":"2024-05-07T11:12:45.051505+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:12:45.051505+0000","last_undegraded":"2024-05-07T11:12:45.051505+0000","last_fullsized":"2024-05-07T11:12:45.051505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051445+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:12:45.051445+0000","last_peered":"2024-05-07T11:12:45.051445+0000","last_clean":"2024-05-07T11:12:45.051445+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:12:45.051445+0000","last_undegraded":"2024-05-07T11:12:45.051445+0000","last_fullsized":"2024-05-07T11:12:45.051445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.050944+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:12:45.050944+0000","last_peered":"2024-05-07T11:12:45.050944+0000","last_clean":"2024-05-07T11:12:45.050944+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:12:45.050944+0000","last_undegraded":"2024-05-07T11:12:45.050944+0000","last_fullsized":"2024-05-07T11:12:45.050944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051008+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:12:45.051008+0000","last_peered":"2024-05-07T11:12:45.051008+0000","last_clean":"2024-05-07T11:12:45.051008+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:12:45.051008+0000","last_undegraded":"2024-05-07T11:12:45.051008+0000","last_fullsized":"2024-05-07T11:12:45.051008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051044+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:12:45.051044+0000","last_peered":"2024-05-07T11:12:45.051044+0000","last_clean":"2024-05-07T11:12:45.051044+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:12:45.051044+0000","last_undegraded":"2024-05-07T11:12:45.051044+0000","last_fullsized":"2024-05-07T11:12:45.051044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044713+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:12:46.044713+0000","last_peered":"2024-05-07T11:12:46.044713+0000","last_clean":"2024-05-07T11:12:46.044713+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:12:46.044713+0000","last_undegraded":"2024-05-07T11:12:46.044713+0000","last_fullsized":"2024-05-07T11:12:46.044713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045230+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:12:46.045230+0000","last_peered":"2024-05-07T11:12:46.045230+0000","last_clean":"2024-05-07T11:12:46.045230+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:12:46.045230+0000","last_undegraded":"2024-05-07T11:12:46.045230+0000","last_fullsized":"2024-05-07T11:12:46.045230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.045154+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:12:46.045154+0000","last_peered":"2024-05-07T11:12:46.045154+0000","last_clean":"2024-05-07T11:12:46.045154+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:12:46.045154+0000","last_undegraded":"2024-05-07T11:12:46.045154+0000","last_fullsized":"2024-05-07T11:12:46.045154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051665+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:12:45.051665+0000","last_peered":"2024-05-07T11:12:45.051665+0000","last_clean":"2024-05-07T11:12:45.051665+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:12:45.051665+0000","last_undegraded":"2024-05-07T11:12:45.051665+0000","last_fullsized":"2024-05-07T11:12:45.051665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.051165+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:12:45.051165+0000","last_peered":"2024-05-07T11:12:45.051165+0000","last_clean":"2024-05-07T11:12:45.051165+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:12:45.051165+0000","last_undegraded":"2024-05-07T11:12:45.051165+0000","last_fullsized":"2024-05-07T11:12:45.051165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052504+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:12:45.052504+0000","last_peered":"2024-05-07T11:12:45.052504+0000","last_clean":"2024-05-07T11:12:45.052504+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:12:45.052504+0000","last_undegraded":"2024-05-07T11:12:45.052504+0000","last_fullsized":"2024-05-07T11:12:45.052504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:46.044918+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:12:46.044918+0000","last_peered":"2024-05-07T11:12:46.044918+0000","last_clean":"2024-05-07T11:12:46.044918+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:12:46.044918+0000","last_undegraded":"2024-05-07T11:12:46.044918+0000","last_fullsized":"2024-05-07T11:12:46.044918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-07T11:12:45.052615+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:12:45.052615+0000","last_peered":"2024-05-07T11:12:45.052615+0000","last_clean":"2024-05-07T11:12:45.052615+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:12:45.052615+0000","last_undegraded":"2024-05-07T11:12:45.052615+0000","last_fullsized":"2024-05-07T11:12:45.052615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":638861,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":638245,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:13:06.328 INFO:tasks.thrashosds.thrasher:Setting 4.0 to [2, 0] 2024-05-07T11:13:06.328 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.0', '2', '0'] 2024-05-07T11:13:06.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.0 2 0 2024-05-07T11:13:06.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:06.329 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-07T11:13:06.342 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:06.341+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:06.379 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:06.379 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:06.387 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:06.392 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-05-07T11:13:06.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:06.394 DEBUG:teuthology.orchestra.run.smithi062:> route 2024-05-07T11:13:06.442 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:06.442+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:06.463 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2024-05-07T11:13:06.463 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-07T11:13:06.463 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-07T11:13:06.464 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-07T11:13:06.464 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-07T11:13:06.464 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-07T11:13:06.464 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-07T11:13:06.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-07T11:13:06.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-07T11:13:06.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-07T11:13:06.464 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-07T11:13:06.505 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:06.505 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:06.515 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:06.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-07T11:13:06.556 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:06.556+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:06.644 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:06.644+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:06.661 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:06.661 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:06.672 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:06.745 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:06.745+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:06.777 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:06.778 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-07T11:13:06.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:06.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:06.790 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-05-07T11:13:06.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:06.806 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2024-05-07T11:13:06.846 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:06.846+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:06.861 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-07T11:13:06.862 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-07T11:13:06.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-07T11:13:06.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-07T11:13:06.862 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-07T11:13:06.892 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:06.892 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:06.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:06.947 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:06.948+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:06.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-07T11:13:06.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-07T11:13:06.983 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-07T11:13:06.984 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-07T11:13:06.984 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-07T11:13:06.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-07T11:13:06.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-07T11:13:06.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-07T11:13:06.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-07T11:13:06.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-07T11:13:06.984 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-07T11:13:07.007 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:07.007 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:07.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:07.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-07T11:13:07.059 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:07.059+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:07.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-07T11:13:07.121 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-07T11:13:07.121 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-07T11:13:07.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2024-05-07T11:13:07.122 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2024-05-07T11:13:07.122 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-07T11:13:07.123 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:07.123 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:07.132 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-07T11:13:07.176 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:07.176+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:07.182 INFO:teuthology.orchestra.run.smithi062.stderr:set 4.0 pg_upmap mapping to [2,0] 2024-05-07T11:13:07.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-07T11:13:07.207 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-07T11:13:07.208 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-07T11:13:07.208 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-07T11:13:07.251 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:07.250+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:07.251 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:07.251 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:07.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:07.263 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-07T11:13:07.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-07T11:13:07.264 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-07T11:13:07.319 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2024-05-07T11:13:07.351 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:07.350+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:07.385 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2024-05-07T11:13:07.407 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:07.407 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:07.416 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:07.442 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2024-05-07T11:13:07.442 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2024-05-07T11:13:07.442 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2024-05-07T11:13:07.442 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2024-05-07T11:13:07.442 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2024-05-07T11:13:07.442 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2024-05-07T11:13:07.442 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2024-05-07T11:13:07.442 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2024-05-07T11:13:07.442 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-07T11:13:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2024-05-07T11:13:07.444 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2024-05-07T11:13:07.444 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2024-05-07T11:13:07.444 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2024-05-07T11:13:07.444 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-07T11:13:07.444 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-07T11:13:07.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:07.444 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2024-05-07T11:13:07.451 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:07.451+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:07.501 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-07T11:13:07.501 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-07T11:13:07.521 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:07.522 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:07.530 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:07.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2024-05-07T11:13:07.569 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2024-05-07T11:13:07.574 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:07.574+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:07.626 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2024-05-07T11:13:07.626 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2024-05-07T11:13:07.627 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-07T11:13:07.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:07.629 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2024-05-07T11:13:07.638 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:07.638 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:07.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:2024-05-07T11:13:07.642+0000 7fe2f13b4480 -1 init, newargv = 0x562199d52830 newargc=15 2024-05-07T11:13:07.643 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[32748]: starting ceph client 2024-05-07T11:13:07.647 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:07.648 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[32748]: starting fuse 2024-05-07T11:13:07.659 INFO:teuthology.orchestra.run.smithi062.stdout:41 2024-05-07T11:13:07.659 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-07T11:13:07.659 DEBUG:teuthology.orchestra.run.smithi062:> sudo stdin-killer -- python3 -c ' 2024-05-07T11:13:07.659 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2024-05-07T11:13:07.659 DEBUG:teuthology.orchestra.run.smithi062:> import re 2024-05-07T11:13:07.659 DEBUG:teuthology.orchestra.run.smithi062:> import os 2024-05-07T11:13:07.659 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2024-05-07T11:13:07.659 DEBUG:teuthology.orchestra.run.smithi062:> 2024-05-07T11:13:07.659 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-07T11:13:07.660 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2024-05-07T11:13:07.661 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2024-05-07T11:13:07.661 DEBUG:teuthology.orchestra.run.smithi062:> return f 2024-05-07T11:13:07.661 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-07T11:13:07.661 DEBUG:teuthology.orchestra.run.smithi062:> 2024-05-07T11:13:07.661 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.0")) 2024-05-07T11:13:07.661 DEBUG:teuthology.orchestra.run.smithi062:> ' 2024-05-07T11:13:07.688 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:07.688+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:07.754 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:07.753+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:07.782 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.0.32748.asok 2024-05-07T11:13:07.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-07T11:13:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-07T11:13:07.792 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:07.792 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:07.793 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32748.asok 2024-05-07T11:13:07.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:07.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32748.asok status 2024-05-07T11:13:07.802 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:07.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:07.886 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:07.886+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:07.934 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:13:07.934 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": { 2024-05-07T11:13:07.934 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_sha1": "b05eb2754514c6559f7c34d831877d418ea3a9c7", 2024-05-07T11:13:07.934 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 19.0.0-2504-gb05eb275 (b05eb2754514c6559f7c34d831877d418ea3a9c7) squid (dev)", 2024-05-07T11:13:07.935 INFO:teuthology.orchestra.run.smithi062.stdout: "entity_id": "0", 2024-05-07T11:13:07.935 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": "smithi062", 2024-05-07T11:13:07.935 INFO:teuthology.orchestra.run.smithi062.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-07T11:13:07.935 INFO:teuthology.orchestra.run.smithi062.stdout: "pid": "32748", 2024-05-07T11:13:07.935 INFO:teuthology.orchestra.run.smithi062.stdout: "root": "/" 2024-05-07T11:13:07.935 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:07.936 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_count": 0, 2024-05-07T11:13:07.936 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_pinned_count": 0, 2024-05-07T11:13:07.936 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4549, 2024-05-07T11:13:07.936 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2024-05-07T11:13:07.936 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2024-05-07T11:13:07.936 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2024-05-07T11:13:07.937 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 4549 2024-05-07T11:13:07.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:07.937 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2024-05-07T11:13:07.937 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:07.937 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2024-05-07T11:13:07.937 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2574162390 2024-05-07T11:13:07.937 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:07.938 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:07.938 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2024-05-07T11:13:07.938 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:07.938 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2024-05-07T11:13:07.938 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2574162390 2024-05-07T11:13:07.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:07.939 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.4549 192.168.0.1:0/2574162390", 2024-05-07T11:13:07.939 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "192.168.0.1:0/2574162390", 2024-05-07T11:13:07.939 INFO:teuthology.orchestra.run.smithi062.stdout: "inode_count": 1, 2024-05-07T11:13:07.939 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_epoch": 5, 2024-05-07T11:13:07.939 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch": 17, 2024-05-07T11:13:07.940 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch_barrier": 0, 2024-05-07T11:13:07.940 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklisted": false, 2024-05-07T11:13:07.940 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs" 2024-05-07T11:13:07.940 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:13:07.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:07.945 DEBUG:teuthology.orchestra.run.smithi062:> stat --file-system '--printf=%T 2024-05-07T11:13:07.945 DEBUG:teuthology.orchestra.run.smithi062:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-07T11:13:07.947 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:07.948 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:07.956 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:07.955+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:07.957 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:07.962 INFO:teuthology.orchestra.run.smithi062.stdout:fuseblk 2024-05-07T11:13:07.962 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-07T11:13:07.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:13:07.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-07T11:13:07.963 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:07.964 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:07.982 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:07.983 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:07.989 INFO:teuthology.run_tasks:Running task workunit... 2024-05-07T11:13:08.001 INFO:tasks.workunit:Pulling workunits from ref 510b35d4b766757579df5fd9efd2f892309f09e1 2024-05-07T11:13:08.001 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-07T11:13:08.001 INFO:tasks.workunit:timeout=6h 2024-05-07T11:13:08.001 INFO:tasks.workunit:cleanup=True 2024-05-07T11:13:08.001 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-07T11:13:08.002 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:08.002 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:08.018 INFO:teuthology.orchestra.run.smithi062.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-07T11:13:08.018 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-07T11:13:08.018 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-05-07T11:13:08.018 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T11:13:08.018 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-07T11:13:08.019 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-07T11:13:08.019 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-07 11:12:44.039086374 +0000 2024-05-07T11:13:08.019 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-07 11:13:07.988010692 +0000 2024-05-07T11:13:08.019 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-05-07T11:13:08.019 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-07T11:13:08.019 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-07T11:13:08.056 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:08.056+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:08.070 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:08.070 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:08.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:08.089 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 510b35d4b766757579df5fd9efd2f892309f09e1 2024-05-07T11:13:08.145 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-07T11:13:08.158 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:08.157+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:08.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T11:13:08.225 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:08.225 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:08.225 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:08.225 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:08.225 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:08.233 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:08.259 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:08.258+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:08.339 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.295288426999999, 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.295223707000002, 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.295126766999999, 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:08.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:08.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:08.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:08.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:08.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:08.359 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.295061429, 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:08.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:08.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:08.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:08.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:08.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.295034536999999, 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.366 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:08.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:08.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.295006958999998, 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.372 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.377 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.294971570000001, 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.381 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.294945963, 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:08.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:08.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:08.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:08.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.294916532999999, 2024-05-07T11:13:08.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:08.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:08.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.292530558999999, 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:08.390 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:08.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:08.393 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.288272020000001, 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:08.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.287624016999999, 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:08.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:08.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.286978697999999, 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.286705134000002, 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.407 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:08.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:08.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:08.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:08.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:08.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.285945130000002, 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.412 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.285360511, 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.416 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:08.419 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056476+0000", 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.281678087, 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023376000000000001, 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056476+0000", 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056476+0000", 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056477+0000", 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2299999999999999e-07 2024-05-07T11:13:08.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056483+0000", 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7320000000000003e-06 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056492+0000", 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056515+0000", 2024-05-07T11:13:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2775000000000001e-05 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056595+0000", 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9728000000000006e-05 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056602+0000", 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399999999999998e-06 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056710+0000", 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000107889 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.281603702000002, 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.424 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:08.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:08.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:08.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.280935455000002, 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000234329, 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3000000000000002e-07 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057222+0000", 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0800000000000002e-06 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057231+0000", 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3729999999999993e-06 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057240+0000", 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2779999999999999e-06 2024-05-07T11:13:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057351+0000", 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000111354 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057453+0000", 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000101914 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.431 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.296587668000001, 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:08.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:08.436 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.437 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:08.437 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:08.437 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:08.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:08.439 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:08.438+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:08.540 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:08.540+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:08.557 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:08.557 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:08.557 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:08.557 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:08.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:08.641 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:08.641+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:08.714 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:08.714 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:08.714 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:08.714 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:08.714 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:08.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:08.742 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:08.742+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:08.829 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:08.829 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:08.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:08.829 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:08.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.829 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:08.829 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.062017769000001, 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.833 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.395462612999999, 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.165855521000001, 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:08.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.165180347, 2024-05-07T11:13:08.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:08.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.164538526000001, 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.850 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.164070118000001, 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:08.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.161364596999999, 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.855 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:08.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.859 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.784048215999999, 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:08.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:08.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.783991441000001, 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.865 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.783962970000001, 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.871 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:08.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:08.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:08.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.783924175999999, 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:08.877 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:08.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.783880852999999, 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.883 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:08.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:08.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:08.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:08.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.783858301999999, 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.783834242000001, 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:08.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:08.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:08.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:08.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.900 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.783815281999999, 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.783788609999998, 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:08.909 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.779284350000001, 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:08.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:08.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:08.913 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.777557822999999, 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.777405489, 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.921 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.777352517000001, 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:08.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.926 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:08.926 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:08.926 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:08.927 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:08.927 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:08.926+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:09.028 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:09.027+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:09.040 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:09.040 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:09.040 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:09.040 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:09.049 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:09.129 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:09.129+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:09.154 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:09.154 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:09.155 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:09.155 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:09.155 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:09.163 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:09.187 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-05-07T11:13:09.230 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:09.230+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:09.271 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.322435251000002, 2024-05-07T11:13:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.998209364000001, 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.837733964999998, 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.837647597, 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:09.294 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.608500163999999, 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:09.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:09.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:09.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:09.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.608452699000001, 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:09.300 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:09.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:09.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:09.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.226540311000001, 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.311 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.224345227000001, 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:09.317 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.224117007, 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:09.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:09.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.223937877000001, 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.323 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:09.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:09.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:09.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:09.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:09.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:09.331 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.223878002999999, 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:09.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:09.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:09.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.223829831, 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:09.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:09.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:09.341 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.223801849000001, 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.223768839000002, 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.347 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:09.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:09.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:09.352 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.223675034999999, 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:09.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:09.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.223531593000001, 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:09.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:09.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:09.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.223346687999999, 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:09.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:09.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:09.369 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.223187618000001, 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:09.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.222744208999998, 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.375 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:09.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.222718945, 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:09.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:09.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:09.384 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:09.386 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:09.385+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:09.386 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:09.486 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:09.486+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:09.497 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:09.497 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:09.497 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:09.497 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:09.506 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:09.587 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:09.587+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:09.651 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:09.651 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:09.651 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:09.651 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:09.652 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:09.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:09.688 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:09.688+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.722331535999999, 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.767 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:09.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.722266816000001, 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.722169875999999, 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.722104538, 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.722077645999999, 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.722050068000001, 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:09.803 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.722014679000001, 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:09.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:09.807 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.721989072, 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:09.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:09.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.721959642000002, 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.812 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.719573667999999, 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:09.816 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.819 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.715315129, 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:09.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.714667125999998, 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.824 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:09.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:09.828 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.714021807000002, 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.713748243000001, 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:09.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:09.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:09.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.712988239000001, 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:09.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:09.840 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.71240362, 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:09.844 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.708646811000001, 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.848 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.707978564000001, 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000234329, 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3000000000000002e-07 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057222+0000", 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0800000000000002e-06 2024-05-07T11:13:09.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057231+0000", 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3729999999999993e-06 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057240+0000", 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2779999999999999e-06 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057351+0000", 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000111354 2024-05-07T11:13:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057453+0000", 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000101914 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.723630777, 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.852 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:09.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.857 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.72114033200000005, 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:09.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:09.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:09.863 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:09.865 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:09.865 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:09.864+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:09.965 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:09.965+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:09.979 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:09.979 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:09.980 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:09.980 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:09.988 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:10.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:10.066 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:10.066+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:10.094 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:10.094 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:10.094 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:10.094 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:10.094 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:10.103 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:10.153 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:10.153 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:10.167 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:10.166+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:10.172 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:10.172 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:10.190 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:10.190 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:10.208 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:10.208 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:10.218 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:10.267 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:10.267+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:10.336 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:10.336 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:10.346 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:10.368 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:10.368+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:10.451 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:10.451 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:10.459 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:10.503 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:10.503+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:10.565 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:10.566 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:10.570 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:10.570+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:10.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:10.671 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:10.670+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:10.692 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:10.692 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:10.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:10.772 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:10.772+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:10.807 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:10.807 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:10.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:10.873 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:10.872+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:10.920 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:10.920 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:10.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:10.974 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:10.974+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:11.041 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:11.042 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:11.051 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:11.074 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:11.074+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:11.175 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:11.175+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:11.197 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:11.197 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:11.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:13:11.206 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:11.276 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:11.276+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:11.310 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:11.311 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:11.319 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:11.376 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:11.376+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:11.430 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:11.430 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:11.439 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:11.482 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:11.482+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:11.543 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:11.544 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:11.553 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:11.594 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:11.594+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:11.679 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:11.678+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:11.698 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:11.699 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:11.708 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:11.779 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:11.779+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:11.819 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:11.819 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:11.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:11.912 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:11.912+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:11.974 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:11.974 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:11.981 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:11.980+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:11.983 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:12.081 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:12.081+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:12.131 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:12.131 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:12.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:12.182 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:12.182+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:12.196 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:13:12.201 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:13:12.201 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:13:12.201 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-05-07T11:13:12.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-05-07T11:13:12.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:12.256 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:12.256 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:12.265 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:12.308 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:12.308+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:12.351 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:12.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-05-07T11:13:12.371 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:12.371 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:12.378 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:12.378 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:12.379 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:12.396 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:12.397 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:12.420 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:12.420+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:12.486 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:12.485+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:12.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-05-07T11:13:12.528 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:12.528 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:12.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:12.528 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:12.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.528 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:12.528 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:12.528 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.761408897999999, 2024-05-07T11:13:12.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.094853741999998, 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:12.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:12.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:12.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:12.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:12.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:12.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:12.537 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.865246650000003, 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:12.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:12.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.864571476000002, 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:12.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.863929655, 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.547 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:12.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:12.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.863461247000004, 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:12.551 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.860755726000001, 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:12.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.483439345000001, 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.560 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:12.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:12.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:12.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:12.566 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.48338257, 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:12.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:12.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.483354099, 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:12.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:12.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.483315305000001, 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.579 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:12.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:12.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.483271982000002, 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:12.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:12.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:12.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.483249431000001, 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.597 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.483225371, 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:12.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:12.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:12.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:12.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:12.606 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.606 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.606 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.606 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.483206411000001, 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:12.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:12.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:12.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.483179739000001, 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:12.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:12.616 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.478675479, 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:12.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.620 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.476948952000001, 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:12.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:12.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.476796618000002, 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.476743645999999, 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:12.629 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:12.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:12.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:12.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:12.633 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:12.635 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:12.635 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:12.634+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:12.735 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:12.735+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:12.744 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:12.744 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:12.744 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:12.744 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:12.753 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:12.837 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:12.837+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:12.899 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:12.899 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:12.899 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:12.899 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:12.899 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:12.907 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:12.937 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:12.936+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:13.037 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:13.037+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:13.054 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:13.054 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:13.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:13.054 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.105822494999998, 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:13.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:13.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:13.059 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.781596608000001, 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:13.060 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:13.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:13.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:13.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.621121209000002, 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.065 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:13.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:13.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:13.070 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.621034840999997, 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:13.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:13.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.391887408000002, 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.076 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:13.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.391839943000001, 2024-05-07T11:13:13.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:13.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.086 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.009927555000001, 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:13.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:13.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.007732471000001, 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:13.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:13.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.007504251, 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:13.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:13.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.007325121000001, 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.103 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:13.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:13.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.007265246999999, 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:13.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.113 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.007217075, 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:13.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.007189093000001, 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.119 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.007156083000002, 2024-05-07T11:13:13.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:13.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.007062278999999, 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:13.129 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.006918837000001, 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.135 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:13.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:13.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:13.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:13.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:13.140 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.006733931999999, 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:13.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.006574862000001, 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:13.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.006131452999998, 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.151 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.006106189, 2024-05-07T11:13:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:13.160 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:13.162 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:13.161+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:13.162 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:13.262 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:13.262+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:13.280 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:13.280 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:13.281 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:13.281 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:13.290 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:13.363 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:13.363+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:13.394 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:13.395 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:13.395 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:13.395 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:13.395 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:13.403 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:13.465 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:13.464+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:13.550 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:13.550 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:13.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:13.550 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:13.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.550 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.550 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.506253509, 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:13.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.556 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.506188788999999, 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:13.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:13.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.562 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.506091849000001, 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:13.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:13.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:13.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.506026511000002, 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:13.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:13.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:13.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.505999619000001, 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:13.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.505972041, 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.581 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:13.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.505936651999999, 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:13.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.505911045000001, 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:13.591 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:13.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.595 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.505881615, 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:13.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.599 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.503495641000001, 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.499237101999999, 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.603 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.607 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.498589099, 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.611 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.49794378, 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:13.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:13.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.497670215999999, 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:13.620 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.496910212, 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:13.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.496325593000002, 2024-05-07T11:13:13.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:13.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:13.629 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.629 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.629 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.629 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:13.629 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:13.629 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.492568783999999, 2024-05-07T11:13:13.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:13.629 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.491900536999999, 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000234329, 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.633 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057219+0000", 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3000000000000002e-07 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057222+0000", 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0800000000000002e-06 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057231+0000", 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3729999999999993e-06 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057240+0000", 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2779999999999999e-06 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057351+0000", 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000111354 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057453+0000", 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000101914 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.636 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.507552749999999, 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:13.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:13.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:13.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:13.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.505062305, 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:13.642 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:13.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:13.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:13.647 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:13.649 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:13.649 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:13.648+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:13.750 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:13.750+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:13.767 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:13.767 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:13.767 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:13.767 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:13.776 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:13.851 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:13.851+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:13.882 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:13.882 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:13.882 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:13.882 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:13.883 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:13.891 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:13.952 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:13.951+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:13.999 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:13.999 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:13.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:13.999 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:13.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:13.999 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:13.999 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 35.232344609999998, 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:14.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 34.565789453999997, 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 34.336182362000002, 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:14.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 34.335507188000001, 2024-05-07T11:13:14.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:14.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:14.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:14.017 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 34.334865366999999, 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 34.334396959000003, 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.022 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:14.026 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 34.331691438, 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:14.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:14.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.030 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.954375057, 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:14.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.036 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.954318281999999, 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:14.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.042 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.954289810999999, 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:14.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:14.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:14.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:14.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.954251017000001, 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:14.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:14.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:14.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.954207694000001, 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:14.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:14.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:14.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:14.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.954185143, 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.066 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.954161082999999, 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.072 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.954142123, 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.954115451, 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:14.077 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:14.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.081 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.949611190999999, 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.947884664, 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.086 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:14.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:14.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.947732330000001, 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:14.090 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.094 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.947679357999998, 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:14.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:14.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.098 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:14.099 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:14.099 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:14.100 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:14.101 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:14.100+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:14.201 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:14.201+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:14.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T11:13:14.216 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:14.216 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:14.216 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:14.216 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:14.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:14.302 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:14.302+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:14.330 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:14.330 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:14.330 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:14.339 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:14.404 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:14.403+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:14.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.497278860000002, 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:14.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:14.452 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.173052972999997, 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:14.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:14.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.012577573999998, 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:14.458 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:14.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:14.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:14.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.012491206, 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:14.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:14.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:14.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:14.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.469 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.783343772999999, 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:14.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:14.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.783296307999997, 2024-05-07T11:13:14.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:14.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:14.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:14.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:14.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:14.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:14.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:14.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:14.481 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.481 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.481 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.401383920000001, 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:14.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:14.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:14.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.399188836, 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:14.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:14.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.493 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.398960616, 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.398781486000001, 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.505 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.398721611999999, 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.39867344, 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:14.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:14.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.398645458000001, 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:14.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:14.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.398612448000002, 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.398518643999999, 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:14.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:14.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.398375202, 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:14.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:14.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:14.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:14.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.398190296999999, 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.543 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.398031227000001, 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.549 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.397587818000002, 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.554 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.397562554, 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:14.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:14.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:14.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:14.559 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:14.559 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:14.560 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:14.560 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:14.561 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:14.561 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:14.562 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:14.559+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:14.574 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:14.661 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:14.661+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:14.678 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:14.678 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:14.687 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:14.771 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:14.771+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:14.832 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:14.832 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:14.841 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:14.882 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:14.882+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:14.963 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:14.963+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:14.987 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:14.988 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:14.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:15.064 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:15.064+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:15.111 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:15.112 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:15.120 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:15.165 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:15.164+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:15.213 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-05-07T11:13:15.225 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:15.225 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:15.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:15.266 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:15.265+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:15.341 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:15.341 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:15.351 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:15.396 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:15.396+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:15.464 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:15.464 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:15.468 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:15.468+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:15.473 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:15.569 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:15.569+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:15.618 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:15.619 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:15.627 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:15.670 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:15.670+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:15.733 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:15.733 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:15.741 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:15.771 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:15.771+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:15.852 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:15.852 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:15.861 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:15.872 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:15.872+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:15.967 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:15.967 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:15.972 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:15.972+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:15.976 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:16.073 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:16.072+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:16.122 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:16.122 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:16.131 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:16.174 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:16.173+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:16.249 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:16.249 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:16.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:16.274 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:16.275+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:16.364 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:16.365 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:16.373 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:16.375 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:16.375+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:16.476 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:16.475+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:16.479 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:16.479 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:16.488 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:16.577 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:16.576+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:16.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:16.599 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:16.599 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:16.608 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:16.677 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:16.677+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:16.713 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:16.713 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:16.722 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:16.726 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:16.726 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:16.745 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:16.745 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:16.763 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:16.763 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:16.778 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:16.777+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:16.828 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.880376050999999, 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.556150164000002, 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.395674765000003, 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.395588396999997, 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.166440964000003, 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.166393499000002, 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.784481110999998, 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.782286026999998, 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.782057807000001, 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.781878677000002, 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.781818803, 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.781770631000001, 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.781742649000002, 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.781709638999999, 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.781615834999997, 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.918 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.781472393000001, 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:16.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:16.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.781287487999997, 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:16.930 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.781128418000002, 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:16.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:16.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.780685009000003, 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:16.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.940 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.780659745000001, 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:16.944 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:16.946 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:16.945+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:16.946 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:17.047 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:17.047+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:17.053 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:17.053 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:17.053 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:17.053 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:17.062 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:17.148 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:17.148+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:17.167 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:17.168 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:17.168 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:17.168 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:17.168 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:17.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:17.230 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T11:13:17.249 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:17.248+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:17.286 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:17.286 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:17.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:17.286 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:17.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.286 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.286 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.242088881000001, 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:17.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:17.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:17.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:17.292 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.242024161000003, 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:17.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:17.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.241927220999997, 2024-05-07T11:13:17.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:17.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:17.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:17.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.241861882999999, 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.304 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:17.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:17.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:17.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:17.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.241834990999998, 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.315 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.241807412999997, 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:17.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:17.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:17.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:17.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.241772023999999, 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.241746417000002, 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:17.329 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.241716986999997, 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:17.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.239331012999997, 2024-05-07T11:13:17.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:17.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.235072473999999, 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.234424470999997, 2024-05-07T11:13:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.233779151999997, 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.233505588, 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.232745584, 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:17.357 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.232160964999998, 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.228404156000003, 2024-05-07T11:13:17.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:17.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.243388121999999, 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.365 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:17.370 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.2408976769999995, 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:17.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:17.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:17.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:17.375 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 3.2401620320000002, 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:17.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:17.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:17.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:17.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:17.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:17.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:17.381 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.381 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.381 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.381 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:17.381 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:17.381 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:17.383 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:17.383 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:17.382+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:17.484 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:17.484+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:17.496 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:17.497 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:17.497 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:17.497 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:17.506 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:17.584 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:17.584+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:17.611 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:17.611 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:17.611 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:17.612 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:17.612 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:17.620 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:17.652 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:13:17.652 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:13:17.652 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-05-07T11:13:17.652 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-07T11:13:17.685 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:17.685+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:17.727 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:17.727 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:17.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.960541046000003, 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:17.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.293985890000002, 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.732 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.736 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.064378798, 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:17.740 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.063703623999999, 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:17.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.063061802999997, 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:17.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.062593395, 2024-05-07T11:13:17.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:17.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.753 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.059887873999998, 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.757 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.682571492999998, 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:17.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:17.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.763 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.682514718, 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:17.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:17.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.682486247, 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.682447453000002, 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:17.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.682404130000002, 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:17.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.682381579000001, 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:17.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:17.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.793 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.682357519, 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:17.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.682338559000002, 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.682311886999997, 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.808 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.677807627, 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:17.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.676081099999998, 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.813 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.675928765999998, 2024-05-07T11:13:17.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:17.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:17.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.675875794, 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:17.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.825 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.826 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.826 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:17.826 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:17.826 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:17.827 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:17.828 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:17.827+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:17.929 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:17.928+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:17.943 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:17.944 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:17.944 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:17.944 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:17.953 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:17.954 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:17.954 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:13:17.954 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 21, 2024-05-07T11:13:17.954 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "712a8431-2ac1-4386-a81f-c899bab82549", 2024-05-07T11:13:17.954 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-05-07T11:12:28.567931+0000", 2024-05-07T11:13:17.954 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-05-07T11:13:15.198651+0000", 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-05-07T11:12:36.689723+0000", 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-05-07T11:12:29.411691+0000", 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-07T11:13:17.955 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 4, 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "luminous", 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:36.979175+0000", 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:17.956 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-05-07T11:13:17.957 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:17.958 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:17.959 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:17.960 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:17.961 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.9900000095367432, 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.9900000095367432, 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 2, 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 2, 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:37.110970+0000", 2024-05-07T11:13:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-05-07T11:13:17.963 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:17.964 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:17.965 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:17.966 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.5, 2024-05-07T11:13:17.967 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.5, 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:41.627365+0000", 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:17.968 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-05-07T11:13:17.969 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "14", 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:17.970 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:17.971 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:17.972 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-05-07T11:13:17.973 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.974 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:42.384664+0000", 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-05-07T11:13:17.975 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-05-07T11:13:17.976 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:17.977 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:17.978 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.979 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-05-07T11:13:17.980 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cd7246e2-0069-4df7-a669-4abe038a28ad", 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:13:17.981 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 13, 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6800", 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6801", 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:17.982 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6802", 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6803", 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:17.983 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6806", 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.984 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6807", 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6804", 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.985 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6805", 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.88:6801/1378788154", 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.88:6803/1378788154", 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.88:6807/1378788154", 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.88:6805/1378788154", 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "7df5bb74-60c0-4a46-a3d1-494f777a4f88", 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 13, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:13:17.987 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6800", 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6801", 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6802", 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6803", 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.989 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6806", 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6807", 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6804", 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6805", 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.149:6801/3051775179", 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.149:6803/3051775179", 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.149:6807/3051775179", 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.149:6805/3051775179", 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "ebed6b16-fba7-4b8a-a78e-1f84a500c31f", 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:13:17.992 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 17, 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6800", 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:17.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6801", 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6802", 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:17.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6803", 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6806", 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:17.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6807", 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6804", 2024-05-07T11:13:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6805", 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.175:6801/2659225388", 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.175:6803/2659225388", 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.175:6807/2659225388", 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.175:6805/2659225388", 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:13:17.997 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.430581+0000", 2024-05-07T11:13:17.998 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.433407+0000", 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:13:17.999 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.440186+0000", 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [ 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.0", 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: 2, 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: 0 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:18.000 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-05-07T11:13:18.001 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-05-07T11:13:18.002 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:18.003 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:13:18.005 INFO:tasks.thrashosds.thrasher:j is {'epoch': 21, 'fsid': '712a8431-2ac1-4386-a81f-c899bab82549', 'created': '2024-05-07T11:12:28.567931+0000', 'modified': '2024-05-07T11:13:15.198651+0000', 'last_up_change': '2024-05-07T11:12:36.689723+0000', 'last_in_change': '2024-05-07T11:12:29.411691+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-07T11:12:41.627365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-05-07T11:12:42.384664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'cd7246e2-0069-4df7-a669-4abe038a28ad', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6800', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6801', 'nonce': 1378788154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6802', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6803', 'nonce': 1378788154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6806', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6807', 'nonce': 1378788154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6804', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6805', 'nonce': 1378788154}]}, 'public_addr': '172.21.15.88:6801/1378788154', 'cluster_addr': '172.21.15.88:6803/1378788154', 'heartbeat_back_addr': '172.21.15.88:6807/1378788154', 'heartbeat_front_addr': '172.21.15.88:6805/1378788154', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7df5bb74-60c0-4a46-a3d1-494f777a4f88', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 3051775179}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 3051775179}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 3051775179}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 3051775179}]}, 'public_addr': '172.21.15.149:6801/3051775179', 'cluster_addr': '172.21.15.149:6803/3051775179', 'heartbeat_back_addr': '172.21.15.149:6807/3051775179', 'heartbeat_front_addr': '172.21.15.149:6805/3051775179', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'ebed6b16-fba7-4b8a-a78e-1f84a500c31f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6800', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6801', 'nonce': 2659225388}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6802', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6803', 'nonce': 2659225388}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6806', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6807', 'nonce': 2659225388}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6804', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6805', 'nonce': 2659225388}]}, 'public_addr': '172.21.15.175:6801/2659225388', 'cluster_addr': '172.21.15.175:6803/2659225388', 'heartbeat_back_addr': '172.21.15.175:6807/2659225388', 'heartbeat_front_addr': '172.21.15.175:6805/2659225388', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.430581+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.433407+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.440186+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.0', 'osds': [2, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-07T11:13:18.005 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-05-07T11:13:18.029 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:18.029+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:18.059 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:18.059 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:18.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:18.129 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:18.129+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:18.175 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.226670073999998, 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:18.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:18.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:18.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 38.902444187, 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:18.181 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:18.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:18.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 38.741968788000001, 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:18.187 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:18.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:18.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:18.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 38.741882420000003, 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:18.193 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:18.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.198 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 38.512734987000002, 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:18.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:18.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:18.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:18.204 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 38.512687522, 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:18.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.130775133999997, 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.210 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:18.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.128580049999997, 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.216 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.12835183, 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.222 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:18.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:18.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.1281727, 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:18.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:18.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.128112825999999, 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.234 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:18.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.239 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.128064653999999, 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:18.244 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.128036672, 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:18.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:18.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.128003661999998, 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.250 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:18.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:18.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:18.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:18.255 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.127909858000002, 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:18.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:18.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:18.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.261 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.127766416, 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:18.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:18.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:18.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:18.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.267 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.127581511000002, 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.127422441, 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.126979032000001, 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:18.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.126953768, 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:18.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:18.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:18.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:18.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:18.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:18.287 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.287 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.287 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.287 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:18.287 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:18.287 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-05-07T11:13:18.290 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:18.290 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:18.288+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:18.390 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:18.389+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:18.405 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:18.405 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:18.405 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:18.405 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:18.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:18.498 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:18.498+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:18.560 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:18.560 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:18.560 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:18.561 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:18.561 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:18.570 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:18.591 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:18.591+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:18.692 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:18.692+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:18.717 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.673827920999997, 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.723 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.673763201, 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.729 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:18.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.673666261000001, 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.735 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.673600923000002, 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.741 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:18.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.673574031000001, 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:18.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:18.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:18.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:18.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.752 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.673546453, 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:18.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:18.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:18.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.673511064000003, 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.758 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.673485456999998, 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.762 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:18.764 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:18.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.766 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.673456027, 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:18.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:18.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:18.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.671070053000001, 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.666811514000003, 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.666163511000001, 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.665518192, 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.665244627999996, 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.787 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:18.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:18.791 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.664484623999996, 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:18.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:18.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.663900005000002, 2024-05-07T11:13:18.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:18.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:18.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 34.660143196, 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.802 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 32.675127162000003, 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:18.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.6726367169999996, 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.808 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:18.813 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.6719010719999998, 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:18.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:18.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:18.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.818 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:18.819 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:18.819 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:18.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:18.821 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:18.820+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:18.821 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:18.921 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:18.921+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:18.938 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:18.938 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:18.939 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:18.939 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:18.950 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:18.957 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:18.958 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:18.976 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:18.976 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:18.994 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:18.994 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:19.023 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:19.022+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:19.056 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:19.056 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:19.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:19.123 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:19.123+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:19.172 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:19.172 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:19.182 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:19.224 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:19.224+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:19.299 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:19.299 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:19.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:19.324 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:19.324+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:19.415 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:19.415 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:19.424 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:19.425 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:19.424+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:19.526 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:19.526+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:19.529 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:19.530 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:19.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:19.627 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:19.627+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:19.655 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:19.655 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:19.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:19.728 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:19.728+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:19.770 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:19.770 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:19.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:19.829 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:19.829+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:19.885 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:19.885 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:19.894 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:19.930 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:19.930+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:20.003 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:20.003 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:20.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:20.031 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:20.031+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:20.118 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:20.118 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:20.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:20.170 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:20.170+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:20.232 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:20.233 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:20.233 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:20.233+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:20.242 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:20.290 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T11:13:20.334 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:20.333+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:20.355 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:20.355 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:20.364 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:20.435 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:20.435+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:20.468 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:20.468 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:20.477 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:20.535 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:20.535+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:20.582 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:20.583 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:20.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:20.637 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:20.637+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:20.704 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:20.704 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:20.713 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:20.737 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:20.737+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:20.817 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:20.818 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:20.826 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:20.838 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:20.838+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:20.931 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:20.931 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:20.939 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:20.938+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:20.940 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:21.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:21.040 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:21.039+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:21.051 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:21.052 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:21.060 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:21.136 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:21.136 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:21.141 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:21.141+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:21.155 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:21.173 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:21.209 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:21.209 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:21.209 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:21.210 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:21.211 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:21.217 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:21.230 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-05-07T11:13:21.261 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:21.261+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:21.325 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.558362356000004, 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.891807200000002, 2024-05-07T11:13:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.662200108, 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.661524933999999, 2024-05-07T11:13:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.660883112999997, 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.660414705000001, 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.657709183999998, 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:21.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.280392802999998, 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.280336028000001, 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:21.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.280307557, 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.371 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:21.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.280268763000002, 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:21.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:21.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.280225440000002, 2024-05-07T11:13:21.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:21.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:21.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.280202889000002, 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:21.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:21.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:21.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:21.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:21.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:21.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:21.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.280178829, 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.399 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:21.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.405 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.280159869000002, 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.280133196999998, 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:21.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.275628937, 2024-05-07T11:13:21.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:21.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.419 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.420 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:21.420 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:21.420 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.273902409999998, 2024-05-07T11:13:21.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:21.420 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.420 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.420 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:21.424 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.273750075999999, 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:21.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:21.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:21.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.273697104, 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:21.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:21.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:21.433 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:21.435 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:21.436 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:21.435+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:21.535 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:21.535+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:21.551 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:21.552 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:21.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:21.636 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:21.636+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:21.705 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:21.705 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:21.706 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:21.706 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:21.706 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:21.715 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:21.737 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:21.737+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:21.822 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:21.822 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:21.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:21.822 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:21.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.822 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:21.822 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:21.822 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 42.873801399999998, 2024-05-07T11:13:21.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:21.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:21.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.827 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 42.549575513000001, 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:21.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:21.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:21.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 42.389100114000001, 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:21.833 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:21.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:21.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 42.389013746000003, 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:21.839 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:21.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:21.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 42.159866313000002, 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.845 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:21.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:21.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:21.850 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 42.159818848, 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:21.851 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:21.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:21.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:21.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.856 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.777906459999997, 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:21.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:21.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.775711375999997, 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:21.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.775483156, 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.869 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:21.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.775304026000001, 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.875 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:21.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.775244151999999, 2024-05-07T11:13:21.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:21.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.775195979999999, 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.887 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:21.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:21.892 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.775167998000001, 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:21.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:21.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.775134987999998, 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:21.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:21.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.775041184000003, 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:21.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.910 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.774897742, 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:21.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:21.916 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.774712837000003, 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:21.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:21.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:21.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.774553767, 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:21.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:21.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:21.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:21.926 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.774110358000001, 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:21.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:21.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:21.932 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.774085094, 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:21.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:21.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:21.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:21.936 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:21.938 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:21.939 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:21.937+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:22.038 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:22.038+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:22.055 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:22.055 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:22.055 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:22.055 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:22.065 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:22.139 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:22.139+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:22.172 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:22.172 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:22.172 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:22.172 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:22.172 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:22.181 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:22.265 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:22.265+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:22.329 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:22.329 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:22.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:22.329 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:22.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.329 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.329 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:22.329 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.284760222000003, 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:22.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:22.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.284695501999998, 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:22.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:22.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.284598561999999, 2024-05-07T11:13:22.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.284533224, 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.349 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:22.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:22.355 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.284506331999999, 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:22.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.284478753999998, 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:22.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.284443365000001, 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:22.367 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:22.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.284417758000004, 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:22.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.284388327999999, 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:22.376 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:22.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:22.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.282002353999999, 2024-05-07T11:13:22.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:22.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:22.383 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.277743815000001, 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:22.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:22.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.277095811999999, 2024-05-07T11:13:22.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:22.389 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.389 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.389 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.389 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:22.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:22.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.276450492999999, 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:22.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:22.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:22.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.276176929000002, 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:22.401 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.275416925000002, 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:22.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:22.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:22.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.274832306, 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:22.405 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:22.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.271075496999998, 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.286059463000001, 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.283569018, 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.418 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:22.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:22.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:22.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:22.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.424 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.2828333730000008, 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:22.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:22.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:22.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:22.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:22.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:22.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:22.430 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.430 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.430 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.430 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:22.430 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:22.430 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:22.432 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:22.432 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:22.431+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:22.532 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:22.532+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:22.550 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:22.550 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:22.550 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:22.550 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:22.560 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:22.633 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:22.632+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:22.665 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:22.665 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:22.665 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:22.665 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:22.665 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:22.674 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:22.758 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:22.758+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:22.822 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:22.822 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:22.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:22.822 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:22.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.822 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:22.822 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:22.822 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.055166474000004, 2024-05-07T11:13:22.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:22.823 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.823 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.823 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.823 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:22.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:22.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:22.827 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.388611318000002, 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:22.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:22.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:22.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:22.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:22.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:22.834 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.834 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.834 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.159004226, 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.838 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.158329051999999, 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:22.842 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.157687230999997, 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:22.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:22.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.847 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.157218823000001, 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:22.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:22.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:22.852 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.154513301999998, 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:22.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:22.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:22.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:22.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:22.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.777196920999998, 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.857 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:22.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:22.863 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.777140146000001, 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:22.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:22.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:22.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:22.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.777111675, 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:22.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.777072881000002, 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:22.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:22.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:22.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:22.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:22.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:22.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:22.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:22.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:22.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:22.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:22.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:22.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:22.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:22.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:22.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:22.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:22.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:22.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:22.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:22.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:22.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:22.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:22.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:22.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:22.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:22.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.777029558000002, 2024-05-07T11:13:22.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:22.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:22.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.777007007000002, 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:22.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:22.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:22.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:22.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:22.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:22.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:22.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:22.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.776982947, 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:22.901 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:22.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:22.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:22.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.907 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:22.908 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.776963987000002, 2024-05-07T11:13:22.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:22.908 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.908 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.908 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:22.908 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:22.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:22.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:22.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:22.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:22.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:22.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:22.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:22.912 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.776937314999998, 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:22.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:22.917 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.772433055, 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:22.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:22.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:22.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:22.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:22.922 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:22.923 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.770706527999998, 2024-05-07T11:13:22.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:22.923 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.923 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.923 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.923 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:22.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.770554193999999, 2024-05-07T11:13:22.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:22.928 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.928 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.928 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.928 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:22.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:22.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:22.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:22.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:22.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:22.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.932 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.770501222, 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:22.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:22.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:22.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.936 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.937 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:22.937 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:22.937 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:22.938 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:22.937+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:22.939 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:23.006 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:13:23.006 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:13:23.006 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-05-07T11:13:23.006 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.782888 2024-05-07T11:13:23.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.7828880048500033 2024-05-07T11:13:23.038 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:23.038+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:23.057 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:23.057 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:23.057 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:23.057 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:23.066 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:23.139 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:23.139+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:23.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:23.212 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:23.212 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:23.212 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:23.212 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:23.212 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:23.221 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:23.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:13:23.264 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:23.264+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:23.315 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:23.329 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:23.329 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:23.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:23.329 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:23.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.329 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:23.329 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:23.329 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.380794780000002, 2024-05-07T11:13:23.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:23.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.334 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.056568892999998, 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.335 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:23.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:23.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:23.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.340 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.896093493999999, 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.896007126000001, 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:23.346 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:23.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.351 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.666859692999999, 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:23.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.666812227999998, 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:23.357 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:23.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.362 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.284899840000001, 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.368 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.282704756000001, 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:23.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:23.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.374 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.282476535999997, 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:23.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:23.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:23.380 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.282297405999998, 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:23.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:23.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:23.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.282237532000003, 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.386 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.391 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.282189359999997, 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:23.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:23.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:23.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.396 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.282161377999998, 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.282128368000002, 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:23.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.282034564, 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.407 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:23.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:23.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.281891121999998, 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:23.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:23.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:23.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.281706217, 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:23.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:23.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:23.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:23.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.281547146999998, 2024-05-07T11:13:23.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:23.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:23.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.281103737999999, 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.434 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.281078473999997, 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:23.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:23.438 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:23.439 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:23.440 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:23.440 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:23.441 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:23.440+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:23.441 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:23.442 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:23.540 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:23.540+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:23.558 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:23.558 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:23.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:23.641 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:23.641+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:23.672 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:23.673 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:23.682 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:23.742 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:23.743+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:23.786 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:23.786 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:23.795 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:23.844 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:23.843+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:23.909 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:23.909 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:23.918 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:23.945 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:23.944+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:24.046 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:24.046+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:24.065 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:24.065 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:24.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:24.147 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:24.147+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:24.180 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:24.180 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:24.189 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.2 primary-affinity to 0.782888 (8513072) 2024-05-07T11:13:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:13:24.247 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:24.246+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:24.304 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:24.304 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:24.314 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:24.358 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:24.358+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:24.418 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:24.418 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:24.427 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:24.448 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:24.448+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:24.550 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:24.549+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:24.573 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:24.573 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:24.582 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:24.650 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:24.650+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:24.697 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:24.697 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:24.706 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:24.751 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:24.751+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:24.811 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:24.811 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:24.820 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:24.863 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:24.863+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:24.924 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:24.924 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:24.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:24.952 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:24.951+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:25.041 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:25.041 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:25.050 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:25.053 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:25.052+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:25.152 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:25.152+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:25.156 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:25.156 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:25.165 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:25.253 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:25.253+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:25.311 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:25.312 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:25.320 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:25.355 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:25.355+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:25.431 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:25.431 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:25.440 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:25.443 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:25.455 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:25.455+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:25.544 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:25.544 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:25.553 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:25.556 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:25.556+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:25.583 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:25.583 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:25.603 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:25.603 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:25.621 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:25.657 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:25.657+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:25.660 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 46.712012307000002, 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 46.387786419999998, 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 46.227311020999998, 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 46.227224653, 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.998077219999999, 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:25.688 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.998029754999997, 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:25.689 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.616117367000001, 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:25.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.613922283000001, 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:25.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.613694062999997, 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:25.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:25.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:25.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:25.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:25.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:25.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.613514932999998, 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:25.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:25.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:25.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.613455059000003, 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:25.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:25.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:25.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.613406886999996, 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:25.725 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:25.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:25.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:25.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.613378904999998, 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:25.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:25.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:25.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:25.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.613345895000002, 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:25.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.613252091, 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:25.741 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.613108648999997, 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.747 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.612923744, 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.753 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:25.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.612764673999997, 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:25.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:25.763 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.612321264999999, 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.612296000999997, 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:25.769 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:25.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:25.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:25.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:25.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:25.773 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.773 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.773 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.773 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:25.773 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:25.773 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:25.774 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:25.774+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:25.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:25.876 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:25.876+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:25.892 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:25.892 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:25.892 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:25.892 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:25.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:25.977 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:25.977+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:26.006 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:26.006 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:26.007 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:26.007 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:26.007 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:26.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:26.078 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:26.078+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:26.121 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:26.121 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.077580709000003, 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:26.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:26.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:26.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.127 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.077515988999998, 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:26.128 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:26.131 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.132 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.077419049, 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:26.134 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:26.136 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.138 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:26.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.077353711000001, 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.141 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.144 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.145 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.146 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.077326819, 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:26.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:26.152 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.077299240999999, 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:26.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.158 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.077263852000002, 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.077238244999997, 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.077208814999999, 2024-05-07T11:13:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.074822841, 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.171 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:26.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:26.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.070564302000001, 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:26.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:26.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.069916298999999, 2024-05-07T11:13:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:26.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.069270979999999, 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:26.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.068997416000002, 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:26.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:26.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:26.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.068237412000002, 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:26.192 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:26.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.067652793000001, 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:26.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.199 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.063895983999998, 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.078879950000001, 2024-05-07T11:13:26.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:26.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:26.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.076389505000002, 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:26.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:26.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.075653859999999, 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:26.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:26.219 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:26.221 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:26.221+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:26.221 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:26.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T11:13:26.322 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:26.322+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:26.340 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:26.340 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:26.340 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:26.340 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:26.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:26.423 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:26.423+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:26.456 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:26.456 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:26.456 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:26.456 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:26.456 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:26.465 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:26.549 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:26.549+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:26.613 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:26.613 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:26.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:26.613 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:26.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.613 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:26.613 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:26.613 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.845999042999999, 2024-05-07T11:13:26.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:26.613 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:26.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:26.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.179443886999998, 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:26.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:26.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.949836795000003, 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.622 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:26.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:26.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.949161621000002, 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:26.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:26.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:26.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.9485198, 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.948051391999996, 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.635 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:26.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.639 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.945345871000001, 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.568029490000001, 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:26.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:26.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:26.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:26.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.649 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.567972715000003, 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:26.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.567944244000003, 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:26.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.661 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.567905449999998, 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:26.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:26.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:26.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:26.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:26.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.567862126999998, 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:26.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:26.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:26.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.567839575999997, 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:26.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.680 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.567815516000003, 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:26.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:26.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:26.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.567796555999998, 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:26.687 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:26.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:26.691 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.567769884000001, 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:26.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:26.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.563265624000003, 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.696 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:26.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.561539097000001, 2024-05-07T11:13:26.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.561386763000002, 2024-05-07T11:13:26.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.708 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.561333791000003, 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:26.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:26.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:26.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:26.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:26.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:26.713 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.713 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.713 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.713 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:26.713 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:26.713 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:26.715 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:26.715 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:26.714+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:26.816 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:26.816+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:26.832 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:26.832 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:26.832 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:26.832 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:26.841 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:26.917 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:26.916+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:26.946 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:26.946 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:26.946 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:26.946 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:26.946 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:26.955 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:27.018 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:27.018+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:27.062 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:27.062 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:27.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:27.062 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 48.113929257000002, 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:27.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:27.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.068 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.789703369999998, 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:27.069 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:27.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.074 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.629227970999999, 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:27.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:27.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:27.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:27.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:27.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.629141603000001, 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:27.080 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:27.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:27.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:27.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:27.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.399994169999999, 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:27.086 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:27.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:27.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.399946704999998, 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:27.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:27.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:27.097 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.018034317000001, 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:27.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:27.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.103 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.015839233000001, 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:27.109 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.015611012999997, 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:27.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:27.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:27.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:27.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.015431882999998, 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.116 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.015372008999996, 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.127 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.015323836999997, 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:27.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:27.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:27.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.015295854999998, 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:27.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.138 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.015262845000002, 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.015169041, 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.015025598999998, 2024-05-07T11:13:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:27.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.014840694, 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.014681623999998, 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.014238214999999, 2024-05-07T11:13:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 43.014212950999998, 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:27.177 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:27.179 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:27.180 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:27.179+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:27.251 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-05-07T11:13:27.279 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:27.279+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:27.297 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:27.297 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:27.297 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:27.297 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:27.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:27.380 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:27.380+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:27.412 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:27.412 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:27.412 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:27.412 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:27.412 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:27.422 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:27.481 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:27.481+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:27.529 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:27.529 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:27.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:27.529 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:27.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.529 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.529 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:27.529 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.484895023, 2024-05-07T11:13:27.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:27.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:27.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.484830303000003, 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.484733362999997, 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:27.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:27.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:27.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.484668024999998, 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.548 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.484641132999997, 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.554 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:27.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:27.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.560 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.484613555000003, 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:27.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:27.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:27.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:27.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.567 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.484578165999999, 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:27.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.484552559000001, 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.484523129000003, 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.482137154999997, 2024-05-07T11:13:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:27.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:27.584 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.584 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.596 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.597 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:27.597 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:27.597 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.477878615999998, 2024-05-07T11:13:27.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:27.598 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.598 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.599 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.599 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:27.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:27.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:27.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:27.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:27.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:27.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:27.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:27.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:27.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:27.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:27.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:27.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:27.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:27.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:27.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:27.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:27.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:27.609 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.609 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.609 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.610 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:27.610 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:27.610 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.477230613000003, 2024-05-07T11:13:27.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:27.610 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.610 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.610 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.610 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:27.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:27.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:27.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:27.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:27.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:27.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:27.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:27.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:27.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:27.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:27.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:27.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:27.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:27.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:27.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:27.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:27.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:27.616 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.617 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.617 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.617 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:27.617 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:27.617 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.476585294000003, 2024-05-07T11:13:27.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:27.617 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.618 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.618 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.618 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:27.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:27.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:27.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:27.622 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.476311729999999, 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:27.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:27.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:27.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:27.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.475551725999999, 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.627 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:27.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:27.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.474967106999998, 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:27.631 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:27.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.471210298000003, 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 41.486194263999998, 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 18.483703818999999, 2024-05-07T11:13:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.482968174, 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:27.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:27.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.655 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:27.655 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:27.655 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:27.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:27.657 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:27.656+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:27.657 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:27.757 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:27.756+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:27.776 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:27.776 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:27.776 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:27.776 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:27.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:27.796 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:27.797 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:27.815 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:27.816 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:27.833 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:27.834 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:27.869 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:27.869+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:27.932 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:27.933 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:27.941 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:27.958 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:27.958+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:28.060 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:28.059+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:28.088 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:28.088 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:28.097 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:28.161 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:28.160+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:28.211 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:28.211 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:28.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:28.261 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:28.261+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:28.362 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:28.362+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:28.366 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:28.366 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:28.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:28.463 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:28.463+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:28.529 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:28.573 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:28.573+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:28.645 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:28.645 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:28.654 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:28.695 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:28.695+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:28.766 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:28.766+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:28.800 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:28.800 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:28.809 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:28.867 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:28.867+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:28.913 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:28.913 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:28.923 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:28.967 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:28.967+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:29.038 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:29.039 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:29.048 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:29.092 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:29.092+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:29.154 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:29.155 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:29.163 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:29.169 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:29.169+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:29.251 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:13:29.251 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:13:29.251 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-05-07T11:13:29.252 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2024-05-07T11:13:29.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-05-07T11:13:29.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T11:13:29.270 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:29.269+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:29.309 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:29.309 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:29.318 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:29.371 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:29.370+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:29.434 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:29.434 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:29.443 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:29.472 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:29.472+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:29.573 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:29.572+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:29.590 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:29.590 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:29.599 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:29.674 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:29.674+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:29.744 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:29.744 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:29.753 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:29.796 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:29.796+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:29.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:29.869 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:29.869 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:29.876 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:29.875+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:29.879 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:29.973 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:29.973 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:29.976 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:29.977+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:29.991 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:30.009 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:30.026 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:30.027 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:30.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:30.078 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:30.078+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:30.142 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:30.142 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:30.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:30.142 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.098221326999997, 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.145 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:30.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:30.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:30.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.098156607, 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:30.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:30.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.156 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.098059667000001, 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.097994329000002, 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:30.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.168 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.097967437000001, 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:30.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.097939859, 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:30.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:30.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:30.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.097904470000003, 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:30.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:30.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.097878862999998, 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.188 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.097849433, 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:30.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:30.192 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.095463459000001, 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.091204920000003, 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.090556917000001, 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.089911598, 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.089638033999996, 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.088878029999996, 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.088293411000002, 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.084536602, 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.099520568000003, 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:30.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:30.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.097030123, 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.230 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:30.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:30.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:30.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.096294478000001, 2024-05-07T11:13:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:30.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:30.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.240 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:30.241 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:30.241 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:30.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:30.243 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:30.242+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:30.252 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-05-07T11:13:30.253 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-05-07T11:13:30.343 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:30.342+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:30.352 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:30.352 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:30.352 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:30.352 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:30.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:30.444 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:30.444+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:30.466 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:30.466 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:30.467 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:30.467 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:30.467 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:30.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:30.545 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:30.545+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:30.583 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:30.583 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:30.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:30.583 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:30.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.816385482000001, 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:30.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:30.587 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.149830326, 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.920223233999998, 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.592 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.919548059999997, 2024-05-07T11:13:30.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:30.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:30.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.600 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.918906239000002, 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.604 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.918437830999999, 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:30.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:30.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:30.608 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.915732310000003, 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.538415929000003, 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.613 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:30.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.538359153999998, 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.619 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:30.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:30.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:30.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.538330682999998, 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:30.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:30.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:30.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:30.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:30.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.538291889, 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:30.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:30.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:30.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.538248566, 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.642 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.538226014999999, 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:30.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.648 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.538201954999998, 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:30.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.654 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.538182995, 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:30.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.538156323000003, 2024-05-07T11:13:30.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:30.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:30.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.533652062999998, 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.531925536000003, 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:30.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:30.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.531773201999997, 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:30.672 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:30.676 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.531720229999998, 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:30.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.680 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.681 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:30.681 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:30.681 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:30.682 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:30.683 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:30.682+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:30.783 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:30.783+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:30.795 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:30.795 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:30.795 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:30.795 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:30.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:30.888 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:30.888+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:30.950 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:30.950 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:30.958 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:30.985 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:30.985+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:31.086 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:31.086+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:31.106 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:31.106 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:31.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:31.106 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.158341018000002, 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.107 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:31.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 51.834115130999997, 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:31.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:31.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:31.118 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 51.673639731999998, 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:31.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:31.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:31.123 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 51.673553364, 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:31.124 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:31.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:31.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.129 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 51.444405930999999, 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:31.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 51.444358465999997, 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.135 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.140 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.062446078000001, 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:31.146 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.060250994, 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:31.152 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.060022773999997, 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:31.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.059843643999997, 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:31.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.059783770000003, 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.165 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:31.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:31.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.059735598000003, 2024-05-07T11:13:31.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:31.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:31.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.059707615999997, 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:31.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.180 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.059674606000002, 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:31.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.059580801999999, 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:31.186 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.059437359999997, 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.192 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.059252454999999, 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.198 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.059093384999997, 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:31.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:31.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.208 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.058649975999998, 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:31.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:31.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:31.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:31.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.058624711999997, 2024-05-07T11:13:31.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:31.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:31.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:31.218 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:31.220 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:31.220+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:31.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:31.320 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:31.320+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:31.338 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:31.338 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:31.338 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:31.338 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:31.348 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:31.421 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:31.421+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:31.454 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:31.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:31.521 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:31.521+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.525908078000001, 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.525843358000003, 2024-05-07T11:13:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.525746417999997, 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.525681079999998, 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.525654187999997, 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:31.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:31.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.600 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.525626610000003, 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:31.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.525591220999999, 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.606 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.525565614000001, 2024-05-07T11:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.525536184000003, 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.523150209999997, 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.518891670999999, 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.518243667999997, 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.517598348999996, 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:31.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.517324785, 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:31.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:31.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.516564781, 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:31.643 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.515980161999998, 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:31.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:31.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:31.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:31.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.650 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.650 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.512223353000003, 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 45.527207318999999, 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.659 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.524716873999999, 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.523981229, 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:31.665 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:31.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:31.670 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:31.672 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:31.673 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:31.672+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:31.773 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:31.773+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:31.786 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:31.786 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:31.795 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:31.874 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:31.874+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:31.902 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:31.902 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:31.902 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:31.902 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:31.902 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:31.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:31.975 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:31.975+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:32.018 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:32.018 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.251773837000002, 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:32.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.585218681000001, 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:32.023 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.355611588999999, 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:32.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:32.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:32.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.354936414999997, 2024-05-07T11:13:32.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:32.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:32.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.354294594000002, 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.040 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.353826185999999, 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.351120665000003, 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.973804284000003, 2024-05-07T11:13:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:32.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:32.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:32.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:32.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:32.057 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.057 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.973747508999999, 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:32.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.973719037999999, 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:32.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:32.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.973680244000001, 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:32.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.973636921000001, 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.076 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.97361437, 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.973590309999999, 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.97357135, 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.973544678000003, 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:32.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:32.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.969040417999999, 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.967313891000003, 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.108 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:32.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:32.112 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.967161556999997, 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:32.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:32.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.967108584999998, 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:32.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:32.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:32.121 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.121 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.121 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.121 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:32.121 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:32.121 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:32.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:32.123 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:32.124 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:32.122+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:32.223 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:32.223+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:32.234 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:32.234 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:32.234 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:32.234 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:32.243 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:32.261 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:32.262 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:32.268 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T11:13:32.280 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:32.281 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:32.298 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:32.299 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:32.324 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:32.324+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:32.349 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:32.349 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:32.357 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:32.425 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:32.425+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:32.461 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:32.462 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:32.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:32.526 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:32.525+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:32.582 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:32.583 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:32.592 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:32.627 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:32.627+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:32.698 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:32.698 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:32.707 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:32.727 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:32.727+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:32.812 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:32.812 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:32.822 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:32.827 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:32.828+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:32.928 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:32.928+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:32.929 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:32.929 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:32.938 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:33.029 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:33.029+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:33.043 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:33.043 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:33.052 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:33.130 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:33.130+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:33.158 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:33.158 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:33.167 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:33.231 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:33.231+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:33.264 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-05-07T11:13:33.282 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:33.282 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:33.291 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:33.332 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:33.332+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:33.395 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:33.395 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:33.404 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:33.448 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:33.448+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:33.509 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:33.509 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:33.519 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:33.559 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:33.559+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:33.631 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:33.631 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:33.635 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:33.635+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:33.641 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:33.736 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:33.736+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:33.745 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:33.745 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:33.754 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:33.836 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:33.836+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:33.860 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:33.860 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:33.869 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:33.937 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:33.938+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:33.976 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:33.976 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:33.985 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:34.038 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:34.038+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:34.090 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:34.090 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:34.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:34.141 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:34.141+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:34.240 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:34.240+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:34.245 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:34.245 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:34.255 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:34.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:34.341 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:34.341+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:34.363 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:34.363 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:34.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:34.456 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:34.456+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:34.482 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:34.518 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:34.518 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:34.518 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:34.518 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:34.519 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:34.527 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:34.543 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:34.543+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:34.644 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:34.644+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:34.673 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:34.673 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.725268118999999, 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:34.674 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:34.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.679 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.401042232000002, 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:34.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:34.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:34.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.240566833000003, 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:34.686 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:34.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.692 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:34.692 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:34.692 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.240480464999997, 2024-05-07T11:13:34.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:34.692 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.692 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:34.697 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.011333032000003, 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:34.698 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:34.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:34.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:34.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:34.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:34.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:34.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:34.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:34.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.011285567000002, 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:34.705 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.710 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.629373178999998, 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:34.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:34.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:34.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:34.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:34.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.627178094999998, 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.718 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:34.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:34.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:34.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.626949875000001, 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.724 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.729 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.626770745000002, 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:34.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:34.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:34.735 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.626710871, 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.626662699000001, 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.741 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:34.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:34.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:34.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:34.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:34.746 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.626634717000002, 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.626601706999999, 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:34.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.756 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.626507902999997, 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:34.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:34.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:34.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:34.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.762 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.626364461000001, 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:34.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:34.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.626179555999997, 2024-05-07T11:13:34.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:34.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:34.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:34.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.773 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.626020486000002, 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.625577077000003, 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:34.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:34.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:34.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:34.783 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.625551813000001, 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:34.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:34.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:34.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.787 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:34.788 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:34.788 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:34.790 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:34.789+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:34.790 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:34.890 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:34.890+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:34.904 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:34.904 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:34.904 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:34.904 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:34.914 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:34.991 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:34.990+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:35.022 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:35.022 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:35.022 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:35.022 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:35.023 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:35.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:35.092 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:35.092+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:35.178 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:35.178 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:35.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:35.178 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:35.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.134194983999997, 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:35.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.134130263999999, 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.190 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.134033324000001, 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:35.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:35.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:35.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:35.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:35.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.133967986000002, 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:35.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:35.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:35.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:35.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.133941094000001, 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.207 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.133913516, 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:35.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:35.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:35.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:35.212 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.133878127000003, 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.133852519999998, 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.13382309, 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:35.221 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:35.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:35.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:35.224 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.131437116000001, 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:35.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.127178577000002, 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:35.228 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:35.232 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.126530574, 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:35.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.125885255, 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.125611691000003, 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.241 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.244 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.124851687000003, 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:35.248 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.124267068000002, 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:35.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:35.251 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.120510259, 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:35.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:35.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:35.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.135494225000002, 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.260 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.133003779999999, 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:35.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:35.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:35.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:35.265 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.132268135, 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:35.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:35.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:35.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:35.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.271 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.271 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.271 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:35.271 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:35.271 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:35.271 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:13:35.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-07T11:13:35.273 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:35.272+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:35.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:35.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:13:35.373 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:35.373+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:35.392 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:35.392 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:35.392 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:35.392 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:35.401 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:35.474 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:35.475+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:35.507 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:35.507 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:35.507 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:35.507 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:35.508 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:35.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:35.575 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:35.575+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:35.624 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:35.624 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:35.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:35.624 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:35.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.624 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:35.624 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:35.624 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.857196590999997, 2024-05-07T11:13:35.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:35.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:35.628 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.190641435000003, 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:35.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:35.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.632 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.961034343000001, 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:35.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.960359169, 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:35.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:35.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:35.640 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.959717347999998, 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.959248940000002, 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.645 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.956543418999999, 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:35.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:35.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:35.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.579227037999999, 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:35.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.659 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.579170263000002, 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:35.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:35.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.665 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.579141792000001, 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:35.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.579102998000003, 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.677 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.579059675000003, 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:35.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:35.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:35.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:35.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:35.683 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.579037124000003, 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:35.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:35.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:35.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:35.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.579013064000002, 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:35.689 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:35.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:35.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.578994104000003, 2024-05-07T11:13:35.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:35.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:35.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:35.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.578967431999999, 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:35.704 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.574463172000002, 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.708 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.572736644999999, 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.572584311, 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.713 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:35.717 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.572531339000001, 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:35.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:35.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:35.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.721 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.722 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:35.722 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:35.722 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:35.723 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:35.724 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:35.723+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:35.824 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:35.824+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:35.835 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:35.836 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:35.844 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:35.925 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:35.925+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:35.950 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:35.950 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:35.950 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:35.950 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:35.950 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:35.959 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:36.025 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:36.025+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:36.066 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:36.066 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:36.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:36.066 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:36.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.066 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 57.117887365999998, 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.067 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:36.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:36.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 56.793661479000001, 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:36.073 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:36.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:36.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:36.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 56.633186080000002, 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.079 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:36.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:36.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.084 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 56.633099712000003, 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.085 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:36.086 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:36.086 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:36.086 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:36.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.086 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:36.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 56.403952279000002, 2024-05-07T11:13:36.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:36.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:36.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:36.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:36.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:36.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:36.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:36.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 56.403904814000001, 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.098 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:36.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:36.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:36.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:36.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:36.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:36.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.105 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.105 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.021992425999997, 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:36.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.112 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.019797341999997, 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:36.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:36.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:36.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:36.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:36.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:36.118 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.119 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.119 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.120 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:36.120 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.019569122, 2024-05-07T11:13:36.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:36.120 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.121 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.121 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.121 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:36.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:36.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:36.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:36.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:36.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:36.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:36.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:36.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:36.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:36.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:36.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:36.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:36.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:36.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:36.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:36.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:36.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:36.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:36.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:36.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:36.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:36.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:36.132 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.019389992000001, 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:36.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:36.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:36.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:36.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:36.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.019330117999999, 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:36.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:36.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:36.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:36.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:36.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:36.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:36.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:36.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:36.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:36.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:36.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:36.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.147 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.019281946, 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:36.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:36.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:36.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:36.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:36.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:36.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.019253964000001, 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.154 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:36.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.019220953999998, 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:36.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:36.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:36.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:36.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:36.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:36.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:36.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:36.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:36.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:36.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:36.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.019127150000003, 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:36.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:36.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:36.172 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.173 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.173 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.173 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.173 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:36.173 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.018983708, 2024-05-07T11:13:36.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:36.173 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.173 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.174 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.174 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:36.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:36.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:36.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:36.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:36.179 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.018798803000003, 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:36.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:36.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:36.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:36.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:36.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:36.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:36.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.186 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.018639733000001, 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:36.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:36.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:36.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:36.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:36.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:36.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:36.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:36.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:36.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.018196324000002, 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:36.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:36.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:36.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:36.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:36.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:36.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:36.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:36.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:36.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.200 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.01817106, 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:36.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.205 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.205 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.205 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:36.205 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:36.205 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:36.207 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:36.206+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:36.207 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:36.274 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.0 to 1 (10000) 2024-05-07T11:13:36.274 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:13:36.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-07T11:13:36.307 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:36.308+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:36.326 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:36.326 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:36.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:36.408 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:36.408+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:36.441 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:36.441 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:36.442 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:36.442 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:36.442 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:36.450 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:36.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:36.534 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:36.534+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:36.598 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:36.598 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:36.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:36.598 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.553555906, 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:36.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.553491186000002, 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.605 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:36.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:36.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:36.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.553394246000003, 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:36.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:36.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.553328907999997, 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.617 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:36.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:36.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:36.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:36.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:36.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:36.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:36.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.553302016000004, 2024-05-07T11:13:36.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:36.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:36.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:36.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:36.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:36.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:36.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:36.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.629 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.553274438000003, 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:36.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:36.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:36.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.553239048999998, 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.553213442000001, 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:36.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.643 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.553184012000003, 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:36.647 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.550798038000003, 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:36.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:36.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.546539498999998, 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.545891496000003, 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.545246177000003, 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.544972612999999, 2024-05-07T11:13:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.544212608999999, 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:36.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:36.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.543627989999997, 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:36.674 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:36.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:36.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:36.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:36.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:36.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:36.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:36.679 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.679 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.679 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.680 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:36.680 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:36.680 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.539871181000002, 2024-05-07T11:13:36.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:36.681 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.681 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.681 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:36.681 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:36.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:36.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:36.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:36.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:36.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:36.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:36.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:36.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:36.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:36.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:36.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:36.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:36.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:36.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:36.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:36.689 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.689 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.689 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.690 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:36.690 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:36.690 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.554855146999998, 2024-05-07T11:13:36.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:36.690 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.690 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:36.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.552364701999998, 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:36.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:36.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:36.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:36.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:36.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.551629057, 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:36.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:36.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:36.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:36.707 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.707 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.707 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.707 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:36.707 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:36.707 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:36.709 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:36.709+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:36.709 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:36.710 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:36.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:36.711 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:36.809 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:36.809+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:36.824 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:36.824 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:36.834 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:36.911 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:36.911+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:36.939 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:36.939 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:36.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:37.012 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:37.012+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:37.054 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:37.054 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:37.063 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:37.112 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:37.113+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:37.183 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:37.183 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:37.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:37.213 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:37.214+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.1 to 1 (10000) 2024-05-07T11:13:37.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-07T11:13:37.314 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:37.314+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:37.339 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:37.339 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:37.348 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:37.415 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:37.415+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:37.453 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:37.453 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:37.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:37.516 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:37.515+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:37.570 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:37.570 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:37.579 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:37.617 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:37.617+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:37.717 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:37.718+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:37.725 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:37.726 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:37.735 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:37.818 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:37.819+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:37.840 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:37.840 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:37.849 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:37.919 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:37.918+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:37.960 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:37.960 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:37.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:38.020 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:38.020+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:38.114 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:38.114 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:38.121 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:38.121+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:38.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:38.222 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:38.222+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:38.227 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:38.227 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:38.237 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:38.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T11:13:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.2 to 1 (10000) 2024-05-07T11:13:38.307 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-07T11:13:38.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:13:38.322 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:38.323+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:38.347 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:38.347 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:38.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:38.423 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:38.424+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:38.460 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:38.460 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:38.469 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:38.524 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:38.524+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:38.612 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:38.612 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:38.621 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:38.625 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:38.626+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:38.675 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:13:38.687 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-05-07T11:13:38.290444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90268,"kb_used_data":888,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025252,"statfs":{"total":289910292480,"available":289817858048,"internally_reserved":0,"allocated":909312,"data_stored":1503647,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.343168"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279865+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:13:36.279865+0000","last_peered":"2024-05-07T11:13:36.279865+0000","last_clean":"2024-05-07T11:13:36.279865+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:13:36.279865+0000","last_undegraded":"2024-05-07T11:13:36.279865+0000","last_fullsized":"2024-05-07T11:13:36.279865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279496+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:13:36.279496+0000","last_peered":"2024-05-07T11:13:36.279496+0000","last_clean":"2024-05-07T11:13:36.279496+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:13:36.279496+0000","last_undegraded":"2024-05-07T11:13:36.279496+0000","last_fullsized":"2024-05-07T11:13:36.279496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264964+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:13:33.264964+0000","last_peered":"2024-05-07T11:13:33.264964+0000","last_clean":"2024-05-07T11:13:33.264964+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:13:33.264964+0000","last_undegraded":"2024-05-07T11:13:33.264964+0000","last_fullsized":"2024-05-07T11:13:33.264964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264934+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:13:33.264934+0000","last_peered":"2024-05-07T11:13:33.264934+0000","last_clean":"2024-05-07T11:13:33.264934+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:13:33.264934+0000","last_undegraded":"2024-05-07T11:13:33.264934+0000","last_fullsized":"2024-05-07T11:13:33.264934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279311+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:13:36.279311+0000","last_peered":"2024-05-07T11:13:36.279311+0000","last_clean":"2024-05-07T11:13:36.279311+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:13:36.279311+0000","last_undegraded":"2024-05-07T11:13:36.279311+0000","last_fullsized":"2024-05-07T11:13:36.279311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278985+0000","last_change":"2024-05-07T11:13:25.248711+0000","last_active":"2024-05-07T11:13:36.278985+0000","last_peered":"2024-05-07T11:13:36.278985+0000","last_clean":"2024-05-07T11:13:36.278985+0000","last_became_active":"2024-05-07T11:13:25.248452+0000","last_became_peered":"2024-05-07T11:13:25.248452+0000","last_unstale":"2024-05-07T11:13:36.278985+0000","last_undegraded":"2024-05-07T11:13:36.278985+0000","last_fullsized":"2024-05-07T11:13:36.278985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278888+0000","last_change":"2024-05-07T11:13:25.248071+0000","last_active":"2024-05-07T11:13:36.278888+0000","last_peered":"2024-05-07T11:13:36.278888+0000","last_clean":"2024-05-07T11:13:36.278888+0000","last_became_active":"2024-05-07T11:13:25.247861+0000","last_became_peered":"2024-05-07T11:13:25.247861+0000","last_unstale":"2024-05-07T11:13:36.278888+0000","last_undegraded":"2024-05-07T11:13:36.278888+0000","last_fullsized":"2024-05-07T11:13:36.278888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.057596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264333+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:13:33.264333+0000","last_peered":"2024-05-07T11:13:33.264333+0000","last_clean":"2024-05-07T11:13:33.264333+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:13:33.264333+0000","last_undegraded":"2024-05-07T11:13:33.264333+0000","last_fullsized":"2024-05-07T11:13:33.264333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279788+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:13:36.279788+0000","last_peered":"2024-05-07T11:13:36.279788+0000","last_clean":"2024-05-07T11:13:36.279788+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:13:36.279788+0000","last_undegraded":"2024-05-07T11:13:36.279788+0000","last_fullsized":"2024-05-07T11:13:36.279788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279561+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:13:36.279561+0000","last_peered":"2024-05-07T11:13:36.279561+0000","last_clean":"2024-05-07T11:13:36.279561+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:13:36.279561+0000","last_undegraded":"2024-05-07T11:13:36.279561+0000","last_fullsized":"2024-05-07T11:13:36.279561+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279538+0000","last_change":"2024-05-07T11:13:25.249909+0000","last_active":"2024-05-07T11:13:36.279538+0000","last_peered":"2024-05-07T11:13:36.279538+0000","last_clean":"2024-05-07T11:13:36.279538+0000","last_became_active":"2024-05-07T11:13:25.249670+0000","last_became_peered":"2024-05-07T11:13:25.249670+0000","last_unstale":"2024-05-07T11:13:36.279538+0000","last_undegraded":"2024-05-07T11:13:36.279538+0000","last_fullsized":"2024-05-07T11:13:36.279538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:31.697406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279404+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:13:36.279404+0000","last_peered":"2024-05-07T11:13:36.279404+0000","last_clean":"2024-05-07T11:13:36.279404+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:13:36.279404+0000","last_undegraded":"2024-05-07T11:13:36.279404+0000","last_fullsized":"2024-05-07T11:13:36.279404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279207+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:13:36.279207+0000","last_peered":"2024-05-07T11:13:36.279207+0000","last_clean":"2024-05-07T11:13:36.279207+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:13:36.279207+0000","last_undegraded":"2024-05-07T11:13:36.279207+0000","last_fullsized":"2024-05-07T11:13:36.279207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264516+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:13:33.264516+0000","last_peered":"2024-05-07T11:13:33.264516+0000","last_clean":"2024-05-07T11:13:33.264516+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:13:33.264516+0000","last_undegraded":"2024-05-07T11:13:33.264516+0000","last_fullsized":"2024-05-07T11:13:33.264516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264568+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:13:33.264568+0000","last_peered":"2024-05-07T11:13:33.264568+0000","last_clean":"2024-05-07T11:13:33.264568+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:13:33.264568+0000","last_undegraded":"2024-05-07T11:13:33.264568+0000","last_fullsized":"2024-05-07T11:13:33.264568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278899+0000","last_change":"2024-05-07T11:13:25.248991+0000","last_active":"2024-05-07T11:13:36.278899+0000","last_peered":"2024-05-07T11:13:36.278899+0000","last_clean":"2024-05-07T11:13:36.278899+0000","last_became_active":"2024-05-07T11:13:25.248693+0000","last_became_peered":"2024-05-07T11:13:25.248693+0000","last_unstale":"2024-05-07T11:13:36.278899+0000","last_undegraded":"2024-05-07T11:13:36.278899+0000","last_fullsized":"2024-05-07T11:13:36.278899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:27:15.749485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280170+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:13:36.280170+0000","last_peered":"2024-05-07T11:13:36.280170+0000","last_clean":"2024-05-07T11:13:36.280170+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:13:36.280170+0000","last_undegraded":"2024-05-07T11:13:36.280170+0000","last_fullsized":"2024-05-07T11:13:36.280170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279753+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:13:36.279753+0000","last_peered":"2024-05-07T11:13:36.279753+0000","last_clean":"2024-05-07T11:13:36.279753+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:13:36.279753+0000","last_undegraded":"2024-05-07T11:13:36.279753+0000","last_fullsized":"2024-05-07T11:13:36.279753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279663+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:13:36.279663+0000","last_peered":"2024-05-07T11:13:36.279663+0000","last_clean":"2024-05-07T11:13:36.279663+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:13:36.279663+0000","last_undegraded":"2024-05-07T11:13:36.279663+0000","last_fullsized":"2024-05-07T11:13:36.279663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264938+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:13:33.264938+0000","last_peered":"2024-05-07T11:13:33.264938+0000","last_clean":"2024-05-07T11:13:33.264938+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:13:33.264938+0000","last_undegraded":"2024-05-07T11:13:33.264938+0000","last_fullsized":"2024-05-07T11:13:33.264938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264785+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:13:33.264785+0000","last_peered":"2024-05-07T11:13:33.264785+0000","last_clean":"2024-05-07T11:13:33.264785+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:13:33.264785+0000","last_undegraded":"2024-05-07T11:13:33.264785+0000","last_fullsized":"2024-05-07T11:13:33.264785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279101+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:13:36.279101+0000","last_peered":"2024-05-07T11:13:36.279101+0000","last_clean":"2024-05-07T11:13:36.279101+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:13:36.279101+0000","last_undegraded":"2024-05-07T11:13:36.279101+0000","last_fullsized":"2024-05-07T11:13:36.279101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278899+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:13:36.278899+0000","last_peered":"2024-05-07T11:13:36.278899+0000","last_clean":"2024-05-07T11:13:36.278899+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:13:36.278899+0000","last_undegraded":"2024-05-07T11:13:36.278899+0000","last_fullsized":"2024-05-07T11:13:36.278899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278943+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:13:36.278943+0000","last_peered":"2024-05-07T11:13:36.278943+0000","last_clean":"2024-05-07T11:13:36.278943+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:13:36.278943+0000","last_undegraded":"2024-05-07T11:13:36.278943+0000","last_fullsized":"2024-05-07T11:13:36.278943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279880+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:13:36.279880+0000","last_peered":"2024-05-07T11:13:36.279880+0000","last_clean":"2024-05-07T11:13:36.279880+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:13:36.279880+0000","last_undegraded":"2024-05-07T11:13:36.279880+0000","last_fullsized":"2024-05-07T11:13:36.279880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279865+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:13:36.279865+0000","last_peered":"2024-05-07T11:13:36.279865+0000","last_clean":"2024-05-07T11:13:36.279865+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:13:36.279865+0000","last_undegraded":"2024-05-07T11:13:36.279865+0000","last_fullsized":"2024-05-07T11:13:36.279865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279769+0000","last_change":"2024-05-07T11:13:25.249860+0000","last_active":"2024-05-07T11:13:36.279769+0000","last_peered":"2024-05-07T11:13:36.279769+0000","last_clean":"2024-05-07T11:13:36.279769+0000","last_became_active":"2024-05-07T11:13:25.249519+0000","last_became_peered":"2024-05-07T11:13:25.249519+0000","last_unstale":"2024-05-07T11:13:36.279769+0000","last_undegraded":"2024-05-07T11:13:36.279769+0000","last_fullsized":"2024-05-07T11:13:36.279769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279613+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:13:36.279613+0000","last_peered":"2024-05-07T11:13:36.279613+0000","last_clean":"2024-05-07T11:13:36.279613+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:13:36.279613+0000","last_undegraded":"2024-05-07T11:13:36.279613+0000","last_fullsized":"2024-05-07T11:13:36.279613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279493+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:13:36.279493+0000","last_peered":"2024-05-07T11:13:36.279493+0000","last_clean":"2024-05-07T11:13:36.279493+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:13:36.279493+0000","last_undegraded":"2024-05-07T11:13:36.279493+0000","last_fullsized":"2024-05-07T11:13:36.279493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279262+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:13:36.279262+0000","last_peered":"2024-05-07T11:13:36.279262+0000","last_clean":"2024-05-07T11:13:36.279262+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:13:36.279262+0000","last_undegraded":"2024-05-07T11:13:36.279262+0000","last_fullsized":"2024-05-07T11:13:36.279262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279012+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:13:36.279012+0000","last_peered":"2024-05-07T11:13:36.279012+0000","last_clean":"2024-05-07T11:13:36.279012+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:13:36.279012+0000","last_undegraded":"2024-05-07T11:13:36.279012+0000","last_fullsized":"2024-05-07T11:13:36.279012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264391+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:13:33.264391+0000","last_peered":"2024-05-07T11:13:33.264391+0000","last_clean":"2024-05-07T11:13:33.264391+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:13:33.264391+0000","last_undegraded":"2024-05-07T11:13:33.264391+0000","last_fullsized":"2024-05-07T11:13:33.264391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279503+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:13:36.279503+0000","last_peered":"2024-05-07T11:13:36.279503+0000","last_clean":"2024-05-07T11:13:36.279503+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:13:36.279503+0000","last_undegraded":"2024-05-07T11:13:36.279503+0000","last_fullsized":"2024-05-07T11:13:36.279503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264896+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:13:33.264896+0000","last_peered":"2024-05-07T11:13:33.264896+0000","last_clean":"2024-05-07T11:13:33.264896+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:13:33.264896+0000","last_undegraded":"2024-05-07T11:13:33.264896+0000","last_fullsized":"2024-05-07T11:13:33.264896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279606+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:13:36.279606+0000","last_peered":"2024-05-07T11:13:36.279606+0000","last_clean":"2024-05-07T11:13:36.279606+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:13:36.279606+0000","last_undegraded":"2024-05-07T11:13:36.279606+0000","last_fullsized":"2024-05-07T11:13:36.279606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279252+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:13:36.279252+0000","last_peered":"2024-05-07T11:13:36.279252+0000","last_clean":"2024-05-07T11:13:36.279252+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:13:36.279252+0000","last_undegraded":"2024-05-07T11:13:36.279252+0000","last_fullsized":"2024-05-07T11:13:36.279252+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279974+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:13:36.279974+0000","last_peered":"2024-05-07T11:13:36.279974+0000","last_clean":"2024-05-07T11:13:36.279974+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:13:36.279974+0000","last_undegraded":"2024-05-07T11:13:36.279974+0000","last_fullsized":"2024-05-07T11:13:36.279974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279113+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:13:36.279113+0000","last_peered":"2024-05-07T11:13:36.279113+0000","last_clean":"2024-05-07T11:13:36.279113+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:13:36.279113+0000","last_undegraded":"2024-05-07T11:13:36.279113+0000","last_fullsized":"2024-05-07T11:13:36.279113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279920+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:13:36.279920+0000","last_peered":"2024-05-07T11:13:36.279920+0000","last_clean":"2024-05-07T11:13:36.279920+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:13:36.279920+0000","last_undegraded":"2024-05-07T11:13:36.279920+0000","last_fullsized":"2024-05-07T11:13:36.279920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264567+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:13:33.264567+0000","last_peered":"2024-05-07T11:13:33.264567+0000","last_clean":"2024-05-07T11:13:33.264567+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:13:33.264567+0000","last_undegraded":"2024-05-07T11:13:33.264567+0000","last_fullsized":"2024-05-07T11:13:33.264567+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265282+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:13:33.265282+0000","last_peered":"2024-05-07T11:13:33.265282+0000","last_clean":"2024-05-07T11:13:33.265282+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:13:33.265282+0000","last_undegraded":"2024-05-07T11:13:33.265282+0000","last_fullsized":"2024-05-07T11:13:33.265282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278953+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:13:36.278953+0000","last_peered":"2024-05-07T11:13:36.278953+0000","last_clean":"2024-05-07T11:13:36.278953+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:13:36.278953+0000","last_undegraded":"2024-05-07T11:13:36.278953+0000","last_fullsized":"2024-05-07T11:13:36.278953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279759+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:13:36.279759+0000","last_peered":"2024-05-07T11:13:36.279759+0000","last_clean":"2024-05-07T11:13:36.279759+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:13:36.279759+0000","last_undegraded":"2024-05-07T11:13:36.279759+0000","last_fullsized":"2024-05-07T11:13:36.279759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279011+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:13:36.279011+0000","last_peered":"2024-05-07T11:13:36.279011+0000","last_clean":"2024-05-07T11:13:36.279011+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:13:36.279011+0000","last_undegraded":"2024-05-07T11:13:36.279011+0000","last_fullsized":"2024-05-07T11:13:36.279011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279489+0000","last_change":"2024-05-07T11:13:25.249690+0000","last_active":"2024-05-07T11:13:36.279489+0000","last_peered":"2024-05-07T11:13:36.279489+0000","last_clean":"2024-05-07T11:13:36.279489+0000","last_became_active":"2024-05-07T11:13:25.249304+0000","last_became_peered":"2024-05-07T11:13:25.249304+0000","last_unstale":"2024-05-07T11:13:36.279489+0000","last_undegraded":"2024-05-07T11:13:36.279489+0000","last_fullsized":"2024-05-07T11:13:36.279489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:30.051793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264540+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:13:33.264540+0000","last_peered":"2024-05-07T11:13:33.264540+0000","last_clean":"2024-05-07T11:13:33.264540+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:13:33.264540+0000","last_undegraded":"2024-05-07T11:13:33.264540+0000","last_fullsized":"2024-05-07T11:13:33.264540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279612+0000","last_change":"2024-05-07T11:13:25.249164+0000","last_active":"2024-05-07T11:13:36.279612+0000","last_peered":"2024-05-07T11:13:36.279612+0000","last_clean":"2024-05-07T11:13:36.279612+0000","last_became_active":"2024-05-07T11:13:25.248783+0000","last_became_peered":"2024-05-07T11:13:25.248783+0000","last_unstale":"2024-05-07T11:13:36.279612+0000","last_undegraded":"2024-05-07T11:13:36.279612+0000","last_fullsized":"2024-05-07T11:13:36.279612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:00.987017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279361+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:13:36.279361+0000","last_peered":"2024-05-07T11:13:36.279361+0000","last_clean":"2024-05-07T11:13:36.279361+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:13:36.279361+0000","last_undegraded":"2024-05-07T11:13:36.279361+0000","last_fullsized":"2024-05-07T11:13:36.279361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279616+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:13:36.279616+0000","last_peered":"2024-05-07T11:13:36.279616+0000","last_clean":"2024-05-07T11:13:36.279616+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:13:36.279616+0000","last_undegraded":"2024-05-07T11:13:36.279616+0000","last_fullsized":"2024-05-07T11:13:36.279616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265030+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:13:33.265030+0000","last_peered":"2024-05-07T11:13:33.265030+0000","last_clean":"2024-05-07T11:13:33.265030+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:13:33.265030+0000","last_undegraded":"2024-05-07T11:13:33.265030+0000","last_fullsized":"2024-05-07T11:13:33.265030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264713+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:13:33.264713+0000","last_peered":"2024-05-07T11:13:33.264713+0000","last_clean":"2024-05-07T11:13:33.264713+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:13:33.264713+0000","last_undegraded":"2024-05-07T11:13:33.264713+0000","last_fullsized":"2024-05-07T11:13:33.264713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265482+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:13:33.265482+0000","last_peered":"2024-05-07T11:13:33.265482+0000","last_clean":"2024-05-07T11:13:33.265482+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:13:33.265482+0000","last_undegraded":"2024-05-07T11:13:33.265482+0000","last_fullsized":"2024-05-07T11:13:33.265482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279151+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:13:36.279151+0000","last_peered":"2024-05-07T11:13:36.279151+0000","last_clean":"2024-05-07T11:13:36.279151+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:13:36.279151+0000","last_undegraded":"2024-05-07T11:13:36.279151+0000","last_fullsized":"2024-05-07T11:13:36.279151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265390+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:13:33.265390+0000","last_peered":"2024-05-07T11:13:33.265390+0000","last_clean":"2024-05-07T11:13:33.265390+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:13:33.265390+0000","last_undegraded":"2024-05-07T11:13:33.265390+0000","last_fullsized":"2024-05-07T11:13:33.265390+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279033+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:13:36.279033+0000","last_peered":"2024-05-07T11:13:36.279033+0000","last_clean":"2024-05-07T11:13:36.279033+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:13:36.279033+0000","last_undegraded":"2024-05-07T11:13:36.279033+0000","last_fullsized":"2024-05-07T11:13:36.279033+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279896+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:13:36.279896+0000","last_peered":"2024-05-07T11:13:36.279896+0000","last_clean":"2024-05-07T11:13:36.279896+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:13:36.279896+0000","last_undegraded":"2024-05-07T11:13:36.279896+0000","last_fullsized":"2024-05-07T11:13:36.279896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":242,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264780+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:13:33.264780+0000","last_peered":"2024-05-07T11:13:33.264780+0000","last_clean":"2024-05-07T11:13:33.264780+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:13:33.264780+0000","last_undegraded":"2024-05-07T11:13:33.264780+0000","last_fullsized":"2024-05-07T11:13:33.264780+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264988+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:13:33.264988+0000","last_peered":"2024-05-07T11:13:33.264988+0000","last_clean":"2024-05-07T11:13:33.264988+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:13:33.264988+0000","last_undegraded":"2024-05-07T11:13:33.264988+0000","last_fullsized":"2024-05-07T11:13:33.264988+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279357+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:13:36.279357+0000","last_peered":"2024-05-07T11:13:36.279357+0000","last_clean":"2024-05-07T11:13:36.279357+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:13:36.279357+0000","last_undegraded":"2024-05-07T11:13:36.279357+0000","last_fullsized":"2024-05-07T11:13:36.279357+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279445+0000","last_change":"2024-05-07T11:13:25.249760+0000","last_active":"2024-05-07T11:13:36.279445+0000","last_peered":"2024-05-07T11:13:36.279445+0000","last_clean":"2024-05-07T11:13:36.279445+0000","last_became_active":"2024-05-07T11:13:25.249466+0000","last_became_peered":"2024-05-07T11:13:25.249466+0000","last_unstale":"2024-05-07T11:13:36.279445+0000","last_undegraded":"2024-05-07T11:13:36.279445+0000","last_fullsized":"2024-05-07T11:13:36.279445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264688+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:13:33.264688+0000","last_peered":"2024-05-07T11:13:33.264688+0000","last_clean":"2024-05-07T11:13:33.264688+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:13:33.264688+0000","last_undegraded":"2024-05-07T11:13:33.264688+0000","last_fullsized":"2024-05-07T11:13:33.264688+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279195+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:13:36.279195+0000","last_peered":"2024-05-07T11:13:36.279195+0000","last_clean":"2024-05-07T11:13:36.279195+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:13:36.279195+0000","last_undegraded":"2024-05-07T11:13:36.279195+0000","last_fullsized":"2024-05-07T11:13:36.279195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279632+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:13:36.279632+0000","last_peered":"2024-05-07T11:13:36.279632+0000","last_clean":"2024-05-07T11:13:36.279632+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:13:36.279632+0000","last_undegraded":"2024-05-07T11:13:36.279632+0000","last_fullsized":"2024-05-07T11:13:36.279632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279292+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:13:36.279292+0000","last_peered":"2024-05-07T11:13:36.279292+0000","last_clean":"2024-05-07T11:13:36.279292+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:13:36.279292+0000","last_undegraded":"2024-05-07T11:13:36.279292+0000","last_fullsized":"2024-05-07T11:13:36.279292+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279053+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:13:36.279053+0000","last_peered":"2024-05-07T11:13:36.279053+0000","last_clean":"2024-05-07T11:13:36.279053+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:13:36.279053+0000","last_undegraded":"2024-05-07T11:13:36.279053+0000","last_fullsized":"2024-05-07T11:13:36.279053+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279998+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:13:36.279998+0000","last_peered":"2024-05-07T11:13:36.279998+0000","last_clean":"2024-05-07T11:13:36.279998+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:13:36.279998+0000","last_undegraded":"2024-05-07T11:13:36.279998+0000","last_fullsized":"2024-05-07T11:13:36.279998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264732+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:13:33.264732+0000","last_peered":"2024-05-07T11:13:33.264732+0000","last_clean":"2024-05-07T11:13:33.264732+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:13:33.264732+0000","last_undegraded":"2024-05-07T11:13:33.264732+0000","last_fullsized":"2024-05-07T11:13:33.264732+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264969+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:13:33.264969+0000","last_peered":"2024-05-07T11:13:33.264969+0000","last_clean":"2024-05-07T11:13:33.264969+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:13:33.264969+0000","last_undegraded":"2024-05-07T11:13:33.264969+0000","last_fullsized":"2024-05-07T11:13:33.264969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279797+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:13:36.279797+0000","last_peered":"2024-05-07T11:13:36.279797+0000","last_clean":"2024-05-07T11:13:36.279797+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:13:36.279797+0000","last_undegraded":"2024-05-07T11:13:36.279797+0000","last_fullsized":"2024-05-07T11:13:36.279797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279627+0000","last_change":"2024-05-07T11:13:25.249176+0000","last_active":"2024-05-07T11:13:36.279627+0000","last_peered":"2024-05-07T11:13:36.279627+0000","last_clean":"2024-05-07T11:13:36.279627+0000","last_became_active":"2024-05-07T11:13:25.248831+0000","last_became_peered":"2024-05-07T11:13:25.248831+0000","last_unstale":"2024-05-07T11:13:36.279627+0000","last_undegraded":"2024-05-07T11:13:36.279627+0000","last_fullsized":"2024-05-07T11:13:36.279627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:48:30.756870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279890+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:13:36.279890+0000","last_peered":"2024-05-07T11:13:36.279890+0000","last_clean":"2024-05-07T11:13:36.279890+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:13:36.279890+0000","last_undegraded":"2024-05-07T11:13:36.279890+0000","last_fullsized":"2024-05-07T11:13:36.279890+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279128+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:13:36.279128+0000","last_peered":"2024-05-07T11:13:36.279128+0000","last_clean":"2024-05-07T11:13:36.279128+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:13:36.279128+0000","last_undegraded":"2024-05-07T11:13:36.279128+0000","last_fullsized":"2024-05-07T11:13:36.279128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279805+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:13:36.279805+0000","last_peered":"2024-05-07T11:13:36.279805+0000","last_clean":"2024-05-07T11:13:36.279805+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:13:36.279805+0000","last_undegraded":"2024-05-07T11:13:36.279805+0000","last_fullsized":"2024-05-07T11:13:36.279805+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279806+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:13:36.279806+0000","last_peered":"2024-05-07T11:13:36.279806+0000","last_clean":"2024-05-07T11:13:36.279806+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:13:36.279806+0000","last_undegraded":"2024-05-07T11:13:36.279806+0000","last_fullsized":"2024-05-07T11:13:36.279806+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279303+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:13:36.279303+0000","last_peered":"2024-05-07T11:13:36.279303+0000","last_clean":"2024-05-07T11:13:36.279303+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:13:36.279303+0000","last_undegraded":"2024-05-07T11:13:36.279303+0000","last_fullsized":"2024-05-07T11:13:36.279303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280244+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:13:36.280244+0000","last_peered":"2024-05-07T11:13:36.280244+0000","last_clean":"2024-05-07T11:13:36.280244+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:13:36.280244+0000","last_undegraded":"2024-05-07T11:13:36.280244+0000","last_fullsized":"2024-05-07T11:13:36.280244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280067+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:13:36.280067+0000","last_peered":"2024-05-07T11:13:36.280067+0000","last_clean":"2024-05-07T11:13:36.280067+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:13:36.280067+0000","last_undegraded":"2024-05-07T11:13:36.280067+0000","last_fullsized":"2024-05-07T11:13:36.280067+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279129+0000","last_change":"2024-05-07T11:13:25.248884+0000","last_active":"2024-05-07T11:13:36.279129+0000","last_peered":"2024-05-07T11:13:36.279129+0000","last_clean":"2024-05-07T11:13:36.279129+0000","last_became_active":"2024-05-07T11:13:25.248619+0000","last_became_peered":"2024-05-07T11:13:25.248619+0000","last_unstale":"2024-05-07T11:13:36.279129+0000","last_undegraded":"2024-05-07T11:13:36.279129+0000","last_fullsized":"2024-05-07T11:13:36.279129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280063+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:13:36.280063+0000","last_peered":"2024-05-07T11:13:36.280063+0000","last_clean":"2024-05-07T11:13:36.280063+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:13:36.280063+0000","last_undegraded":"2024-05-07T11:13:36.280063+0000","last_fullsized":"2024-05-07T11:13:36.280063+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265310+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:13:33.265310+0000","last_peered":"2024-05-07T11:13:33.265310+0000","last_clean":"2024-05-07T11:13:33.265310+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:13:33.265310+0000","last_undegraded":"2024-05-07T11:13:33.265310+0000","last_fullsized":"2024-05-07T11:13:33.265310+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279016+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:13:36.279016+0000","last_peered":"2024-05-07T11:13:36.279016+0000","last_clean":"2024-05-07T11:13:36.279016+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:13:36.279016+0000","last_undegraded":"2024-05-07T11:13:36.279016+0000","last_fullsized":"2024-05-07T11:13:36.279016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264746+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:13:33.264746+0000","last_peered":"2024-05-07T11:13:33.264746+0000","last_clean":"2024-05-07T11:13:33.264746+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:13:33.264746+0000","last_undegraded":"2024-05-07T11:13:33.264746+0000","last_fullsized":"2024-05-07T11:13:33.264746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265135+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:13:33.265135+0000","last_peered":"2024-05-07T11:13:33.265135+0000","last_clean":"2024-05-07T11:13:33.265135+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:13:33.265135+0000","last_undegraded":"2024-05-07T11:13:33.265135+0000","last_fullsized":"2024-05-07T11:13:33.265135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279143+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:13:36.279143+0000","last_peered":"2024-05-07T11:13:36.279143+0000","last_clean":"2024-05-07T11:13:36.279143+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:13:36.279143+0000","last_undegraded":"2024-05-07T11:13:36.279143+0000","last_fullsized":"2024-05-07T11:13:36.279143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279739+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:13:36.279739+0000","last_peered":"2024-05-07T11:13:36.279739+0000","last_clean":"2024-05-07T11:13:36.279739+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:13:36.279739+0000","last_undegraded":"2024-05-07T11:13:36.279739+0000","last_fullsized":"2024-05-07T11:13:36.279739+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279818+0000","last_change":"2024-05-07T11:13:25.249281+0000","last_active":"2024-05-07T11:13:36.279818+0000","last_peered":"2024-05-07T11:13:36.279818+0000","last_clean":"2024-05-07T11:13:36.279818+0000","last_became_active":"2024-05-07T11:13:25.249068+0000","last_became_peered":"2024-05-07T11:13:25.249068+0000","last_unstale":"2024-05-07T11:13:36.279818+0000","last_undegraded":"2024-05-07T11:13:36.279818+0000","last_fullsized":"2024-05-07T11:13:36.279818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:30:57.180798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279018+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:13:36.279018+0000","last_peered":"2024-05-07T11:13:36.279018+0000","last_clean":"2024-05-07T11:13:36.279018+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:13:36.279018+0000","last_undegraded":"2024-05-07T11:13:36.279018+0000","last_fullsized":"2024-05-07T11:13:36.279018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280147+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:13:36.280147+0000","last_peered":"2024-05-07T11:13:36.280147+0000","last_clean":"2024-05-07T11:13:36.280147+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:13:36.280147+0000","last_undegraded":"2024-05-07T11:13:36.280147+0000","last_fullsized":"2024-05-07T11:13:36.280147+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279034+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:13:36.279034+0000","last_peered":"2024-05-07T11:13:36.279034+0000","last_clean":"2024-05-07T11:13:36.279034+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:13:36.279034+0000","last_undegraded":"2024-05-07T11:13:36.279034+0000","last_fullsized":"2024-05-07T11:13:36.279034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279938+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:13:36.279938+0000","last_peered":"2024-05-07T11:13:36.279938+0000","last_clean":"2024-05-07T11:13:36.279938+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:13:36.279938+0000","last_undegraded":"2024-05-07T11:13:36.279938+0000","last_fullsized":"2024-05-07T11:13:36.279938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279160+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:13:36.279160+0000","last_peered":"2024-05-07T11:13:36.279160+0000","last_clean":"2024-05-07T11:13:36.279160+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:13:36.279160+0000","last_undegraded":"2024-05-07T11:13:36.279160+0000","last_fullsized":"2024-05-07T11:13:36.279160+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279763+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:13:36.279763+0000","last_peered":"2024-05-07T11:13:36.279763+0000","last_clean":"2024-05-07T11:13:36.279763+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:13:36.279763+0000","last_undegraded":"2024-05-07T11:13:36.279763+0000","last_fullsized":"2024-05-07T11:13:36.279763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279143+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:13:36.279143+0000","last_peered":"2024-05-07T11:13:36.279143+0000","last_clean":"2024-05-07T11:13:36.279143+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:13:36.279143+0000","last_undegraded":"2024-05-07T11:13:36.279143+0000","last_fullsized":"2024-05-07T11:13:36.279143+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279543+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:13:36.279543+0000","last_peered":"2024-05-07T11:13:36.279543+0000","last_clean":"2024-05-07T11:13:36.279543+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:13:36.279543+0000","last_undegraded":"2024-05-07T11:13:36.279543+0000","last_fullsized":"2024-05-07T11:13:36.279543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279323+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:13:36.279323+0000","last_peered":"2024-05-07T11:13:36.279323+0000","last_clean":"2024-05-07T11:13:36.279323+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:13:36.279323+0000","last_undegraded":"2024-05-07T11:13:36.279323+0000","last_fullsized":"2024-05-07T11:13:36.279323+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279405+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:13:36.279405+0000","last_peered":"2024-05-07T11:13:36.279405+0000","last_clean":"2024-05-07T11:13:36.279405+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:13:36.279405+0000","last_undegraded":"2024-05-07T11:13:36.279405+0000","last_fullsized":"2024-05-07T11:13:36.279405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279405+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:13:36.279405+0000","last_peered":"2024-05-07T11:13:36.279405+0000","last_clean":"2024-05-07T11:13:36.279405+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:13:36.279405+0000","last_undegraded":"2024-05-07T11:13:36.279405+0000","last_fullsized":"2024-05-07T11:13:36.279405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264579+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:13:33.264579+0000","last_peered":"2024-05-07T11:13:33.264579+0000","last_clean":"2024-05-07T11:13:33.264579+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:13:33.264579+0000","last_undegraded":"2024-05-07T11:13:33.264579+0000","last_fullsized":"2024-05-07T11:13:33.264579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265071+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:13:33.265071+0000","last_peered":"2024-05-07T11:13:33.265071+0000","last_clean":"2024-05-07T11:13:33.265071+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:13:33.265071+0000","last_undegraded":"2024-05-07T11:13:33.265071+0000","last_fullsized":"2024-05-07T11:13:33.265071+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264614+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:13:33.264614+0000","last_peered":"2024-05-07T11:13:33.264614+0000","last_clean":"2024-05-07T11:13:33.264614+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:13:33.264614+0000","last_undegraded":"2024-05-07T11:13:33.264614+0000","last_fullsized":"2024-05-07T11:13:33.264614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279661+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:13:36.279661+0000","last_peered":"2024-05-07T11:13:36.279661+0000","last_clean":"2024-05-07T11:13:36.279661+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:13:36.279661+0000","last_undegraded":"2024-05-07T11:13:36.279661+0000","last_fullsized":"2024-05-07T11:13:36.279661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279212+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:13:36.279212+0000","last_peered":"2024-05-07T11:13:36.279212+0000","last_clean":"2024-05-07T11:13:36.279212+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:13:36.279212+0000","last_undegraded":"2024-05-07T11:13:36.279212+0000","last_fullsized":"2024-05-07T11:13:36.279212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279957+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:13:36.279957+0000","last_peered":"2024-05-07T11:13:36.279957+0000","last_clean":"2024-05-07T11:13:36.279957+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:13:36.279957+0000","last_undegraded":"2024-05-07T11:13:36.279957+0000","last_fullsized":"2024-05-07T11:13:36.279957+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264605+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:13:33.264605+0000","last_peered":"2024-05-07T11:13:33.264605+0000","last_clean":"2024-05-07T11:13:33.264605+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:13:33.264605+0000","last_undegraded":"2024-05-07T11:13:33.264605+0000","last_fullsized":"2024-05-07T11:13:33.264605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280027+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:13:36.280027+0000","last_peered":"2024-05-07T11:13:36.280027+0000","last_clean":"2024-05-07T11:13:36.280027+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:13:36.280027+0000","last_undegraded":"2024-05-07T11:13:36.280027+0000","last_fullsized":"2024-05-07T11:13:36.280027+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":699035,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":702680,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":101932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:13:38.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:13:38.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:38.726 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:38.727+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:38.732 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:38.732 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:38.741 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:38.827 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:38.827+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:38.846 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:38.847 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:38.855 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:38.860 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:38.860 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:38.879 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:38.897 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:38.897 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:38.929 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:38.929+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.958757703000003, 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.958692982999999, 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:39.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.958596043, 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:39.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:39.020 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.958530705000001, 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:39.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:39.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:39.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:39.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:39.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:39.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:39.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:39.027 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.958503813, 2024-05-07T11:13:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.958476234999999, 2024-05-07T11:13:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.040 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.040 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:39.040 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.040 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.041 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:39.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:39.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.042 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:39.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:39.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:39.043 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:39.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.043 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:39.044 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:39.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.044 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.044 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.044 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:39.044 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:39.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.045 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.045 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:39.045 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:39.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.046 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.046 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:39.046 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:39.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.047 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:39.047 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:39.047 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:39.047 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.047 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.047 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.048 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:39.048 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:39.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.048 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.048 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.048 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:39.048 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:39.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.048 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.048 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.958440846000002, 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:39.049 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:39.050 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.051 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.052 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.958415238999997, 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:39.053 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.054 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.055 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.056 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.057 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.958385808999999, 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.058 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.059 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.060 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.061 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.955999835, 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.063 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.064 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:39.065 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:39.065 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.065 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.065 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.065 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:39.065 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.951741296000002, 2024-05-07T11:13:39.066 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.067 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.068 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.068 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.068 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:39.068 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:39.068 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.068 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.069 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.069 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:39.069 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:39.069 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.069 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.069 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.070 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:39.070 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:39.070 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.070 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.070 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.071 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:39.071 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:39.071 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.071 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.071 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.071 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:39.072 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:39.072 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.072 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.072 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.072 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:39.072 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:39.073 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.073 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.073 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.073 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:39.073 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:39.073 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.074 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.074 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.074 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:39.074 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:39.074 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.074 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.075 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.075 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.075 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.075 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:39.075 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:39.076 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.951093293, 2024-05-07T11:13:39.076 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:39.076 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.076 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.076 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.076 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.077 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.077 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.077 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:39.077 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.077 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.077 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.078 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.078 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:39.078 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.078 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.078 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.078 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.079 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:39.079 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:39.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.079 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.079 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.079 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:39.080 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:39.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.080 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.080 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.080 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:39.080 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:39.081 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.081 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.081 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.081 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:39.081 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:39.081 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.082 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.082 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.082 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:39.082 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:39.082 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.082 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.083 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.083 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:39.083 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:39.083 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.083 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.083 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.084 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:39.084 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:39.084 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.084 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.084 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.084 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:39.084 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:39.084 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.084 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.084 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.950447973999999, 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.085 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.086 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.087 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.088 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.950174410000002, 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.089 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:39.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:39.091 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:39.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.949414406000002, 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.094 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.096 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.096 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:39.096 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:39.096 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.096 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.096 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.096 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:39.097 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:39.097 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.097 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.097 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.097 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:39.097 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:39.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.098 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.098 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.098 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:39.098 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:39.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.099 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.099 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.099 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:39.099 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:39.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.099 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.100 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.100 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:39.100 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:39.100 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.100 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.101 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.101 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.101 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:39.101 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:39.101 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.948829787000001, 2024-05-07T11:13:39.102 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:39.102 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.102 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.102 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:39.102 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.102 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.103 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.103 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:39.103 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.103 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.103 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.103 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.104 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:39.104 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.104 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.104 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.105 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:39.105 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:39.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.105 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.105 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.105 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:39.106 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:39.106 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.106 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.106 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.106 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:39.106 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:39.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.107 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.107 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.107 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:39.107 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:39.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.108 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.108 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:39.108 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:39.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.109 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.109 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:39.109 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:39.109 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.109 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.109 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.110 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.110 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.110 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:39.110 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:39.110 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.945072977999999, 2024-05-07T11:13:39.110 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:39.110 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.110 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.110 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:39.111 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.111 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.111 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.111 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:39.111 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.112 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.112 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.112 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:39.112 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.112 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.112 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.112 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.112 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:39.112 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:39.113 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.960056944000002, 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:39.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:39.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 29.957566498999999, 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.120 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:39.121 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:39.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 24.956830854, 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:39.125 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:39.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:39.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:39.131 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:39.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:39.131 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:39.131 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.131 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.131 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.131 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:39.131 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:39.131 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:39.134 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:39.133+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:39.137 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:39.140 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:39.142 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:13:39.145 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-05-07T11:13:38.948359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90268,"kb_used_data":888,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025252,"statfs":{"total":289910292480,"available":289817858048,"internally_reserved":0,"allocated":909312,"data_stored":1503647,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.685942"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279865+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:13:36.279865+0000","last_peered":"2024-05-07T11:13:36.279865+0000","last_clean":"2024-05-07T11:13:36.279865+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:13:36.279865+0000","last_undegraded":"2024-05-07T11:13:36.279865+0000","last_fullsized":"2024-05-07T11:13:36.279865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279496+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:13:36.279496+0000","last_peered":"2024-05-07T11:13:36.279496+0000","last_clean":"2024-05-07T11:13:36.279496+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:13:36.279496+0000","last_undegraded":"2024-05-07T11:13:36.279496+0000","last_fullsized":"2024-05-07T11:13:36.279496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264964+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:13:33.264964+0000","last_peered":"2024-05-07T11:13:33.264964+0000","last_clean":"2024-05-07T11:13:33.264964+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:13:33.264964+0000","last_undegraded":"2024-05-07T11:13:33.264964+0000","last_fullsized":"2024-05-07T11:13:33.264964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264934+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:13:33.264934+0000","last_peered":"2024-05-07T11:13:33.264934+0000","last_clean":"2024-05-07T11:13:33.264934+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:13:33.264934+0000","last_undegraded":"2024-05-07T11:13:33.264934+0000","last_fullsized":"2024-05-07T11:13:33.264934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279311+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:13:36.279311+0000","last_peered":"2024-05-07T11:13:36.279311+0000","last_clean":"2024-05-07T11:13:36.279311+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:13:36.279311+0000","last_undegraded":"2024-05-07T11:13:36.279311+0000","last_fullsized":"2024-05-07T11:13:36.279311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278985+0000","last_change":"2024-05-07T11:13:25.248711+0000","last_active":"2024-05-07T11:13:36.278985+0000","last_peered":"2024-05-07T11:13:36.278985+0000","last_clean":"2024-05-07T11:13:36.278985+0000","last_became_active":"2024-05-07T11:13:25.248452+0000","last_became_peered":"2024-05-07T11:13:25.248452+0000","last_unstale":"2024-05-07T11:13:36.278985+0000","last_undegraded":"2024-05-07T11:13:36.278985+0000","last_fullsized":"2024-05-07T11:13:36.278985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278888+0000","last_change":"2024-05-07T11:13:25.248071+0000","last_active":"2024-05-07T11:13:36.278888+0000","last_peered":"2024-05-07T11:13:36.278888+0000","last_clean":"2024-05-07T11:13:36.278888+0000","last_became_active":"2024-05-07T11:13:25.247861+0000","last_became_peered":"2024-05-07T11:13:25.247861+0000","last_unstale":"2024-05-07T11:13:36.278888+0000","last_undegraded":"2024-05-07T11:13:36.278888+0000","last_fullsized":"2024-05-07T11:13:36.278888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.057596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264333+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:13:33.264333+0000","last_peered":"2024-05-07T11:13:33.264333+0000","last_clean":"2024-05-07T11:13:33.264333+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:13:33.264333+0000","last_undegraded":"2024-05-07T11:13:33.264333+0000","last_fullsized":"2024-05-07T11:13:33.264333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279788+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:13:36.279788+0000","last_peered":"2024-05-07T11:13:36.279788+0000","last_clean":"2024-05-07T11:13:36.279788+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:13:36.279788+0000","last_undegraded":"2024-05-07T11:13:36.279788+0000","last_fullsized":"2024-05-07T11:13:36.279788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279561+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:13:36.279561+0000","last_peered":"2024-05-07T11:13:36.279561+0000","last_clean":"2024-05-07T11:13:36.279561+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:13:36.279561+0000","last_undegraded":"2024-05-07T11:13:36.279561+0000","last_fullsized":"2024-05-07T11:13:36.279561+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279538+0000","last_change":"2024-05-07T11:13:25.249909+0000","last_active":"2024-05-07T11:13:36.279538+0000","last_peered":"2024-05-07T11:13:36.279538+0000","last_clean":"2024-05-07T11:13:36.279538+0000","last_became_active":"2024-05-07T11:13:25.249670+0000","last_became_peered":"2024-05-07T11:13:25.249670+0000","last_unstale":"2024-05-07T11:13:36.279538+0000","last_undegraded":"2024-05-07T11:13:36.279538+0000","last_fullsized":"2024-05-07T11:13:36.279538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:31.697406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279404+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:13:36.279404+0000","last_peered":"2024-05-07T11:13:36.279404+0000","last_clean":"2024-05-07T11:13:36.279404+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:13:36.279404+0000","last_undegraded":"2024-05-07T11:13:36.279404+0000","last_fullsized":"2024-05-07T11:13:36.279404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279207+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:13:36.279207+0000","last_peered":"2024-05-07T11:13:36.279207+0000","last_clean":"2024-05-07T11:13:36.279207+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:13:36.279207+0000","last_undegraded":"2024-05-07T11:13:36.279207+0000","last_fullsized":"2024-05-07T11:13:36.279207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264516+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:13:33.264516+0000","last_peered":"2024-05-07T11:13:33.264516+0000","last_clean":"2024-05-07T11:13:33.264516+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:13:33.264516+0000","last_undegraded":"2024-05-07T11:13:33.264516+0000","last_fullsized":"2024-05-07T11:13:33.264516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264568+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:13:33.264568+0000","last_peered":"2024-05-07T11:13:33.264568+0000","last_clean":"2024-05-07T11:13:33.264568+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:13:33.264568+0000","last_undegraded":"2024-05-07T11:13:33.264568+0000","last_fullsized":"2024-05-07T11:13:33.264568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278899+0000","last_change":"2024-05-07T11:13:25.248991+0000","last_active":"2024-05-07T11:13:36.278899+0000","last_peered":"2024-05-07T11:13:36.278899+0000","last_clean":"2024-05-07T11:13:36.278899+0000","last_became_active":"2024-05-07T11:13:25.248693+0000","last_became_peered":"2024-05-07T11:13:25.248693+0000","last_unstale":"2024-05-07T11:13:36.278899+0000","last_undegraded":"2024-05-07T11:13:36.278899+0000","last_fullsized":"2024-05-07T11:13:36.278899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:27:15.749485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280170+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:13:36.280170+0000","last_peered":"2024-05-07T11:13:36.280170+0000","last_clean":"2024-05-07T11:13:36.280170+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:13:36.280170+0000","last_undegraded":"2024-05-07T11:13:36.280170+0000","last_fullsized":"2024-05-07T11:13:36.280170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279753+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:13:36.279753+0000","last_peered":"2024-05-07T11:13:36.279753+0000","last_clean":"2024-05-07T11:13:36.279753+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:13:36.279753+0000","last_undegraded":"2024-05-07T11:13:36.279753+0000","last_fullsized":"2024-05-07T11:13:36.279753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279663+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:13:36.279663+0000","last_peered":"2024-05-07T11:13:36.279663+0000","last_clean":"2024-05-07T11:13:36.279663+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:13:36.279663+0000","last_undegraded":"2024-05-07T11:13:36.279663+0000","last_fullsized":"2024-05-07T11:13:36.279663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264938+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:13:33.264938+0000","last_peered":"2024-05-07T11:13:33.264938+0000","last_clean":"2024-05-07T11:13:33.264938+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:13:33.264938+0000","last_undegraded":"2024-05-07T11:13:33.264938+0000","last_fullsized":"2024-05-07T11:13:33.264938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264785+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:13:33.264785+0000","last_peered":"2024-05-07T11:13:33.264785+0000","last_clean":"2024-05-07T11:13:33.264785+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:13:33.264785+0000","last_undegraded":"2024-05-07T11:13:33.264785+0000","last_fullsized":"2024-05-07T11:13:33.264785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279101+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:13:36.279101+0000","last_peered":"2024-05-07T11:13:36.279101+0000","last_clean":"2024-05-07T11:13:36.279101+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:13:36.279101+0000","last_undegraded":"2024-05-07T11:13:36.279101+0000","last_fullsized":"2024-05-07T11:13:36.279101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278899+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:13:36.278899+0000","last_peered":"2024-05-07T11:13:36.278899+0000","last_clean":"2024-05-07T11:13:36.278899+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:13:36.278899+0000","last_undegraded":"2024-05-07T11:13:36.278899+0000","last_fullsized":"2024-05-07T11:13:36.278899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278943+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:13:36.278943+0000","last_peered":"2024-05-07T11:13:36.278943+0000","last_clean":"2024-05-07T11:13:36.278943+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:13:36.278943+0000","last_undegraded":"2024-05-07T11:13:36.278943+0000","last_fullsized":"2024-05-07T11:13:36.278943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279880+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:13:36.279880+0000","last_peered":"2024-05-07T11:13:36.279880+0000","last_clean":"2024-05-07T11:13:36.279880+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:13:36.279880+0000","last_undegraded":"2024-05-07T11:13:36.279880+0000","last_fullsized":"2024-05-07T11:13:36.279880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279865+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:13:36.279865+0000","last_peered":"2024-05-07T11:13:36.279865+0000","last_clean":"2024-05-07T11:13:36.279865+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:13:36.279865+0000","last_undegraded":"2024-05-07T11:13:36.279865+0000","last_fullsized":"2024-05-07T11:13:36.279865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279769+0000","last_change":"2024-05-07T11:13:25.249860+0000","last_active":"2024-05-07T11:13:36.279769+0000","last_peered":"2024-05-07T11:13:36.279769+0000","last_clean":"2024-05-07T11:13:36.279769+0000","last_became_active":"2024-05-07T11:13:25.249519+0000","last_became_peered":"2024-05-07T11:13:25.249519+0000","last_unstale":"2024-05-07T11:13:36.279769+0000","last_undegraded":"2024-05-07T11:13:36.279769+0000","last_fullsized":"2024-05-07T11:13:36.279769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279613+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:13:36.279613+0000","last_peered":"2024-05-07T11:13:36.279613+0000","last_clean":"2024-05-07T11:13:36.279613+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:13:36.279613+0000","last_undegraded":"2024-05-07T11:13:36.279613+0000","last_fullsized":"2024-05-07T11:13:36.279613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279493+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:13:36.279493+0000","last_peered":"2024-05-07T11:13:36.279493+0000","last_clean":"2024-05-07T11:13:36.279493+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:13:36.279493+0000","last_undegraded":"2024-05-07T11:13:36.279493+0000","last_fullsized":"2024-05-07T11:13:36.279493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279262+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:13:36.279262+0000","last_peered":"2024-05-07T11:13:36.279262+0000","last_clean":"2024-05-07T11:13:36.279262+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:13:36.279262+0000","last_undegraded":"2024-05-07T11:13:36.279262+0000","last_fullsized":"2024-05-07T11:13:36.279262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279012+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:13:36.279012+0000","last_peered":"2024-05-07T11:13:36.279012+0000","last_clean":"2024-05-07T11:13:36.279012+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:13:36.279012+0000","last_undegraded":"2024-05-07T11:13:36.279012+0000","last_fullsized":"2024-05-07T11:13:36.279012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264391+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:13:33.264391+0000","last_peered":"2024-05-07T11:13:33.264391+0000","last_clean":"2024-05-07T11:13:33.264391+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:13:33.264391+0000","last_undegraded":"2024-05-07T11:13:33.264391+0000","last_fullsized":"2024-05-07T11:13:33.264391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279503+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:13:36.279503+0000","last_peered":"2024-05-07T11:13:36.279503+0000","last_clean":"2024-05-07T11:13:36.279503+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:13:36.279503+0000","last_undegraded":"2024-05-07T11:13:36.279503+0000","last_fullsized":"2024-05-07T11:13:36.279503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264896+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:13:33.264896+0000","last_peered":"2024-05-07T11:13:33.264896+0000","last_clean":"2024-05-07T11:13:33.264896+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:13:33.264896+0000","last_undegraded":"2024-05-07T11:13:33.264896+0000","last_fullsized":"2024-05-07T11:13:33.264896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279606+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:13:36.279606+0000","last_peered":"2024-05-07T11:13:36.279606+0000","last_clean":"2024-05-07T11:13:36.279606+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:13:36.279606+0000","last_undegraded":"2024-05-07T11:13:36.279606+0000","last_fullsized":"2024-05-07T11:13:36.279606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279252+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:13:36.279252+0000","last_peered":"2024-05-07T11:13:36.279252+0000","last_clean":"2024-05-07T11:13:36.279252+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:13:36.279252+0000","last_undegraded":"2024-05-07T11:13:36.279252+0000","last_fullsized":"2024-05-07T11:13:36.279252+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279974+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:13:36.279974+0000","last_peered":"2024-05-07T11:13:36.279974+0000","last_clean":"2024-05-07T11:13:36.279974+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:13:36.279974+0000","last_undegraded":"2024-05-07T11:13:36.279974+0000","last_fullsized":"2024-05-07T11:13:36.279974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279113+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:13:36.279113+0000","last_peered":"2024-05-07T11:13:36.279113+0000","last_clean":"2024-05-07T11:13:36.279113+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:13:36.279113+0000","last_undegraded":"2024-05-07T11:13:36.279113+0000","last_fullsized":"2024-05-07T11:13:36.279113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279920+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:13:36.279920+0000","last_peered":"2024-05-07T11:13:36.279920+0000","last_clean":"2024-05-07T11:13:36.279920+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:13:36.279920+0000","last_undegraded":"2024-05-07T11:13:36.279920+0000","last_fullsized":"2024-05-07T11:13:36.279920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264567+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:13:33.264567+0000","last_peered":"2024-05-07T11:13:33.264567+0000","last_clean":"2024-05-07T11:13:33.264567+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:13:33.264567+0000","last_undegraded":"2024-05-07T11:13:33.264567+0000","last_fullsized":"2024-05-07T11:13:33.264567+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265282+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:13:33.265282+0000","last_peered":"2024-05-07T11:13:33.265282+0000","last_clean":"2024-05-07T11:13:33.265282+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:13:33.265282+0000","last_undegraded":"2024-05-07T11:13:33.265282+0000","last_fullsized":"2024-05-07T11:13:33.265282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.278953+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:13:36.278953+0000","last_peered":"2024-05-07T11:13:36.278953+0000","last_clean":"2024-05-07T11:13:36.278953+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:13:36.278953+0000","last_undegraded":"2024-05-07T11:13:36.278953+0000","last_fullsized":"2024-05-07T11:13:36.278953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279759+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:13:36.279759+0000","last_peered":"2024-05-07T11:13:36.279759+0000","last_clean":"2024-05-07T11:13:36.279759+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:13:36.279759+0000","last_undegraded":"2024-05-07T11:13:36.279759+0000","last_fullsized":"2024-05-07T11:13:36.279759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279011+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:13:36.279011+0000","last_peered":"2024-05-07T11:13:36.279011+0000","last_clean":"2024-05-07T11:13:36.279011+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:13:36.279011+0000","last_undegraded":"2024-05-07T11:13:36.279011+0000","last_fullsized":"2024-05-07T11:13:36.279011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279489+0000","last_change":"2024-05-07T11:13:25.249690+0000","last_active":"2024-05-07T11:13:36.279489+0000","last_peered":"2024-05-07T11:13:36.279489+0000","last_clean":"2024-05-07T11:13:36.279489+0000","last_became_active":"2024-05-07T11:13:25.249304+0000","last_became_peered":"2024-05-07T11:13:25.249304+0000","last_unstale":"2024-05-07T11:13:36.279489+0000","last_undegraded":"2024-05-07T11:13:36.279489+0000","last_fullsized":"2024-05-07T11:13:36.279489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:30.051793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264540+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:13:33.264540+0000","last_peered":"2024-05-07T11:13:33.264540+0000","last_clean":"2024-05-07T11:13:33.264540+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:13:33.264540+0000","last_undegraded":"2024-05-07T11:13:33.264540+0000","last_fullsized":"2024-05-07T11:13:33.264540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279612+0000","last_change":"2024-05-07T11:13:25.249164+0000","last_active":"2024-05-07T11:13:36.279612+0000","last_peered":"2024-05-07T11:13:36.279612+0000","last_clean":"2024-05-07T11:13:36.279612+0000","last_became_active":"2024-05-07T11:13:25.248783+0000","last_became_peered":"2024-05-07T11:13:25.248783+0000","last_unstale":"2024-05-07T11:13:36.279612+0000","last_undegraded":"2024-05-07T11:13:36.279612+0000","last_fullsized":"2024-05-07T11:13:36.279612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:00.987017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279361+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:13:36.279361+0000","last_peered":"2024-05-07T11:13:36.279361+0000","last_clean":"2024-05-07T11:13:36.279361+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:13:36.279361+0000","last_undegraded":"2024-05-07T11:13:36.279361+0000","last_fullsized":"2024-05-07T11:13:36.279361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279616+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:13:36.279616+0000","last_peered":"2024-05-07T11:13:36.279616+0000","last_clean":"2024-05-07T11:13:36.279616+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:13:36.279616+0000","last_undegraded":"2024-05-07T11:13:36.279616+0000","last_fullsized":"2024-05-07T11:13:36.279616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265030+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:13:33.265030+0000","last_peered":"2024-05-07T11:13:33.265030+0000","last_clean":"2024-05-07T11:13:33.265030+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:13:33.265030+0000","last_undegraded":"2024-05-07T11:13:33.265030+0000","last_fullsized":"2024-05-07T11:13:33.265030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264713+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:13:33.264713+0000","last_peered":"2024-05-07T11:13:33.264713+0000","last_clean":"2024-05-07T11:13:33.264713+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:13:33.264713+0000","last_undegraded":"2024-05-07T11:13:33.264713+0000","last_fullsized":"2024-05-07T11:13:33.264713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265482+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:13:33.265482+0000","last_peered":"2024-05-07T11:13:33.265482+0000","last_clean":"2024-05-07T11:13:33.265482+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:13:33.265482+0000","last_undegraded":"2024-05-07T11:13:33.265482+0000","last_fullsized":"2024-05-07T11:13:33.265482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279151+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:13:36.279151+0000","last_peered":"2024-05-07T11:13:36.279151+0000","last_clean":"2024-05-07T11:13:36.279151+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:13:36.279151+0000","last_undegraded":"2024-05-07T11:13:36.279151+0000","last_fullsized":"2024-05-07T11:13:36.279151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265390+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:13:33.265390+0000","last_peered":"2024-05-07T11:13:33.265390+0000","last_clean":"2024-05-07T11:13:33.265390+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:13:33.265390+0000","last_undegraded":"2024-05-07T11:13:33.265390+0000","last_fullsized":"2024-05-07T11:13:33.265390+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279033+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:13:36.279033+0000","last_peered":"2024-05-07T11:13:36.279033+0000","last_clean":"2024-05-07T11:13:36.279033+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:13:36.279033+0000","last_undegraded":"2024-05-07T11:13:36.279033+0000","last_fullsized":"2024-05-07T11:13:36.279033+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279896+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:13:36.279896+0000","last_peered":"2024-05-07T11:13:36.279896+0000","last_clean":"2024-05-07T11:13:36.279896+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:13:36.279896+0000","last_undegraded":"2024-05-07T11:13:36.279896+0000","last_fullsized":"2024-05-07T11:13:36.279896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":242,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264780+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:13:33.264780+0000","last_peered":"2024-05-07T11:13:33.264780+0000","last_clean":"2024-05-07T11:13:33.264780+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:13:33.264780+0000","last_undegraded":"2024-05-07T11:13:33.264780+0000","last_fullsized":"2024-05-07T11:13:33.264780+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264988+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:13:33.264988+0000","last_peered":"2024-05-07T11:13:33.264988+0000","last_clean":"2024-05-07T11:13:33.264988+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:13:33.264988+0000","last_undegraded":"2024-05-07T11:13:33.264988+0000","last_fullsized":"2024-05-07T11:13:33.264988+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279357+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:13:36.279357+0000","last_peered":"2024-05-07T11:13:36.279357+0000","last_clean":"2024-05-07T11:13:36.279357+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:13:36.279357+0000","last_undegraded":"2024-05-07T11:13:36.279357+0000","last_fullsized":"2024-05-07T11:13:36.279357+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279445+0000","last_change":"2024-05-07T11:13:25.249760+0000","last_active":"2024-05-07T11:13:36.279445+0000","last_peered":"2024-05-07T11:13:36.279445+0000","last_clean":"2024-05-07T11:13:36.279445+0000","last_became_active":"2024-05-07T11:13:25.249466+0000","last_became_peered":"2024-05-07T11:13:25.249466+0000","last_unstale":"2024-05-07T11:13:36.279445+0000","last_undegraded":"2024-05-07T11:13:36.279445+0000","last_fullsized":"2024-05-07T11:13:36.279445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264688+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:13:33.264688+0000","last_peered":"2024-05-07T11:13:33.264688+0000","last_clean":"2024-05-07T11:13:33.264688+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:13:33.264688+0000","last_undegraded":"2024-05-07T11:13:33.264688+0000","last_fullsized":"2024-05-07T11:13:33.264688+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279195+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:13:36.279195+0000","last_peered":"2024-05-07T11:13:36.279195+0000","last_clean":"2024-05-07T11:13:36.279195+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:13:36.279195+0000","last_undegraded":"2024-05-07T11:13:36.279195+0000","last_fullsized":"2024-05-07T11:13:36.279195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279632+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:13:36.279632+0000","last_peered":"2024-05-07T11:13:36.279632+0000","last_clean":"2024-05-07T11:13:36.279632+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:13:36.279632+0000","last_undegraded":"2024-05-07T11:13:36.279632+0000","last_fullsized":"2024-05-07T11:13:36.279632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279292+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:13:36.279292+0000","last_peered":"2024-05-07T11:13:36.279292+0000","last_clean":"2024-05-07T11:13:36.279292+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:13:36.279292+0000","last_undegraded":"2024-05-07T11:13:36.279292+0000","last_fullsized":"2024-05-07T11:13:36.279292+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279053+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:13:36.279053+0000","last_peered":"2024-05-07T11:13:36.279053+0000","last_clean":"2024-05-07T11:13:36.279053+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:13:36.279053+0000","last_undegraded":"2024-05-07T11:13:36.279053+0000","last_fullsized":"2024-05-07T11:13:36.279053+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279998+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:13:36.279998+0000","last_peered":"2024-05-07T11:13:36.279998+0000","last_clean":"2024-05-07T11:13:36.279998+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:13:36.279998+0000","last_undegraded":"2024-05-07T11:13:36.279998+0000","last_fullsized":"2024-05-07T11:13:36.279998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264732+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:13:33.264732+0000","last_peered":"2024-05-07T11:13:33.264732+0000","last_clean":"2024-05-07T11:13:33.264732+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:13:33.264732+0000","last_undegraded":"2024-05-07T11:13:33.264732+0000","last_fullsized":"2024-05-07T11:13:33.264732+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264969+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:13:33.264969+0000","last_peered":"2024-05-07T11:13:33.264969+0000","last_clean":"2024-05-07T11:13:33.264969+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:13:33.264969+0000","last_undegraded":"2024-05-07T11:13:33.264969+0000","last_fullsized":"2024-05-07T11:13:33.264969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279797+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:13:36.279797+0000","last_peered":"2024-05-07T11:13:36.279797+0000","last_clean":"2024-05-07T11:13:36.279797+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:13:36.279797+0000","last_undegraded":"2024-05-07T11:13:36.279797+0000","last_fullsized":"2024-05-07T11:13:36.279797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279627+0000","last_change":"2024-05-07T11:13:25.249176+0000","last_active":"2024-05-07T11:13:36.279627+0000","last_peered":"2024-05-07T11:13:36.279627+0000","last_clean":"2024-05-07T11:13:36.279627+0000","last_became_active":"2024-05-07T11:13:25.248831+0000","last_became_peered":"2024-05-07T11:13:25.248831+0000","last_unstale":"2024-05-07T11:13:36.279627+0000","last_undegraded":"2024-05-07T11:13:36.279627+0000","last_fullsized":"2024-05-07T11:13:36.279627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:48:30.756870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279890+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:13:36.279890+0000","last_peered":"2024-05-07T11:13:36.279890+0000","last_clean":"2024-05-07T11:13:36.279890+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:13:36.279890+0000","last_undegraded":"2024-05-07T11:13:36.279890+0000","last_fullsized":"2024-05-07T11:13:36.279890+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279128+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:13:36.279128+0000","last_peered":"2024-05-07T11:13:36.279128+0000","last_clean":"2024-05-07T11:13:36.279128+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:13:36.279128+0000","last_undegraded":"2024-05-07T11:13:36.279128+0000","last_fullsized":"2024-05-07T11:13:36.279128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279805+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:13:36.279805+0000","last_peered":"2024-05-07T11:13:36.279805+0000","last_clean":"2024-05-07T11:13:36.279805+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:13:36.279805+0000","last_undegraded":"2024-05-07T11:13:36.279805+0000","last_fullsized":"2024-05-07T11:13:36.279805+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279806+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:13:36.279806+0000","last_peered":"2024-05-07T11:13:36.279806+0000","last_clean":"2024-05-07T11:13:36.279806+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:13:36.279806+0000","last_undegraded":"2024-05-07T11:13:36.279806+0000","last_fullsized":"2024-05-07T11:13:36.279806+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279303+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:13:36.279303+0000","last_peered":"2024-05-07T11:13:36.279303+0000","last_clean":"2024-05-07T11:13:36.279303+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:13:36.279303+0000","last_undegraded":"2024-05-07T11:13:36.279303+0000","last_fullsized":"2024-05-07T11:13:36.279303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280244+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:13:36.280244+0000","last_peered":"2024-05-07T11:13:36.280244+0000","last_clean":"2024-05-07T11:13:36.280244+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:13:36.280244+0000","last_undegraded":"2024-05-07T11:13:36.280244+0000","last_fullsized":"2024-05-07T11:13:36.280244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280067+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:13:36.280067+0000","last_peered":"2024-05-07T11:13:36.280067+0000","last_clean":"2024-05-07T11:13:36.280067+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:13:36.280067+0000","last_undegraded":"2024-05-07T11:13:36.280067+0000","last_fullsized":"2024-05-07T11:13:36.280067+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279129+0000","last_change":"2024-05-07T11:13:25.248884+0000","last_active":"2024-05-07T11:13:36.279129+0000","last_peered":"2024-05-07T11:13:36.279129+0000","last_clean":"2024-05-07T11:13:36.279129+0000","last_became_active":"2024-05-07T11:13:25.248619+0000","last_became_peered":"2024-05-07T11:13:25.248619+0000","last_unstale":"2024-05-07T11:13:36.279129+0000","last_undegraded":"2024-05-07T11:13:36.279129+0000","last_fullsized":"2024-05-07T11:13:36.279129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280063+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:13:36.280063+0000","last_peered":"2024-05-07T11:13:36.280063+0000","last_clean":"2024-05-07T11:13:36.280063+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:13:36.280063+0000","last_undegraded":"2024-05-07T11:13:36.280063+0000","last_fullsized":"2024-05-07T11:13:36.280063+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265310+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:13:33.265310+0000","last_peered":"2024-05-07T11:13:33.265310+0000","last_clean":"2024-05-07T11:13:33.265310+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:13:33.265310+0000","last_undegraded":"2024-05-07T11:13:33.265310+0000","last_fullsized":"2024-05-07T11:13:33.265310+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279016+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:13:36.279016+0000","last_peered":"2024-05-07T11:13:36.279016+0000","last_clean":"2024-05-07T11:13:36.279016+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:13:36.279016+0000","last_undegraded":"2024-05-07T11:13:36.279016+0000","last_fullsized":"2024-05-07T11:13:36.279016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264746+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:13:33.264746+0000","last_peered":"2024-05-07T11:13:33.264746+0000","last_clean":"2024-05-07T11:13:33.264746+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:13:33.264746+0000","last_undegraded":"2024-05-07T11:13:33.264746+0000","last_fullsized":"2024-05-07T11:13:33.264746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265135+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:13:33.265135+0000","last_peered":"2024-05-07T11:13:33.265135+0000","last_clean":"2024-05-07T11:13:33.265135+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:13:33.265135+0000","last_undegraded":"2024-05-07T11:13:33.265135+0000","last_fullsized":"2024-05-07T11:13:33.265135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279143+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:13:36.279143+0000","last_peered":"2024-05-07T11:13:36.279143+0000","last_clean":"2024-05-07T11:13:36.279143+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:13:36.279143+0000","last_undegraded":"2024-05-07T11:13:36.279143+0000","last_fullsized":"2024-05-07T11:13:36.279143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279739+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:13:36.279739+0000","last_peered":"2024-05-07T11:13:36.279739+0000","last_clean":"2024-05-07T11:13:36.279739+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:13:36.279739+0000","last_undegraded":"2024-05-07T11:13:36.279739+0000","last_fullsized":"2024-05-07T11:13:36.279739+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279818+0000","last_change":"2024-05-07T11:13:25.249281+0000","last_active":"2024-05-07T11:13:36.279818+0000","last_peered":"2024-05-07T11:13:36.279818+0000","last_clean":"2024-05-07T11:13:36.279818+0000","last_became_active":"2024-05-07T11:13:25.249068+0000","last_became_peered":"2024-05-07T11:13:25.249068+0000","last_unstale":"2024-05-07T11:13:36.279818+0000","last_undegraded":"2024-05-07T11:13:36.279818+0000","last_fullsized":"2024-05-07T11:13:36.279818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:30:57.180798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279018+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:13:36.279018+0000","last_peered":"2024-05-07T11:13:36.279018+0000","last_clean":"2024-05-07T11:13:36.279018+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:13:36.279018+0000","last_undegraded":"2024-05-07T11:13:36.279018+0000","last_fullsized":"2024-05-07T11:13:36.279018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280147+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:13:36.280147+0000","last_peered":"2024-05-07T11:13:36.280147+0000","last_clean":"2024-05-07T11:13:36.280147+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:13:36.280147+0000","last_undegraded":"2024-05-07T11:13:36.280147+0000","last_fullsized":"2024-05-07T11:13:36.280147+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279034+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:13:36.279034+0000","last_peered":"2024-05-07T11:13:36.279034+0000","last_clean":"2024-05-07T11:13:36.279034+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:13:36.279034+0000","last_undegraded":"2024-05-07T11:13:36.279034+0000","last_fullsized":"2024-05-07T11:13:36.279034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279938+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:13:36.279938+0000","last_peered":"2024-05-07T11:13:36.279938+0000","last_clean":"2024-05-07T11:13:36.279938+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:13:36.279938+0000","last_undegraded":"2024-05-07T11:13:36.279938+0000","last_fullsized":"2024-05-07T11:13:36.279938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279160+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:13:36.279160+0000","last_peered":"2024-05-07T11:13:36.279160+0000","last_clean":"2024-05-07T11:13:36.279160+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:13:36.279160+0000","last_undegraded":"2024-05-07T11:13:36.279160+0000","last_fullsized":"2024-05-07T11:13:36.279160+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279763+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:13:36.279763+0000","last_peered":"2024-05-07T11:13:36.279763+0000","last_clean":"2024-05-07T11:13:36.279763+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:13:36.279763+0000","last_undegraded":"2024-05-07T11:13:36.279763+0000","last_fullsized":"2024-05-07T11:13:36.279763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279143+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:13:36.279143+0000","last_peered":"2024-05-07T11:13:36.279143+0000","last_clean":"2024-05-07T11:13:36.279143+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:13:36.279143+0000","last_undegraded":"2024-05-07T11:13:36.279143+0000","last_fullsized":"2024-05-07T11:13:36.279143+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279543+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:13:36.279543+0000","last_peered":"2024-05-07T11:13:36.279543+0000","last_clean":"2024-05-07T11:13:36.279543+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:13:36.279543+0000","last_undegraded":"2024-05-07T11:13:36.279543+0000","last_fullsized":"2024-05-07T11:13:36.279543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279323+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:13:36.279323+0000","last_peered":"2024-05-07T11:13:36.279323+0000","last_clean":"2024-05-07T11:13:36.279323+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:13:36.279323+0000","last_undegraded":"2024-05-07T11:13:36.279323+0000","last_fullsized":"2024-05-07T11:13:36.279323+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279405+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:13:36.279405+0000","last_peered":"2024-05-07T11:13:36.279405+0000","last_clean":"2024-05-07T11:13:36.279405+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:13:36.279405+0000","last_undegraded":"2024-05-07T11:13:36.279405+0000","last_fullsized":"2024-05-07T11:13:36.279405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279405+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:13:36.279405+0000","last_peered":"2024-05-07T11:13:36.279405+0000","last_clean":"2024-05-07T11:13:36.279405+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:13:36.279405+0000","last_undegraded":"2024-05-07T11:13:36.279405+0000","last_fullsized":"2024-05-07T11:13:36.279405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264579+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:13:33.264579+0000","last_peered":"2024-05-07T11:13:33.264579+0000","last_clean":"2024-05-07T11:13:33.264579+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:13:33.264579+0000","last_undegraded":"2024-05-07T11:13:33.264579+0000","last_fullsized":"2024-05-07T11:13:33.264579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.265071+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:13:33.265071+0000","last_peered":"2024-05-07T11:13:33.265071+0000","last_clean":"2024-05-07T11:13:33.265071+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:13:33.265071+0000","last_undegraded":"2024-05-07T11:13:33.265071+0000","last_fullsized":"2024-05-07T11:13:33.265071+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264614+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:13:33.264614+0000","last_peered":"2024-05-07T11:13:33.264614+0000","last_clean":"2024-05-07T11:13:33.264614+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:13:33.264614+0000","last_undegraded":"2024-05-07T11:13:33.264614+0000","last_fullsized":"2024-05-07T11:13:33.264614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279661+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:13:36.279661+0000","last_peered":"2024-05-07T11:13:36.279661+0000","last_clean":"2024-05-07T11:13:36.279661+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:13:36.279661+0000","last_undegraded":"2024-05-07T11:13:36.279661+0000","last_fullsized":"2024-05-07T11:13:36.279661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279212+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:13:36.279212+0000","last_peered":"2024-05-07T11:13:36.279212+0000","last_clean":"2024-05-07T11:13:36.279212+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:13:36.279212+0000","last_undegraded":"2024-05-07T11:13:36.279212+0000","last_fullsized":"2024-05-07T11:13:36.279212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.279957+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:13:36.279957+0000","last_peered":"2024-05-07T11:13:36.279957+0000","last_clean":"2024-05-07T11:13:36.279957+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:13:36.279957+0000","last_undegraded":"2024-05-07T11:13:36.279957+0000","last_fullsized":"2024-05-07T11:13:36.279957+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-07T11:13:33.264605+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:13:33.264605+0000","last_peered":"2024-05-07T11:13:33.264605+0000","last_clean":"2024-05-07T11:13:33.264605+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:13:33.264605+0000","last_undegraded":"2024-05-07T11:13:33.264605+0000","last_fullsized":"2024-05-07T11:13:33.264605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T11:13:36.280027+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:13:36.280027+0000","last_peered":"2024-05-07T11:13:36.280027+0000","last_clean":"2024-05-07T11:13:36.280027+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:13:36.280027+0000","last_undegraded":"2024-05-07T11:13:36.280027+0000","last_fullsized":"2024-05-07T11:13:36.280027+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":699035,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":702680,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":101932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:13:39.149 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-07T11:13:39.149 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:13:39.149 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-05-07T11:13:39.149 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-05-07T11:13:39.149 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-05-07T11:13:39.149 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-05-07T11:13:39.234 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:39.234+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:39.258 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:39.259 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:39.259 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:39.259 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:39.259 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:39.259 INFO:teuthology.orchestra.run.smithi175.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-05-07T11:13:39.259 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:39.269 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-05-07T11:13:39.334 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:39.335+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:39.374 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:39.375 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:39.383 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:39.435 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:39.435+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:39.492 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:39.492 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:39.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:39.492 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:39.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.492 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:39.492 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:39.492 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.723654379999999, 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.496 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.057099223999998, 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:39.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:39.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:39.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.827492132000003, 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:39.501 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:39.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:39.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:39.506 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.506 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.506 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.506 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:39.506 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.826816958000002, 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:39.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:39.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:39.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:39.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:39.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.826175137, 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.825706728999997, 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.516 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.823001208000001, 2024-05-07T11:13:39.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:39.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.524 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.445684827000001, 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.525 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:39.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:39.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:39.530 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.445628052000004, 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.445599581000003, 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.536 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:39.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.445560786999998, 2024-05-07T11:13:39.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:39.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:39.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.548 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.445517463999998, 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:39.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:39.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:39.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.445494912999997, 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:39.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:39.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.445470853000003, 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:39.562 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.568 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.445451892999998, 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.445425221000001, 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.574 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:39.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:39.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:39.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.579 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:39.579 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:39.579 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.440920961000003, 2024-05-07T11:13:39.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:39.579 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.579 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.579 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.579 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:39.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:39.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:39.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:39.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:39.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:39.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:39.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:39.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:39.587 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.587 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.587 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.587 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:39.588 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:39.588 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.439194434000001, 2024-05-07T11:13:39.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.439042100000002, 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.438989128000003, 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.601 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.601 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.601 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:39.601 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:39.601 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:39.602 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:39.602+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:39.603 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:39.702 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:39.703+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:39.709 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:39.709 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:39.709 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:39.709 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:39.718 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:39.804 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:39.803+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:39.822 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:39.822 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:39.822 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:39.822 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:39.822 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:39.831 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:39.904 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:39.904+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:39.937 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 60.989328354000001, 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:39.938 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:39.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.943 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 60.665102466999997, 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:39.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:39.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:39.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 60.504627067999998, 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:39.949 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 60.5045407, 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.959 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 60.275393266999998, 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.960 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:39.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:39.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:39.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:39.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 60.275345801999997, 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.965 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.970 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.893433414, 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.976 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.89123833, 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:39.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:39.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:39.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.891010110000003, 2024-05-07T11:13:39.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.890830979999997, 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.988 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:39.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:39.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:39.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.890771106000003, 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:39.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:39.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.890722934000003, 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:39.999 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:40.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:40.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:40.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:40.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.890694951999997, 2024-05-07T11:13:40.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:40.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.009 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.890661942000001, 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:40.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:40.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:40.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:40.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.890568137999999, 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:40.020 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.890424695999997, 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:40.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:40.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:40.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:40.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:40.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:40.026 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.890239790999999, 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:40.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:40.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:40.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.890080720999997, 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:40.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.889637311999998, 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:40.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:40.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:40.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:40.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.889612048000004, 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:40.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:40.045 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.046 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:40.046 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:40.046 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:40.047 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:40.046+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:40.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:40.148 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:40.148+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:40.163 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:40.163 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:40.172 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:40.249 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:40.249+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:40.277 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:40.277 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:40.277 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:40.278 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:40.278 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:40.286 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:40.351 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:40.350+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:40.435 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.390831831, 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.390767111000002, 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:40.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.390670170999996, 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.390604832999998, 2024-05-07T11:13:40.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.390577940999997, 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.460 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:40.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:40.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:40.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:40.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:40.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.390550363000003, 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:40.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:40.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:40.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:40.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.390514973999998, 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.471 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:40.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:40.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.390489367000001, 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.390459937000003, 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.388073962999997, 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.483 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:40.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.383815423999998, 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.383167421000003, 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.382522102000003, 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.382248537999999, 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:40.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:40.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.381488533999999, 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.380903914999998, 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:40.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.377147106000002, 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.510 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:40.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:40.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.513 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.392131071999998, 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:40.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:40.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:40.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:40.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.389640626999999, 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:40.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.388904982, 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:40.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:40.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:40.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:40.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:40.529 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.529 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.529 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.529 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:40.529 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:40.529 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:40.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:40.531 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:40.530+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:40.631 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:40.631+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:40.641 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:40.641 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:40.641 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:40.641 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:40.649 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:40.732 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:40.732+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:40.754 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:40.754 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:40.754 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:40.754 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:40.754 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:40.763 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:40.833 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:40.832+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:40.910 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:40.910 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:40.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:40.910 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:40.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.910 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:40.910 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:40.910 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 62.143090987000001, 2024-05-07T11:13:40.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:40.910 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.476535831, 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:40.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.246928738999998, 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.922 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.246253565000004, 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:40.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:40.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:40.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:40.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.245611744000001, 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:40.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.245143335999998, 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:40.935 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.242437815000002, 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:40.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:40.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.865121434000002, 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.940 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:40.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:40.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:40.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:40.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:40.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.865064658999998, 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:40.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:40.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.865036187999998, 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.864997394, 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:40.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:40.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:40.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:40.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:40.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.864954071, 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:40.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.969 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.864931519999999, 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:40.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:40.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.864907459999998, 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:40.975 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:40.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:40.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:40.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.864888499999999, 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:40.981 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.864861828000002, 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:40.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:40.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:40.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.860357567999998, 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:40.990 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:40.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:40.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:40.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:40.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.858631041000002, 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:40.995 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:40.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:40.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.858478707000003, 2024-05-07T11:13:40.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:41.000 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:41.000 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:41.000 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:41.000 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:41.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:41.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:41.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.858425734999997, 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:41.004 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:41.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:41.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:41.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:41.011 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:41.011 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:41.010+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:41.112 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:41.111+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:41.126 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:41.126 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:41.127 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:41.127 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:41.136 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:41.137 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:41.137 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:41.155 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:41.155 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:41.173 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:41.173 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:41.212 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:41.212+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:41.241 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:41.241 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:41.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:41.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T11:13:41.313 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:41.312+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:41.355 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:41.355 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:41.363 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:41.414 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:41.414+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:41.480 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:41.480 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:41.489 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:41.515 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:41.514+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:41.595 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:41.596 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:41.605 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:41.648 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:41.648+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:41.710 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:41.710 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:41.717 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:41.716+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:41.719 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:41.818 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:41.819+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:41.835 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:41.835 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:41.844 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:41.920 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:41.919+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:41.950 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:41.951 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:41.959 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:42.021 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:42.021+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:42.105 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:42.105 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:42.114 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:42.121 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:42.121+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:42.222 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:42.222+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:42.229 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:42.229 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:42.241 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-05-07T11:13:42.323 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:42.322+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:42.348 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:42.348 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:42.357 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:42.425 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:42.425+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:42.502 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:42.502 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:42.511 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:42.554 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:42.554+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:42.626 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:42.626+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:42.628 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:42.628 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:42.637 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:42.727 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:42.726+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:42.783 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:42.784 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:42.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:42.828 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:42.827+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:42.929 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:42.929+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:42.937 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:42.937 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:42.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:43.030 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:43.029+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:43.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:43.131 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:43.131+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:43.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:43.216 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:43.216 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:43.225 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:43.232 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:43.232+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:43.320 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:43.320 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:43.329 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:43.330 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:43.333 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:43.332+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:43.339 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:43.344 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:43.344 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:43.367 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:43.367 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:43.434 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:43.435+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:43.448 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:43.448 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:43.448 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:43.448 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:43.457 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:43.535 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:43.534+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:43.562 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:43.563 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:43.571 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:43.636 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:43.636+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.730516972000004, 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.679 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:43.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:43.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:43.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:43.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:43.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:43.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:43.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:43.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.406291085000007, 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.686 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:43.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:43.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:43.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:43.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.245815686, 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:43.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.245729318000002, 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:43.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:43.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.016581884999994, 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:43.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:43.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.016534419999999, 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:43.710 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:43.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:43.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:43.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:43.718 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.718 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.718 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.634622032000003, 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:43.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:43.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:43.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:43.725 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.725 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.725 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.725 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.726 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:43.726 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.632426948000003, 2024-05-07T11:13:43.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:43.727 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.727 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.727 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.727 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:43.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:43.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:43.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:43.733 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.632198727999999, 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.741 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.632019597999999, 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:43.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:43.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.631959723999998, 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.748 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:43.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.631911551999998, 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.759 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:43.760 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.631883569999999, 2024-05-07T11:13:43.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:43.760 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.760 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:43.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:43.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.765 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.631850559999997, 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:43.770 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.631756756000001, 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.776 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.631613313999999, 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:43.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:43.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:43.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:43.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.631428409000002, 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:43.787 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.631269338999999, 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.63082593, 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:43.793 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:43.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.630800665999999, 2024-05-07T11:13:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:43.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:43.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:43.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:43.802 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.802 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.802 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.802 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:43.802 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:43.802 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:43.804 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:43.804 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:43.804+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:43.904 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:43.904+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:43.917 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:43.917 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:43.917 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:43.918 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:43.926 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:44.005 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:44.005+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:44.031 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:44.031 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:44.031 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:44.031 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:44.032 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:44.040 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:44.106 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:44.106+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:44.146 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:44.146 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:44.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:44.146 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:44.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.146 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.146 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:44.146 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.101901779999999, 2024-05-07T11:13:44.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:44.146 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.101837060000001, 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.152 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:44.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:44.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:44.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.101740120000002, 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:44.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:44.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:44.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:44.163 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.101674782000003, 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.169 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.101647890000002, 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:44.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:44.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:44.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.101620312000001, 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.180 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.101584922999997, 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:44.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.184 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.101559315999999, 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:44.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:44.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.189 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.101529886000002, 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:44.193 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.099143912000002, 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:44.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:44.196 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.094885372999997, 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.094237370000002, 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.093592051000002, 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.205 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:44.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.093318486999998, 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.092558482999998, 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.091973864000003, 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.088217055000001, 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.103201020999997, 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.229 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.100710575999997, 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:44.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:44.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:44.234 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.099974930999998, 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:44.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:44.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:44.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:44.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:44.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:44.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:44.240 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.240 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.240 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.240 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:44.240 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:44.240 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:44.241 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:44.242 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:44.241+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:44.268 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:13:44.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-07T11:13:44.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T11:13:44.342 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:44.342+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:44.358 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:44.358 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:44.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:44.443 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:44.443+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:44.473 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:44.473 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:44.473 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:44.473 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:44.473 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:44.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:44.544 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:44.543+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:44.589 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.822872415000006, 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.590 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:44.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.156317259000005, 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.926710166999996, 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.926034993000002, 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.925393172, 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.924924763999996, 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.922219243000001, 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.544902862000001, 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.544846087000003, 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.544817616000003, 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.544778821999998, 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.544735498999998, 2024-05-07T11:13:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.544712947999997, 2024-05-07T11:13:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.544688888000003, 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.544669927999998, 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.544643256000001, 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.540138996000003, 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.538412469000001, 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.538260135000002, 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 60.538207163000003, 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.701 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.702 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.702 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:44.702 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:44.702 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:44.703 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:44.704 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:44.703+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:44.804 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:44.805+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:44.820 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:44.820 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:44.820 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:44.820 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:44.829 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:44.905 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:44.905+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:44.935 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:44.935 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:44.935 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:44.935 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:44.935 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:44.947 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:45.007 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:45.007+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:45.094 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:45.094 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:45.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:45.094 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:45.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.094 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:45.094 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 66.145682504000007, 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:45.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:45.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 65.821456616999996, 2024-05-07T11:13:45.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.106 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:45.106 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:45.106 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 65.660981218000003, 2024-05-07T11:13:45.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:45.106 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.107 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.107 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.107 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:45.107 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:45.107 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:45.107 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:45.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.107 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:45.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:45.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:45.112 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 65.660894850000005, 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:45.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 65.431747416999997, 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.118 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:45.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:45.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:45.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:45.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:45.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:45.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:45.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:45.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:45.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:45.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:45.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:45.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:45.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:45.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:45.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:45.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:45.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:45.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:45.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:45.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:45.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:45.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:45.131 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.131 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.131 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.132 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:45.132 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:45.132 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 65.431699952000002, 2024-05-07T11:13:45.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:45.132 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.132 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.132 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.133 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:45.133 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:45.133 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:45.133 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:45.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.133 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:45.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:45.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:45.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:45.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:45.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:45.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:45.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:45.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:45.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:45.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:45.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:45.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:45.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:45.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:45.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:45.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:45.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:45.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:45.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:45.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:45.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:45.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:45.141 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.049787563999999, 2024-05-07T11:13:45.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:45.142 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.142 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.142 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.142 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:45.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:45.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:45.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:45.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:45.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:45.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.047592479999999, 2024-05-07T11:13:45.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:45.150 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.150 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.150 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.150 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:45.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.047364260000002, 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:45.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:45.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:45.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.047185130000003, 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:45.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:45.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:45.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:45.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.047125256000001, 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.171 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.172 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:45.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:45.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.047077084000001, 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.178 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:45.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:45.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:45.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:45.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:45.184 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.047049102000003, 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:45.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:45.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:45.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.047016092, 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:45.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:45.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:45.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:45.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:45.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:45.195 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.195 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.195 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.195 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.195 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:45.195 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.046922287999998, 2024-05-07T11:13:45.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:45.196 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.196 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.196 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.196 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:45.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:45.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.046778846000002, 2024-05-07T11:13:45.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:45.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:45.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:45.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:45.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.046593940999998, 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:45.208 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:45.213 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.046434871000002, 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:45.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:45.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:45.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.045991462000003, 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:45.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:45.223 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.045966198000002, 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:45.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:45.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:45.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.227 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:45.228 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:45.228 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:45.229 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:45.230 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:45.229+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:45.316 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-05-07T11:13:45.316 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.0 to 1 (10000) 2024-05-07T11:13:45.330 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:45.329+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:45.332 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-07T11:13:45.344 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:45.344 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:45.344 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:45.344 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:45.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:45.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:45.430 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:45.431+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:45.461 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:45.462 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:45.462 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:45.462 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:45.462 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:45.471 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:45.531 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:45.531+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:45.555 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:45.575 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:45.576 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:45.577 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:45.577 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:45.586 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:45.594 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:45.594 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:45.632 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:45.632+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:45.704 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:45.705 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:45.714 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:45.756 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:45.755+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:45.834 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:45.834+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:45.861 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:45.861 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:45.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:45.935 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:45.935+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:45.976 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:45.976 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:45.985 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:46.036 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:46.037+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:46.101 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:46.101 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:46.110 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:46.137 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:46.137+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:46.214 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:46.214 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:46.223 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:46.267 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:46.267+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:46.314 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.1 to 1 (10000) 2024-05-07T11:13:46.328 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:46.328 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:46.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-07T11:13:46.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:46.338 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:46.338+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:46.439 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:46.439+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:46.451 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:46.451 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:46.460 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:46.540 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:46.540+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:46.564 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:46.564 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:46.573 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:46.641 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:46.641+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:46.678 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:46.678 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:46.687 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:46.742 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:46.740+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:46.801 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:46.801 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:46.810 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:46.843 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:46.842+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:46.944 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:46.944+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:46.955 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:46.955 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:46.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:47.044 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:47.043+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:47.070 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:47.071 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:47.079 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:47.144 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:47.144+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:47.187 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:47.188 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:47.196 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:47.246 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:47.246+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:47.301 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:47.301 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:47.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:47.325 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.2 to 1 (10000) 2024-05-07T11:13:47.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:13:47.340 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-07T11:13:47.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:13:47.353 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:47.353+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:47.416 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:47.416 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:47.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:47.448 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:47.447+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:47.542 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:47.543 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:47.549 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:47.549+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:47.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:47.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:47.650 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:47.649+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:47.657 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:47.658 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:47.667 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:47.747 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:47.748 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:13:47.749 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:47.750 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:47.751 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:47.750+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:47.760 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-05-07T11:13:47.324157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90404,"kb_used_data":1024,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025116,"statfs":{"total":289910292480,"available":289817718784,"internally_reserved":0,"allocated":1048576,"data_stored":1576036,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.015289"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318108+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:13:46.318108+0000","last_peered":"2024-05-07T11:13:46.318108+0000","last_clean":"2024-05-07T11:13:46.318108+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:13:46.318108+0000","last_undegraded":"2024-05-07T11:13:46.318108+0000","last_fullsized":"2024-05-07T11:13:46.318108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317818+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:13:46.317818+0000","last_peered":"2024-05-07T11:13:46.317818+0000","last_clean":"2024-05-07T11:13:46.317818+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:13:46.317818+0000","last_undegraded":"2024-05-07T11:13:46.317818+0000","last_fullsized":"2024-05-07T11:13:46.317818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378639+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:13:46.378639+0000","last_peered":"2024-05-07T11:13:46.378639+0000","last_clean":"2024-05-07T11:13:46.378639+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:13:46.378639+0000","last_undegraded":"2024-05-07T11:13:46.378639+0000","last_fullsized":"2024-05-07T11:13:46.378639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378600+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:13:46.378600+0000","last_peered":"2024-05-07T11:13:46.378600+0000","last_clean":"2024-05-07T11:13:46.378600+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:13:46.378600+0000","last_undegraded":"2024-05-07T11:13:46.378600+0000","last_fullsized":"2024-05-07T11:13:46.378600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317581+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:13:46.317581+0000","last_peered":"2024-05-07T11:13:46.317581+0000","last_clean":"2024-05-07T11:13:46.317581+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:13:46.317581+0000","last_undegraded":"2024-05-07T11:13:46.317581+0000","last_fullsized":"2024-05-07T11:13:46.317581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317175+0000","last_change":"2024-05-07T11:13:25.248711+0000","last_active":"2024-05-07T11:13:46.317175+0000","last_peered":"2024-05-07T11:13:46.317175+0000","last_clean":"2024-05-07T11:13:46.317175+0000","last_became_active":"2024-05-07T11:13:25.248452+0000","last_became_peered":"2024-05-07T11:13:25.248452+0000","last_unstale":"2024-05-07T11:13:46.317175+0000","last_undegraded":"2024-05-07T11:13:46.317175+0000","last_fullsized":"2024-05-07T11:13:46.317175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317115+0000","last_change":"2024-05-07T11:13:25.248071+0000","last_active":"2024-05-07T11:13:46.317115+0000","last_peered":"2024-05-07T11:13:46.317115+0000","last_clean":"2024-05-07T11:13:46.317115+0000","last_became_active":"2024-05-07T11:13:25.247861+0000","last_became_peered":"2024-05-07T11:13:25.247861+0000","last_unstale":"2024-05-07T11:13:46.317115+0000","last_undegraded":"2024-05-07T11:13:46.317115+0000","last_fullsized":"2024-05-07T11:13:46.317115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.057596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378126+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:13:46.378126+0000","last_peered":"2024-05-07T11:13:46.378126+0000","last_clean":"2024-05-07T11:13:46.378126+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:13:46.378126+0000","last_undegraded":"2024-05-07T11:13:46.378126+0000","last_fullsized":"2024-05-07T11:13:46.378126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318094+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:13:46.318094+0000","last_peered":"2024-05-07T11:13:46.318094+0000","last_clean":"2024-05-07T11:13:46.318094+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:13:46.318094+0000","last_undegraded":"2024-05-07T11:13:46.318094+0000","last_fullsized":"2024-05-07T11:13:46.318094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317873+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:13:46.317873+0000","last_peered":"2024-05-07T11:13:46.317873+0000","last_clean":"2024-05-07T11:13:46.317873+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:13:46.317873+0000","last_undegraded":"2024-05-07T11:13:46.317873+0000","last_fullsized":"2024-05-07T11:13:46.317873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317770+0000","last_change":"2024-05-07T11:13:25.249909+0000","last_active":"2024-05-07T11:13:46.317770+0000","last_peered":"2024-05-07T11:13:46.317770+0000","last_clean":"2024-05-07T11:13:46.317770+0000","last_became_active":"2024-05-07T11:13:25.249670+0000","last_became_peered":"2024-05-07T11:13:25.249670+0000","last_unstale":"2024-05-07T11:13:46.317770+0000","last_undegraded":"2024-05-07T11:13:46.317770+0000","last_fullsized":"2024-05-07T11:13:46.317770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:31.697406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317577+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:13:46.317577+0000","last_peered":"2024-05-07T11:13:46.317577+0000","last_clean":"2024-05-07T11:13:46.317577+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:13:46.317577+0000","last_undegraded":"2024-05-07T11:13:46.317577+0000","last_fullsized":"2024-05-07T11:13:46.317577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317477+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:13:46.317477+0000","last_peered":"2024-05-07T11:13:46.317477+0000","last_clean":"2024-05-07T11:13:46.317477+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:13:46.317477+0000","last_undegraded":"2024-05-07T11:13:46.317477+0000","last_fullsized":"2024-05-07T11:13:46.317477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378310+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:13:46.378310+0000","last_peered":"2024-05-07T11:13:46.378310+0000","last_clean":"2024-05-07T11:13:46.378310+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:13:46.378310+0000","last_undegraded":"2024-05-07T11:13:46.378310+0000","last_fullsized":"2024-05-07T11:13:46.378310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378334+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:13:46.378334+0000","last_peered":"2024-05-07T11:13:46.378334+0000","last_clean":"2024-05-07T11:13:46.378334+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:13:46.378334+0000","last_undegraded":"2024-05-07T11:13:46.378334+0000","last_fullsized":"2024-05-07T11:13:46.378334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317114+0000","last_change":"2024-05-07T11:13:25.248991+0000","last_active":"2024-05-07T11:13:46.317114+0000","last_peered":"2024-05-07T11:13:46.317114+0000","last_clean":"2024-05-07T11:13:46.317114+0000","last_became_active":"2024-05-07T11:13:25.248693+0000","last_became_peered":"2024-05-07T11:13:25.248693+0000","last_unstale":"2024-05-07T11:13:46.317114+0000","last_undegraded":"2024-05-07T11:13:46.317114+0000","last_fullsized":"2024-05-07T11:13:46.317114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:27:15.749485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318492+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:13:46.318492+0000","last_peered":"2024-05-07T11:13:46.318492+0000","last_clean":"2024-05-07T11:13:46.318492+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:13:46.318492+0000","last_undegraded":"2024-05-07T11:13:46.318492+0000","last_fullsized":"2024-05-07T11:13:46.318492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317999+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:13:46.317999+0000","last_peered":"2024-05-07T11:13:46.317999+0000","last_clean":"2024-05-07T11:13:46.317999+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:13:46.317999+0000","last_undegraded":"2024-05-07T11:13:46.317999+0000","last_fullsized":"2024-05-07T11:13:46.317999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317919+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:13:46.317919+0000","last_peered":"2024-05-07T11:13:46.317919+0000","last_clean":"2024-05-07T11:13:46.317919+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:13:46.317919+0000","last_undegraded":"2024-05-07T11:13:46.317919+0000","last_fullsized":"2024-05-07T11:13:46.317919+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378672+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:13:46.378672+0000","last_peered":"2024-05-07T11:13:46.378672+0000","last_clean":"2024-05-07T11:13:46.378672+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:13:46.378672+0000","last_undegraded":"2024-05-07T11:13:46.378672+0000","last_fullsized":"2024-05-07T11:13:46.378672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378774+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:13:46.378774+0000","last_peered":"2024-05-07T11:13:46.378774+0000","last_clean":"2024-05-07T11:13:46.378774+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:13:46.378774+0000","last_undegraded":"2024-05-07T11:13:46.378774+0000","last_fullsized":"2024-05-07T11:13:46.378774+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317324+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:13:46.317324+0000","last_peered":"2024-05-07T11:13:46.317324+0000","last_clean":"2024-05-07T11:13:46.317324+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:13:46.317324+0000","last_undegraded":"2024-05-07T11:13:46.317324+0000","last_fullsized":"2024-05-07T11:13:46.317324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317119+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:13:46.317119+0000","last_peered":"2024-05-07T11:13:46.317119+0000","last_clean":"2024-05-07T11:13:46.317119+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:13:46.317119+0000","last_undegraded":"2024-05-07T11:13:46.317119+0000","last_fullsized":"2024-05-07T11:13:46.317119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317189+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:13:46.317189+0000","last_peered":"2024-05-07T11:13:46.317189+0000","last_clean":"2024-05-07T11:13:46.317189+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:13:46.317189+0000","last_undegraded":"2024-05-07T11:13:46.317189+0000","last_fullsized":"2024-05-07T11:13:46.317189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318135+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:13:46.318135+0000","last_peered":"2024-05-07T11:13:46.318135+0000","last_clean":"2024-05-07T11:13:46.318135+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:13:46.318135+0000","last_undegraded":"2024-05-07T11:13:46.318135+0000","last_fullsized":"2024-05-07T11:13:46.318135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318177+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:13:46.318177+0000","last_peered":"2024-05-07T11:13:46.318177+0000","last_clean":"2024-05-07T11:13:46.318177+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:13:46.318177+0000","last_undegraded":"2024-05-07T11:13:46.318177+0000","last_fullsized":"2024-05-07T11:13:46.318177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318074+0000","last_change":"2024-05-07T11:13:25.249860+0000","last_active":"2024-05-07T11:13:46.318074+0000","last_peered":"2024-05-07T11:13:46.318074+0000","last_clean":"2024-05-07T11:13:46.318074+0000","last_became_active":"2024-05-07T11:13:25.249519+0000","last_became_peered":"2024-05-07T11:13:25.249519+0000","last_unstale":"2024-05-07T11:13:46.318074+0000","last_undegraded":"2024-05-07T11:13:46.318074+0000","last_fullsized":"2024-05-07T11:13:46.318074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317780+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:13:46.317780+0000","last_peered":"2024-05-07T11:13:46.317780+0000","last_clean":"2024-05-07T11:13:46.317780+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:13:46.317780+0000","last_undegraded":"2024-05-07T11:13:46.317780+0000","last_fullsized":"2024-05-07T11:13:46.317780+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317595+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:13:46.317595+0000","last_peered":"2024-05-07T11:13:46.317595+0000","last_clean":"2024-05-07T11:13:46.317595+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:13:46.317595+0000","last_undegraded":"2024-05-07T11:13:46.317595+0000","last_fullsized":"2024-05-07T11:13:46.317595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317575+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:13:46.317575+0000","last_peered":"2024-05-07T11:13:46.317575+0000","last_clean":"2024-05-07T11:13:46.317575+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:13:46.317575+0000","last_undegraded":"2024-05-07T11:13:46.317575+0000","last_fullsized":"2024-05-07T11:13:46.317575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317284+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:13:46.317284+0000","last_peered":"2024-05-07T11:13:46.317284+0000","last_clean":"2024-05-07T11:13:46.317284+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:13:46.317284+0000","last_undegraded":"2024-05-07T11:13:46.317284+0000","last_fullsized":"2024-05-07T11:13:46.317284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378239+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:13:46.378239+0000","last_peered":"2024-05-07T11:13:46.378239+0000","last_clean":"2024-05-07T11:13:46.378239+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:13:46.378239+0000","last_undegraded":"2024-05-07T11:13:46.378239+0000","last_fullsized":"2024-05-07T11:13:46.378239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317718+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:13:46.317718+0000","last_peered":"2024-05-07T11:13:46.317718+0000","last_clean":"2024-05-07T11:13:46.317718+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:13:46.317718+0000","last_undegraded":"2024-05-07T11:13:46.317718+0000","last_fullsized":"2024-05-07T11:13:46.317718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379218+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:13:46.379218+0000","last_peered":"2024-05-07T11:13:46.379218+0000","last_clean":"2024-05-07T11:13:46.379218+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:13:46.379218+0000","last_undegraded":"2024-05-07T11:13:46.379218+0000","last_fullsized":"2024-05-07T11:13:46.379218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317852+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:13:46.317852+0000","last_peered":"2024-05-07T11:13:46.317852+0000","last_clean":"2024-05-07T11:13:46.317852+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:13:46.317852+0000","last_undegraded":"2024-05-07T11:13:46.317852+0000","last_fullsized":"2024-05-07T11:13:46.317852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317493+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:13:46.317493+0000","last_peered":"2024-05-07T11:13:46.317493+0000","last_clean":"2024-05-07T11:13:46.317493+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:13:46.317493+0000","last_undegraded":"2024-05-07T11:13:46.317493+0000","last_fullsized":"2024-05-07T11:13:46.317493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318304+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:13:46.318304+0000","last_peered":"2024-05-07T11:13:46.318304+0000","last_clean":"2024-05-07T11:13:46.318304+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:13:46.318304+0000","last_undegraded":"2024-05-07T11:13:46.318304+0000","last_fullsized":"2024-05-07T11:13:46.318304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317386+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:13:46.317386+0000","last_peered":"2024-05-07T11:13:46.317386+0000","last_clean":"2024-05-07T11:13:46.317386+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:13:46.317386+0000","last_undegraded":"2024-05-07T11:13:46.317386+0000","last_fullsized":"2024-05-07T11:13:46.317386+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318224+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:13:46.318224+0000","last_peered":"2024-05-07T11:13:46.318224+0000","last_clean":"2024-05-07T11:13:46.318224+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:13:46.318224+0000","last_undegraded":"2024-05-07T11:13:46.318224+0000","last_fullsized":"2024-05-07T11:13:46.318224+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378386+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:13:46.378386+0000","last_peered":"2024-05-07T11:13:46.378386+0000","last_clean":"2024-05-07T11:13:46.378386+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:13:46.378386+0000","last_undegraded":"2024-05-07T11:13:46.378386+0000","last_fullsized":"2024-05-07T11:13:46.378386+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379265+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:13:46.379265+0000","last_peered":"2024-05-07T11:13:46.379265+0000","last_clean":"2024-05-07T11:13:46.379265+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:13:46.379265+0000","last_undegraded":"2024-05-07T11:13:46.379265+0000","last_fullsized":"2024-05-07T11:13:46.379265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317200+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:13:46.317200+0000","last_peered":"2024-05-07T11:13:46.317200+0000","last_clean":"2024-05-07T11:13:46.317200+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:13:46.317200+0000","last_undegraded":"2024-05-07T11:13:46.317200+0000","last_fullsized":"2024-05-07T11:13:46.317200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318052+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:13:46.318052+0000","last_peered":"2024-05-07T11:13:46.318052+0000","last_clean":"2024-05-07T11:13:46.318052+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:13:46.318052+0000","last_undegraded":"2024-05-07T11:13:46.318052+0000","last_fullsized":"2024-05-07T11:13:46.318052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317273+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:13:46.317273+0000","last_peered":"2024-05-07T11:13:46.317273+0000","last_clean":"2024-05-07T11:13:46.317273+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:13:46.317273+0000","last_undegraded":"2024-05-07T11:13:46.317273+0000","last_fullsized":"2024-05-07T11:13:46.317273+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317740+0000","last_change":"2024-05-07T11:13:25.249690+0000","last_active":"2024-05-07T11:13:46.317740+0000","last_peered":"2024-05-07T11:13:46.317740+0000","last_clean":"2024-05-07T11:13:46.317740+0000","last_became_active":"2024-05-07T11:13:25.249304+0000","last_became_peered":"2024-05-07T11:13:25.249304+0000","last_unstale":"2024-05-07T11:13:46.317740+0000","last_undegraded":"2024-05-07T11:13:46.317740+0000","last_fullsized":"2024-05-07T11:13:46.317740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:30.051793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378444+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:13:46.378444+0000","last_peered":"2024-05-07T11:13:46.378444+0000","last_clean":"2024-05-07T11:13:46.378444+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:13:46.378444+0000","last_undegraded":"2024-05-07T11:13:46.378444+0000","last_fullsized":"2024-05-07T11:13:46.378444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317842+0000","last_change":"2024-05-07T11:13:25.249164+0000","last_active":"2024-05-07T11:13:46.317842+0000","last_peered":"2024-05-07T11:13:46.317842+0000","last_clean":"2024-05-07T11:13:46.317842+0000","last_became_active":"2024-05-07T11:13:25.248783+0000","last_became_peered":"2024-05-07T11:13:25.248783+0000","last_unstale":"2024-05-07T11:13:46.317842+0000","last_undegraded":"2024-05-07T11:13:46.317842+0000","last_fullsized":"2024-05-07T11:13:46.317842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:00.987017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317591+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:13:46.317591+0000","last_peered":"2024-05-07T11:13:46.317591+0000","last_clean":"2024-05-07T11:13:46.317591+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:13:46.317591+0000","last_undegraded":"2024-05-07T11:13:46.317591+0000","last_fullsized":"2024-05-07T11:13:46.317591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317896+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:13:46.317896+0000","last_peered":"2024-05-07T11:13:46.317896+0000","last_clean":"2024-05-07T11:13:46.317896+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:13:46.317896+0000","last_undegraded":"2024-05-07T11:13:46.317896+0000","last_fullsized":"2024-05-07T11:13:46.317896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378740+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:13:46.378740+0000","last_peered":"2024-05-07T11:13:46.378740+0000","last_clean":"2024-05-07T11:13:46.378740+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:13:46.378740+0000","last_undegraded":"2024-05-07T11:13:46.378740+0000","last_fullsized":"2024-05-07T11:13:46.378740+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378788+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:13:46.378788+0000","last_peered":"2024-05-07T11:13:46.378788+0000","last_clean":"2024-05-07T11:13:46.378788+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:13:46.378788+0000","last_undegraded":"2024-05-07T11:13:46.378788+0000","last_fullsized":"2024-05-07T11:13:46.378788+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378954+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:13:46.378954+0000","last_peered":"2024-05-07T11:13:46.378954+0000","last_clean":"2024-05-07T11:13:46.378954+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:13:46.378954+0000","last_undegraded":"2024-05-07T11:13:46.378954+0000","last_fullsized":"2024-05-07T11:13:46.378954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317426+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:13:46.317426+0000","last_peered":"2024-05-07T11:13:46.317426+0000","last_clean":"2024-05-07T11:13:46.317426+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:13:46.317426+0000","last_undegraded":"2024-05-07T11:13:46.317426+0000","last_fullsized":"2024-05-07T11:13:46.317426+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378707+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:13:46.378707+0000","last_peered":"2024-05-07T11:13:46.378707+0000","last_clean":"2024-05-07T11:13:46.378707+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:13:46.378707+0000","last_undegraded":"2024-05-07T11:13:46.378707+0000","last_fullsized":"2024-05-07T11:13:46.378707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317301+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:13:46.317301+0000","last_peered":"2024-05-07T11:13:46.317301+0000","last_clean":"2024-05-07T11:13:46.317301+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:13:46.317301+0000","last_undegraded":"2024-05-07T11:13:46.317301+0000","last_fullsized":"2024-05-07T11:13:46.317301+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318233+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:13:46.318233+0000","last_peered":"2024-05-07T11:13:46.318233+0000","last_clean":"2024-05-07T11:13:46.318233+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:13:46.318233+0000","last_undegraded":"2024-05-07T11:13:46.318233+0000","last_fullsized":"2024-05-07T11:13:46.318233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":254,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378593+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:13:46.378593+0000","last_peered":"2024-05-07T11:13:46.378593+0000","last_clean":"2024-05-07T11:13:46.378593+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:13:46.378593+0000","last_undegraded":"2024-05-07T11:13:46.378593+0000","last_fullsized":"2024-05-07T11:13:46.378593+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379333+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:13:46.379333+0000","last_peered":"2024-05-07T11:13:46.379333+0000","last_clean":"2024-05-07T11:13:46.379333+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:13:46.379333+0000","last_undegraded":"2024-05-07T11:13:46.379333+0000","last_fullsized":"2024-05-07T11:13:46.379333+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317614+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:13:46.317614+0000","last_peered":"2024-05-07T11:13:46.317614+0000","last_clean":"2024-05-07T11:13:46.317614+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:13:46.317614+0000","last_undegraded":"2024-05-07T11:13:46.317614+0000","last_fullsized":"2024-05-07T11:13:46.317614+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317736+0000","last_change":"2024-05-07T11:13:25.249760+0000","last_active":"2024-05-07T11:13:46.317736+0000","last_peered":"2024-05-07T11:13:46.317736+0000","last_clean":"2024-05-07T11:13:46.317736+0000","last_became_active":"2024-05-07T11:13:25.249466+0000","last_became_peered":"2024-05-07T11:13:25.249466+0000","last_unstale":"2024-05-07T11:13:46.317736+0000","last_undegraded":"2024-05-07T11:13:46.317736+0000","last_fullsized":"2024-05-07T11:13:46.317736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378554+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:13:46.378554+0000","last_peered":"2024-05-07T11:13:46.378554+0000","last_clean":"2024-05-07T11:13:46.378554+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:13:46.378554+0000","last_undegraded":"2024-05-07T11:13:46.378554+0000","last_fullsized":"2024-05-07T11:13:46.378554+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317612+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:13:46.317612+0000","last_peered":"2024-05-07T11:13:46.317612+0000","last_clean":"2024-05-07T11:13:46.317612+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:13:46.317612+0000","last_undegraded":"2024-05-07T11:13:46.317612+0000","last_fullsized":"2024-05-07T11:13:46.317612+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317920+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:13:46.317920+0000","last_peered":"2024-05-07T11:13:46.317920+0000","last_clean":"2024-05-07T11:13:46.317920+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:13:46.317920+0000","last_undegraded":"2024-05-07T11:13:46.317920+0000","last_fullsized":"2024-05-07T11:13:46.317920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317786+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:13:46.317786+0000","last_peered":"2024-05-07T11:13:46.317786+0000","last_clean":"2024-05-07T11:13:46.317786+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:13:46.317786+0000","last_undegraded":"2024-05-07T11:13:46.317786+0000","last_fullsized":"2024-05-07T11:13:46.317786+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317309+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:13:46.317309+0000","last_peered":"2024-05-07T11:13:46.317309+0000","last_clean":"2024-05-07T11:13:46.317309+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:13:46.317309+0000","last_undegraded":"2024-05-07T11:13:46.317309+0000","last_fullsized":"2024-05-07T11:13:46.317309+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318352+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:13:46.318352+0000","last_peered":"2024-05-07T11:13:46.318352+0000","last_clean":"2024-05-07T11:13:46.318352+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:13:46.318352+0000","last_undegraded":"2024-05-07T11:13:46.318352+0000","last_fullsized":"2024-05-07T11:13:46.318352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378855+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:13:46.378855+0000","last_peered":"2024-05-07T11:13:46.378855+0000","last_clean":"2024-05-07T11:13:46.378855+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:13:46.378855+0000","last_undegraded":"2024-05-07T11:13:46.378855+0000","last_fullsized":"2024-05-07T11:13:46.378855+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379266+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:13:46.379266+0000","last_peered":"2024-05-07T11:13:46.379266+0000","last_clean":"2024-05-07T11:13:46.379266+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:13:46.379266+0000","last_undegraded":"2024-05-07T11:13:46.379266+0000","last_fullsized":"2024-05-07T11:13:46.379266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317961+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:13:46.317961+0000","last_peered":"2024-05-07T11:13:46.317961+0000","last_clean":"2024-05-07T11:13:46.317961+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:13:46.317961+0000","last_undegraded":"2024-05-07T11:13:46.317961+0000","last_fullsized":"2024-05-07T11:13:46.317961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317912+0000","last_change":"2024-05-07T11:13:25.249176+0000","last_active":"2024-05-07T11:13:46.317912+0000","last_peered":"2024-05-07T11:13:46.317912+0000","last_clean":"2024-05-07T11:13:46.317912+0000","last_became_active":"2024-05-07T11:13:25.248831+0000","last_became_peered":"2024-05-07T11:13:25.248831+0000","last_unstale":"2024-05-07T11:13:46.317912+0000","last_undegraded":"2024-05-07T11:13:46.317912+0000","last_fullsized":"2024-05-07T11:13:46.317912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:48:30.756870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318098+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:13:46.318098+0000","last_peered":"2024-05-07T11:13:46.318098+0000","last_clean":"2024-05-07T11:13:46.318098+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:13:46.318098+0000","last_undegraded":"2024-05-07T11:13:46.318098+0000","last_fullsized":"2024-05-07T11:13:46.318098+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317401+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:13:46.317401+0000","last_peered":"2024-05-07T11:13:46.317401+0000","last_clean":"2024-05-07T11:13:46.317401+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:13:46.317401+0000","last_undegraded":"2024-05-07T11:13:46.317401+0000","last_fullsized":"2024-05-07T11:13:46.317401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318014+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:13:46.318014+0000","last_peered":"2024-05-07T11:13:46.318014+0000","last_clean":"2024-05-07T11:13:46.318014+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:13:46.318014+0000","last_undegraded":"2024-05-07T11:13:46.318014+0000","last_fullsized":"2024-05-07T11:13:46.318014+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318164+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:13:46.318164+0000","last_peered":"2024-05-07T11:13:46.318164+0000","last_clean":"2024-05-07T11:13:46.318164+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:13:46.318164+0000","last_undegraded":"2024-05-07T11:13:46.318164+0000","last_fullsized":"2024-05-07T11:13:46.318164+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317544+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:13:46.317544+0000","last_peered":"2024-05-07T11:13:46.317544+0000","last_clean":"2024-05-07T11:13:46.317544+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:13:46.317544+0000","last_undegraded":"2024-05-07T11:13:46.317544+0000","last_fullsized":"2024-05-07T11:13:46.317544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318546+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:13:46.318546+0000","last_peered":"2024-05-07T11:13:46.318546+0000","last_clean":"2024-05-07T11:13:46.318546+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:13:46.318546+0000","last_undegraded":"2024-05-07T11:13:46.318546+0000","last_fullsized":"2024-05-07T11:13:46.318546+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318380+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:13:46.318380+0000","last_peered":"2024-05-07T11:13:46.318380+0000","last_clean":"2024-05-07T11:13:46.318380+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:13:46.318380+0000","last_undegraded":"2024-05-07T11:13:46.318380+0000","last_fullsized":"2024-05-07T11:13:46.318380+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317403+0000","last_change":"2024-05-07T11:13:25.248884+0000","last_active":"2024-05-07T11:13:46.317403+0000","last_peered":"2024-05-07T11:13:46.317403+0000","last_clean":"2024-05-07T11:13:46.317403+0000","last_became_active":"2024-05-07T11:13:25.248619+0000","last_became_peered":"2024-05-07T11:13:25.248619+0000","last_unstale":"2024-05-07T11:13:46.317403+0000","last_undegraded":"2024-05-07T11:13:46.317403+0000","last_fullsized":"2024-05-07T11:13:46.317403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318385+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:13:46.318385+0000","last_peered":"2024-05-07T11:13:46.318385+0000","last_clean":"2024-05-07T11:13:46.318385+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:13:46.318385+0000","last_undegraded":"2024-05-07T11:13:46.318385+0000","last_fullsized":"2024-05-07T11:13:46.318385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379270+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:13:46.379270+0000","last_peered":"2024-05-07T11:13:46.379270+0000","last_clean":"2024-05-07T11:13:46.379270+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:13:46.379270+0000","last_undegraded":"2024-05-07T11:13:46.379270+0000","last_fullsized":"2024-05-07T11:13:46.379270+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317277+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:13:46.317277+0000","last_peered":"2024-05-07T11:13:46.317277+0000","last_clean":"2024-05-07T11:13:46.317277+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:13:46.317277+0000","last_undegraded":"2024-05-07T11:13:46.317277+0000","last_fullsized":"2024-05-07T11:13:46.317277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378532+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:13:46.378532+0000","last_peered":"2024-05-07T11:13:46.378532+0000","last_clean":"2024-05-07T11:13:46.378532+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:13:46.378532+0000","last_undegraded":"2024-05-07T11:13:46.378532+0000","last_fullsized":"2024-05-07T11:13:46.378532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379195+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:13:46.379195+0000","last_peered":"2024-05-07T11:13:46.379195+0000","last_clean":"2024-05-07T11:13:46.379195+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:13:46.379195+0000","last_undegraded":"2024-05-07T11:13:46.379195+0000","last_fullsized":"2024-05-07T11:13:46.379195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317378+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:13:46.317378+0000","last_peered":"2024-05-07T11:13:46.317378+0000","last_clean":"2024-05-07T11:13:46.317378+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:13:46.317378+0000","last_undegraded":"2024-05-07T11:13:46.317378+0000","last_fullsized":"2024-05-07T11:13:46.317378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318051+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:13:46.318051+0000","last_peered":"2024-05-07T11:13:46.318051+0000","last_clean":"2024-05-07T11:13:46.318051+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:13:46.318051+0000","last_undegraded":"2024-05-07T11:13:46.318051+0000","last_fullsized":"2024-05-07T11:13:46.318051+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318165+0000","last_change":"2024-05-07T11:13:25.249281+0000","last_active":"2024-05-07T11:13:46.318165+0000","last_peered":"2024-05-07T11:13:46.318165+0000","last_clean":"2024-05-07T11:13:46.318165+0000","last_became_active":"2024-05-07T11:13:25.249068+0000","last_became_peered":"2024-05-07T11:13:25.249068+0000","last_unstale":"2024-05-07T11:13:46.318165+0000","last_undegraded":"2024-05-07T11:13:46.318165+0000","last_fullsized":"2024-05-07T11:13:46.318165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:30:57.180798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317350+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:13:46.317350+0000","last_peered":"2024-05-07T11:13:46.317350+0000","last_clean":"2024-05-07T11:13:46.317350+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:13:46.317350+0000","last_undegraded":"2024-05-07T11:13:46.317350+0000","last_fullsized":"2024-05-07T11:13:46.317350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318474+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:13:46.318474+0000","last_peered":"2024-05-07T11:13:46.318474+0000","last_clean":"2024-05-07T11:13:46.318474+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:13:46.318474+0000","last_undegraded":"2024-05-07T11:13:46.318474+0000","last_fullsized":"2024-05-07T11:13:46.318474+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317306+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:13:46.317306+0000","last_peered":"2024-05-07T11:13:46.317306+0000","last_clean":"2024-05-07T11:13:46.317306+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:13:46.317306+0000","last_undegraded":"2024-05-07T11:13:46.317306+0000","last_fullsized":"2024-05-07T11:13:46.317306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318170+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:13:46.318170+0000","last_peered":"2024-05-07T11:13:46.318170+0000","last_clean":"2024-05-07T11:13:46.318170+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:13:46.318170+0000","last_undegraded":"2024-05-07T11:13:46.318170+0000","last_fullsized":"2024-05-07T11:13:46.318170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317479+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:13:46.317479+0000","last_peered":"2024-05-07T11:13:46.317479+0000","last_clean":"2024-05-07T11:13:46.317479+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:13:46.317479+0000","last_undegraded":"2024-05-07T11:13:46.317479+0000","last_fullsized":"2024-05-07T11:13:46.317479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318095+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:13:46.318095+0000","last_peered":"2024-05-07T11:13:46.318095+0000","last_clean":"2024-05-07T11:13:46.318095+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:13:46.318095+0000","last_undegraded":"2024-05-07T11:13:46.318095+0000","last_fullsized":"2024-05-07T11:13:46.318095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317487+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:13:46.317487+0000","last_peered":"2024-05-07T11:13:46.317487+0000","last_clean":"2024-05-07T11:13:46.317487+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:13:46.317487+0000","last_undegraded":"2024-05-07T11:13:46.317487+0000","last_fullsized":"2024-05-07T11:13:46.317487+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317856+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:13:46.317856+0000","last_peered":"2024-05-07T11:13:46.317856+0000","last_clean":"2024-05-07T11:13:46.317856+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:13:46.317856+0000","last_undegraded":"2024-05-07T11:13:46.317856+0000","last_fullsized":"2024-05-07T11:13:46.317856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317655+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:13:46.317655+0000","last_peered":"2024-05-07T11:13:46.317655+0000","last_clean":"2024-05-07T11:13:46.317655+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:13:46.317655+0000","last_undegraded":"2024-05-07T11:13:46.317655+0000","last_fullsized":"2024-05-07T11:13:46.317655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317596+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:13:46.317596+0000","last_peered":"2024-05-07T11:13:46.317596+0000","last_clean":"2024-05-07T11:13:46.317596+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:13:46.317596+0000","last_undegraded":"2024-05-07T11:13:46.317596+0000","last_fullsized":"2024-05-07T11:13:46.317596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317660+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:13:46.317660+0000","last_peered":"2024-05-07T11:13:46.317660+0000","last_clean":"2024-05-07T11:13:46.317660+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:13:46.317660+0000","last_undegraded":"2024-05-07T11:13:46.317660+0000","last_fullsized":"2024-05-07T11:13:46.317660+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378399+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:13:46.378399+0000","last_peered":"2024-05-07T11:13:46.378399+0000","last_clean":"2024-05-07T11:13:46.378399+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:13:46.378399+0000","last_undegraded":"2024-05-07T11:13:46.378399+0000","last_fullsized":"2024-05-07T11:13:46.378399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378876+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:13:46.378876+0000","last_peered":"2024-05-07T11:13:46.378876+0000","last_clean":"2024-05-07T11:13:46.378876+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:13:46.378876+0000","last_undegraded":"2024-05-07T11:13:46.378876+0000","last_fullsized":"2024-05-07T11:13:46.378876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378592+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:13:46.378592+0000","last_peered":"2024-05-07T11:13:46.378592+0000","last_clean":"2024-05-07T11:13:46.378592+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:13:46.378592+0000","last_undegraded":"2024-05-07T11:13:46.378592+0000","last_fullsized":"2024-05-07T11:13:46.378592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317973+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:13:46.317973+0000","last_peered":"2024-05-07T11:13:46.317973+0000","last_clean":"2024-05-07T11:13:46.317973+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:13:46.317973+0000","last_undegraded":"2024-05-07T11:13:46.317973+0000","last_fullsized":"2024-05-07T11:13:46.317973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317491+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:13:46.317491+0000","last_peered":"2024-05-07T11:13:46.317491+0000","last_clean":"2024-05-07T11:13:46.317491+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:13:46.317491+0000","last_undegraded":"2024-05-07T11:13:46.317491+0000","last_fullsized":"2024-05-07T11:13:46.317491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318266+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:13:46.318266+0000","last_peered":"2024-05-07T11:13:46.318266+0000","last_clean":"2024-05-07T11:13:46.318266+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:13:46.318266+0000","last_undegraded":"2024-05-07T11:13:46.318266+0000","last_fullsized":"2024-05-07T11:13:46.318266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378420+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:13:46.378420+0000","last_peered":"2024-05-07T11:13:46.378420+0000","last_clean":"2024-05-07T11:13:46.378420+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:13:46.378420+0000","last_undegraded":"2024-05-07T11:13:46.378420+0000","last_fullsized":"2024-05-07T11:13:46.378420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318363+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:13:46.318363+0000","last_peered":"2024-05-07T11:13:46.318363+0000","last_clean":"2024-05-07T11:13:46.318363+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:13:46.318363+0000","last_undegraded":"2024-05-07T11:13:46.318363+0000","last_fullsized":"2024-05-07T11:13:46.318363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":372736,"data_stored":720324,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738385,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":728230,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":127482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:13:47.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:13:47.766 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:47.767 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.729830448000001, 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.729765727999997, 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:47.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:47.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.729668787999998, 2024-05-07T11:13:47.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:47.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.793 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.729603449999999, 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.729576557999998, 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.729548979999997, 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.729513591, 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:47.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:47.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.729487984000002, 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.729458553999997, 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.727072579999998, 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.722814040999999, 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.722166037999997, 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:47.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:47.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.721520718999997, 2024-05-07T11:13:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.845 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.721247155, 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.846 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:47.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:47.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:47.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:47.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.720487151, 2024-05-07T11:13:47.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:47.852 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.852 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.852 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:47.852 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:47.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:47.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.719902531999999, 2024-05-07T11:13:47.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.859 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.716145722999997, 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:47.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:47.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 61.731129688999999, 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.864 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.869 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.728639244, 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:47.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:47.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:47.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:47.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:47.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:47.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:47.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:47.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:47.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:47.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:47.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:47.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:47.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:47.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:47.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:47.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:47.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:47.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:47.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:47.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:47.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:47.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:47.877 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.877 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.877 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.877 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:47.877 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:47.877 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.727903599000001, 2024-05-07T11:13:47.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:47.877 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:47.878 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:47.878 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:47.878 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:47.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:47.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:47.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:47.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:47.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:47.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:47.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:47.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:47.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:47.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:47.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:47.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:47.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:47.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:47.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:47.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:47.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:47.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:47.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:47.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:47.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:47.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:47.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:47.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:47.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:47.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:47.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:47.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:47.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:47.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:47.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:47.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:47.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:47.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:47.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:47.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:47.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:47.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:47.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:47.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:47.885 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.885 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.885 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.885 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:47.885 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:47.886 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:47.887 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:47.888 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:47.886+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:47.889 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:47.890 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:47.987 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:47.988+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:48.003 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:48.004 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:48.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:48.088 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:48.087+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:48.106 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:48.108 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:13:48.116 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:48.117 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:48.118 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-05-07T11:13:47.324157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90404,"kb_used_data":1024,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025116,"statfs":{"total":289910292480,"available":289817718784,"internally_reserved":0,"allocated":1048576,"data_stored":1576036,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.015289"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318108+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:13:46.318108+0000","last_peered":"2024-05-07T11:13:46.318108+0000","last_clean":"2024-05-07T11:13:46.318108+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:13:46.318108+0000","last_undegraded":"2024-05-07T11:13:46.318108+0000","last_fullsized":"2024-05-07T11:13:46.318108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317818+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:13:46.317818+0000","last_peered":"2024-05-07T11:13:46.317818+0000","last_clean":"2024-05-07T11:13:46.317818+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:13:46.317818+0000","last_undegraded":"2024-05-07T11:13:46.317818+0000","last_fullsized":"2024-05-07T11:13:46.317818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378639+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:13:46.378639+0000","last_peered":"2024-05-07T11:13:46.378639+0000","last_clean":"2024-05-07T11:13:46.378639+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:13:46.378639+0000","last_undegraded":"2024-05-07T11:13:46.378639+0000","last_fullsized":"2024-05-07T11:13:46.378639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378600+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:13:46.378600+0000","last_peered":"2024-05-07T11:13:46.378600+0000","last_clean":"2024-05-07T11:13:46.378600+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:13:46.378600+0000","last_undegraded":"2024-05-07T11:13:46.378600+0000","last_fullsized":"2024-05-07T11:13:46.378600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317581+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:13:46.317581+0000","last_peered":"2024-05-07T11:13:46.317581+0000","last_clean":"2024-05-07T11:13:46.317581+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:13:46.317581+0000","last_undegraded":"2024-05-07T11:13:46.317581+0000","last_fullsized":"2024-05-07T11:13:46.317581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317175+0000","last_change":"2024-05-07T11:13:25.248711+0000","last_active":"2024-05-07T11:13:46.317175+0000","last_peered":"2024-05-07T11:13:46.317175+0000","last_clean":"2024-05-07T11:13:46.317175+0000","last_became_active":"2024-05-07T11:13:25.248452+0000","last_became_peered":"2024-05-07T11:13:25.248452+0000","last_unstale":"2024-05-07T11:13:46.317175+0000","last_undegraded":"2024-05-07T11:13:46.317175+0000","last_fullsized":"2024-05-07T11:13:46.317175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317115+0000","last_change":"2024-05-07T11:13:25.248071+0000","last_active":"2024-05-07T11:13:46.317115+0000","last_peered":"2024-05-07T11:13:46.317115+0000","last_clean":"2024-05-07T11:13:46.317115+0000","last_became_active":"2024-05-07T11:13:25.247861+0000","last_became_peered":"2024-05-07T11:13:25.247861+0000","last_unstale":"2024-05-07T11:13:46.317115+0000","last_undegraded":"2024-05-07T11:13:46.317115+0000","last_fullsized":"2024-05-07T11:13:46.317115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.057596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378126+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:13:46.378126+0000","last_peered":"2024-05-07T11:13:46.378126+0000","last_clean":"2024-05-07T11:13:46.378126+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:13:46.378126+0000","last_undegraded":"2024-05-07T11:13:46.378126+0000","last_fullsized":"2024-05-07T11:13:46.378126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318094+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:13:46.318094+0000","last_peered":"2024-05-07T11:13:46.318094+0000","last_clean":"2024-05-07T11:13:46.318094+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:13:46.318094+0000","last_undegraded":"2024-05-07T11:13:46.318094+0000","last_fullsized":"2024-05-07T11:13:46.318094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317873+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:13:46.317873+0000","last_peered":"2024-05-07T11:13:46.317873+0000","last_clean":"2024-05-07T11:13:46.317873+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:13:46.317873+0000","last_undegraded":"2024-05-07T11:13:46.317873+0000","last_fullsized":"2024-05-07T11:13:46.317873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317770+0000","last_change":"2024-05-07T11:13:25.249909+0000","last_active":"2024-05-07T11:13:46.317770+0000","last_peered":"2024-05-07T11:13:46.317770+0000","last_clean":"2024-05-07T11:13:46.317770+0000","last_became_active":"2024-05-07T11:13:25.249670+0000","last_became_peered":"2024-05-07T11:13:25.249670+0000","last_unstale":"2024-05-07T11:13:46.317770+0000","last_undegraded":"2024-05-07T11:13:46.317770+0000","last_fullsized":"2024-05-07T11:13:46.317770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:31.697406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317577+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:13:46.317577+0000","last_peered":"2024-05-07T11:13:46.317577+0000","last_clean":"2024-05-07T11:13:46.317577+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:13:46.317577+0000","last_undegraded":"2024-05-07T11:13:46.317577+0000","last_fullsized":"2024-05-07T11:13:46.317577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317477+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:13:46.317477+0000","last_peered":"2024-05-07T11:13:46.317477+0000","last_clean":"2024-05-07T11:13:46.317477+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:13:46.317477+0000","last_undegraded":"2024-05-07T11:13:46.317477+0000","last_fullsized":"2024-05-07T11:13:46.317477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378310+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:13:46.378310+0000","last_peered":"2024-05-07T11:13:46.378310+0000","last_clean":"2024-05-07T11:13:46.378310+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:13:46.378310+0000","last_undegraded":"2024-05-07T11:13:46.378310+0000","last_fullsized":"2024-05-07T11:13:46.378310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378334+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:13:46.378334+0000","last_peered":"2024-05-07T11:13:46.378334+0000","last_clean":"2024-05-07T11:13:46.378334+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:13:46.378334+0000","last_undegraded":"2024-05-07T11:13:46.378334+0000","last_fullsized":"2024-05-07T11:13:46.378334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317114+0000","last_change":"2024-05-07T11:13:25.248991+0000","last_active":"2024-05-07T11:13:46.317114+0000","last_peered":"2024-05-07T11:13:46.317114+0000","last_clean":"2024-05-07T11:13:46.317114+0000","last_became_active":"2024-05-07T11:13:25.248693+0000","last_became_peered":"2024-05-07T11:13:25.248693+0000","last_unstale":"2024-05-07T11:13:46.317114+0000","last_undegraded":"2024-05-07T11:13:46.317114+0000","last_fullsized":"2024-05-07T11:13:46.317114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:27:15.749485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318492+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:13:46.318492+0000","last_peered":"2024-05-07T11:13:46.318492+0000","last_clean":"2024-05-07T11:13:46.318492+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:13:46.318492+0000","last_undegraded":"2024-05-07T11:13:46.318492+0000","last_fullsized":"2024-05-07T11:13:46.318492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317999+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:13:46.317999+0000","last_peered":"2024-05-07T11:13:46.317999+0000","last_clean":"2024-05-07T11:13:46.317999+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:13:46.317999+0000","last_undegraded":"2024-05-07T11:13:46.317999+0000","last_fullsized":"2024-05-07T11:13:46.317999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317919+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:13:46.317919+0000","last_peered":"2024-05-07T11:13:46.317919+0000","last_clean":"2024-05-07T11:13:46.317919+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:13:46.317919+0000","last_undegraded":"2024-05-07T11:13:46.317919+0000","last_fullsized":"2024-05-07T11:13:46.317919+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378672+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:13:46.378672+0000","last_peered":"2024-05-07T11:13:46.378672+0000","last_clean":"2024-05-07T11:13:46.378672+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:13:46.378672+0000","last_undegraded":"2024-05-07T11:13:46.378672+0000","last_fullsized":"2024-05-07T11:13:46.378672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378774+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:13:46.378774+0000","last_peered":"2024-05-07T11:13:46.378774+0000","last_clean":"2024-05-07T11:13:46.378774+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:13:46.378774+0000","last_undegraded":"2024-05-07T11:13:46.378774+0000","last_fullsized":"2024-05-07T11:13:46.378774+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317324+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:13:46.317324+0000","last_peered":"2024-05-07T11:13:46.317324+0000","last_clean":"2024-05-07T11:13:46.317324+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:13:46.317324+0000","last_undegraded":"2024-05-07T11:13:46.317324+0000","last_fullsized":"2024-05-07T11:13:46.317324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317119+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:13:46.317119+0000","last_peered":"2024-05-07T11:13:46.317119+0000","last_clean":"2024-05-07T11:13:46.317119+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:13:46.317119+0000","last_undegraded":"2024-05-07T11:13:46.317119+0000","last_fullsized":"2024-05-07T11:13:46.317119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317189+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:13:46.317189+0000","last_peered":"2024-05-07T11:13:46.317189+0000","last_clean":"2024-05-07T11:13:46.317189+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:13:46.317189+0000","last_undegraded":"2024-05-07T11:13:46.317189+0000","last_fullsized":"2024-05-07T11:13:46.317189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318135+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:13:46.318135+0000","last_peered":"2024-05-07T11:13:46.318135+0000","last_clean":"2024-05-07T11:13:46.318135+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:13:46.318135+0000","last_undegraded":"2024-05-07T11:13:46.318135+0000","last_fullsized":"2024-05-07T11:13:46.318135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318177+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:13:46.318177+0000","last_peered":"2024-05-07T11:13:46.318177+0000","last_clean":"2024-05-07T11:13:46.318177+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:13:46.318177+0000","last_undegraded":"2024-05-07T11:13:46.318177+0000","last_fullsized":"2024-05-07T11:13:46.318177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318074+0000","last_change":"2024-05-07T11:13:25.249860+0000","last_active":"2024-05-07T11:13:46.318074+0000","last_peered":"2024-05-07T11:13:46.318074+0000","last_clean":"2024-05-07T11:13:46.318074+0000","last_became_active":"2024-05-07T11:13:25.249519+0000","last_became_peered":"2024-05-07T11:13:25.249519+0000","last_unstale":"2024-05-07T11:13:46.318074+0000","last_undegraded":"2024-05-07T11:13:46.318074+0000","last_fullsized":"2024-05-07T11:13:46.318074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317780+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:13:46.317780+0000","last_peered":"2024-05-07T11:13:46.317780+0000","last_clean":"2024-05-07T11:13:46.317780+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:13:46.317780+0000","last_undegraded":"2024-05-07T11:13:46.317780+0000","last_fullsized":"2024-05-07T11:13:46.317780+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317595+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:13:46.317595+0000","last_peered":"2024-05-07T11:13:46.317595+0000","last_clean":"2024-05-07T11:13:46.317595+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:13:46.317595+0000","last_undegraded":"2024-05-07T11:13:46.317595+0000","last_fullsized":"2024-05-07T11:13:46.317595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317575+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:13:46.317575+0000","last_peered":"2024-05-07T11:13:46.317575+0000","last_clean":"2024-05-07T11:13:46.317575+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:13:46.317575+0000","last_undegraded":"2024-05-07T11:13:46.317575+0000","last_fullsized":"2024-05-07T11:13:46.317575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317284+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:13:46.317284+0000","last_peered":"2024-05-07T11:13:46.317284+0000","last_clean":"2024-05-07T11:13:46.317284+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:13:46.317284+0000","last_undegraded":"2024-05-07T11:13:46.317284+0000","last_fullsized":"2024-05-07T11:13:46.317284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378239+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:13:46.378239+0000","last_peered":"2024-05-07T11:13:46.378239+0000","last_clean":"2024-05-07T11:13:46.378239+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:13:46.378239+0000","last_undegraded":"2024-05-07T11:13:46.378239+0000","last_fullsized":"2024-05-07T11:13:46.378239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317718+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:13:46.317718+0000","last_peered":"2024-05-07T11:13:46.317718+0000","last_clean":"2024-05-07T11:13:46.317718+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:13:46.317718+0000","last_undegraded":"2024-05-07T11:13:46.317718+0000","last_fullsized":"2024-05-07T11:13:46.317718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379218+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:13:46.379218+0000","last_peered":"2024-05-07T11:13:46.379218+0000","last_clean":"2024-05-07T11:13:46.379218+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:13:46.379218+0000","last_undegraded":"2024-05-07T11:13:46.379218+0000","last_fullsized":"2024-05-07T11:13:46.379218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317852+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:13:46.317852+0000","last_peered":"2024-05-07T11:13:46.317852+0000","last_clean":"2024-05-07T11:13:46.317852+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:13:46.317852+0000","last_undegraded":"2024-05-07T11:13:46.317852+0000","last_fullsized":"2024-05-07T11:13:46.317852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317493+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:13:46.317493+0000","last_peered":"2024-05-07T11:13:46.317493+0000","last_clean":"2024-05-07T11:13:46.317493+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:13:46.317493+0000","last_undegraded":"2024-05-07T11:13:46.317493+0000","last_fullsized":"2024-05-07T11:13:46.317493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318304+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:13:46.318304+0000","last_peered":"2024-05-07T11:13:46.318304+0000","last_clean":"2024-05-07T11:13:46.318304+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:13:46.318304+0000","last_undegraded":"2024-05-07T11:13:46.318304+0000","last_fullsized":"2024-05-07T11:13:46.318304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317386+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:13:46.317386+0000","last_peered":"2024-05-07T11:13:46.317386+0000","last_clean":"2024-05-07T11:13:46.317386+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:13:46.317386+0000","last_undegraded":"2024-05-07T11:13:46.317386+0000","last_fullsized":"2024-05-07T11:13:46.317386+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318224+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:13:46.318224+0000","last_peered":"2024-05-07T11:13:46.318224+0000","last_clean":"2024-05-07T11:13:46.318224+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:13:46.318224+0000","last_undegraded":"2024-05-07T11:13:46.318224+0000","last_fullsized":"2024-05-07T11:13:46.318224+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378386+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:13:46.378386+0000","last_peered":"2024-05-07T11:13:46.378386+0000","last_clean":"2024-05-07T11:13:46.378386+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:13:46.378386+0000","last_undegraded":"2024-05-07T11:13:46.378386+0000","last_fullsized":"2024-05-07T11:13:46.378386+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379265+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:13:46.379265+0000","last_peered":"2024-05-07T11:13:46.379265+0000","last_clean":"2024-05-07T11:13:46.379265+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:13:46.379265+0000","last_undegraded":"2024-05-07T11:13:46.379265+0000","last_fullsized":"2024-05-07T11:13:46.379265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317200+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:13:46.317200+0000","last_peered":"2024-05-07T11:13:46.317200+0000","last_clean":"2024-05-07T11:13:46.317200+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:13:46.317200+0000","last_undegraded":"2024-05-07T11:13:46.317200+0000","last_fullsized":"2024-05-07T11:13:46.317200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318052+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:13:46.318052+0000","last_peered":"2024-05-07T11:13:46.318052+0000","last_clean":"2024-05-07T11:13:46.318052+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:13:46.318052+0000","last_undegraded":"2024-05-07T11:13:46.318052+0000","last_fullsized":"2024-05-07T11:13:46.318052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317273+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:13:46.317273+0000","last_peered":"2024-05-07T11:13:46.317273+0000","last_clean":"2024-05-07T11:13:46.317273+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:13:46.317273+0000","last_undegraded":"2024-05-07T11:13:46.317273+0000","last_fullsized":"2024-05-07T11:13:46.317273+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317740+0000","last_change":"2024-05-07T11:13:25.249690+0000","last_active":"2024-05-07T11:13:46.317740+0000","last_peered":"2024-05-07T11:13:46.317740+0000","last_clean":"2024-05-07T11:13:46.317740+0000","last_became_active":"2024-05-07T11:13:25.249304+0000","last_became_peered":"2024-05-07T11:13:25.249304+0000","last_unstale":"2024-05-07T11:13:46.317740+0000","last_undegraded":"2024-05-07T11:13:46.317740+0000","last_fullsized":"2024-05-07T11:13:46.317740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:30.051793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378444+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:13:46.378444+0000","last_peered":"2024-05-07T11:13:46.378444+0000","last_clean":"2024-05-07T11:13:46.378444+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:13:46.378444+0000","last_undegraded":"2024-05-07T11:13:46.378444+0000","last_fullsized":"2024-05-07T11:13:46.378444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317842+0000","last_change":"2024-05-07T11:13:25.249164+0000","last_active":"2024-05-07T11:13:46.317842+0000","last_peered":"2024-05-07T11:13:46.317842+0000","last_clean":"2024-05-07T11:13:46.317842+0000","last_became_active":"2024-05-07T11:13:25.248783+0000","last_became_peered":"2024-05-07T11:13:25.248783+0000","last_unstale":"2024-05-07T11:13:46.317842+0000","last_undegraded":"2024-05-07T11:13:46.317842+0000","last_fullsized":"2024-05-07T11:13:46.317842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:00.987017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317591+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:13:46.317591+0000","last_peered":"2024-05-07T11:13:46.317591+0000","last_clean":"2024-05-07T11:13:46.317591+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:13:46.317591+0000","last_undegraded":"2024-05-07T11:13:46.317591+0000","last_fullsized":"2024-05-07T11:13:46.317591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317896+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:13:46.317896+0000","last_peered":"2024-05-07T11:13:46.317896+0000","last_clean":"2024-05-07T11:13:46.317896+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:13:46.317896+0000","last_undegraded":"2024-05-07T11:13:46.317896+0000","last_fullsized":"2024-05-07T11:13:46.317896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378740+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:13:46.378740+0000","last_peered":"2024-05-07T11:13:46.378740+0000","last_clean":"2024-05-07T11:13:46.378740+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:13:46.378740+0000","last_undegraded":"2024-05-07T11:13:46.378740+0000","last_fullsized":"2024-05-07T11:13:46.378740+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378788+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:13:46.378788+0000","last_peered":"2024-05-07T11:13:46.378788+0000","last_clean":"2024-05-07T11:13:46.378788+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:13:46.378788+0000","last_undegraded":"2024-05-07T11:13:46.378788+0000","last_fullsized":"2024-05-07T11:13:46.378788+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378954+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:13:46.378954+0000","last_peered":"2024-05-07T11:13:46.378954+0000","last_clean":"2024-05-07T11:13:46.378954+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:13:46.378954+0000","last_undegraded":"2024-05-07T11:13:46.378954+0000","last_fullsized":"2024-05-07T11:13:46.378954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317426+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:13:46.317426+0000","last_peered":"2024-05-07T11:13:46.317426+0000","last_clean":"2024-05-07T11:13:46.317426+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:13:46.317426+0000","last_undegraded":"2024-05-07T11:13:46.317426+0000","last_fullsized":"2024-05-07T11:13:46.317426+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378707+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:13:46.378707+0000","last_peered":"2024-05-07T11:13:46.378707+0000","last_clean":"2024-05-07T11:13:46.378707+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:13:46.378707+0000","last_undegraded":"2024-05-07T11:13:46.378707+0000","last_fullsized":"2024-05-07T11:13:46.378707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317301+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:13:46.317301+0000","last_peered":"2024-05-07T11:13:46.317301+0000","last_clean":"2024-05-07T11:13:46.317301+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:13:46.317301+0000","last_undegraded":"2024-05-07T11:13:46.317301+0000","last_fullsized":"2024-05-07T11:13:46.317301+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318233+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:13:46.318233+0000","last_peered":"2024-05-07T11:13:46.318233+0000","last_clean":"2024-05-07T11:13:46.318233+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:13:46.318233+0000","last_undegraded":"2024-05-07T11:13:46.318233+0000","last_fullsized":"2024-05-07T11:13:46.318233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":254,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378593+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:13:46.378593+0000","last_peered":"2024-05-07T11:13:46.378593+0000","last_clean":"2024-05-07T11:13:46.378593+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:13:46.378593+0000","last_undegraded":"2024-05-07T11:13:46.378593+0000","last_fullsized":"2024-05-07T11:13:46.378593+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379333+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:13:46.379333+0000","last_peered":"2024-05-07T11:13:46.379333+0000","last_clean":"2024-05-07T11:13:46.379333+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:13:46.379333+0000","last_undegraded":"2024-05-07T11:13:46.379333+0000","last_fullsized":"2024-05-07T11:13:46.379333+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317614+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:13:46.317614+0000","last_peered":"2024-05-07T11:13:46.317614+0000","last_clean":"2024-05-07T11:13:46.317614+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:13:46.317614+0000","last_undegraded":"2024-05-07T11:13:46.317614+0000","last_fullsized":"2024-05-07T11:13:46.317614+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317736+0000","last_change":"2024-05-07T11:13:25.249760+0000","last_active":"2024-05-07T11:13:46.317736+0000","last_peered":"2024-05-07T11:13:46.317736+0000","last_clean":"2024-05-07T11:13:46.317736+0000","last_became_active":"2024-05-07T11:13:25.249466+0000","last_became_peered":"2024-05-07T11:13:25.249466+0000","last_unstale":"2024-05-07T11:13:46.317736+0000","last_undegraded":"2024-05-07T11:13:46.317736+0000","last_fullsized":"2024-05-07T11:13:46.317736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378554+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:13:46.378554+0000","last_peered":"2024-05-07T11:13:46.378554+0000","last_clean":"2024-05-07T11:13:46.378554+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:13:46.378554+0000","last_undegraded":"2024-05-07T11:13:46.378554+0000","last_fullsized":"2024-05-07T11:13:46.378554+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317612+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:13:46.317612+0000","last_peered":"2024-05-07T11:13:46.317612+0000","last_clean":"2024-05-07T11:13:46.317612+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:13:46.317612+0000","last_undegraded":"2024-05-07T11:13:46.317612+0000","last_fullsized":"2024-05-07T11:13:46.317612+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317920+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:13:46.317920+0000","last_peered":"2024-05-07T11:13:46.317920+0000","last_clean":"2024-05-07T11:13:46.317920+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:13:46.317920+0000","last_undegraded":"2024-05-07T11:13:46.317920+0000","last_fullsized":"2024-05-07T11:13:46.317920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317786+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:13:46.317786+0000","last_peered":"2024-05-07T11:13:46.317786+0000","last_clean":"2024-05-07T11:13:46.317786+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:13:46.317786+0000","last_undegraded":"2024-05-07T11:13:46.317786+0000","last_fullsized":"2024-05-07T11:13:46.317786+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317309+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:13:46.317309+0000","last_peered":"2024-05-07T11:13:46.317309+0000","last_clean":"2024-05-07T11:13:46.317309+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:13:46.317309+0000","last_undegraded":"2024-05-07T11:13:46.317309+0000","last_fullsized":"2024-05-07T11:13:46.317309+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318352+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:13:46.318352+0000","last_peered":"2024-05-07T11:13:46.318352+0000","last_clean":"2024-05-07T11:13:46.318352+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:13:46.318352+0000","last_undegraded":"2024-05-07T11:13:46.318352+0000","last_fullsized":"2024-05-07T11:13:46.318352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378855+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:13:46.378855+0000","last_peered":"2024-05-07T11:13:46.378855+0000","last_clean":"2024-05-07T11:13:46.378855+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:13:46.378855+0000","last_undegraded":"2024-05-07T11:13:46.378855+0000","last_fullsized":"2024-05-07T11:13:46.378855+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379266+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:13:46.379266+0000","last_peered":"2024-05-07T11:13:46.379266+0000","last_clean":"2024-05-07T11:13:46.379266+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:13:46.379266+0000","last_undegraded":"2024-05-07T11:13:46.379266+0000","last_fullsized":"2024-05-07T11:13:46.379266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317961+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:13:46.317961+0000","last_peered":"2024-05-07T11:13:46.317961+0000","last_clean":"2024-05-07T11:13:46.317961+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:13:46.317961+0000","last_undegraded":"2024-05-07T11:13:46.317961+0000","last_fullsized":"2024-05-07T11:13:46.317961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317912+0000","last_change":"2024-05-07T11:13:25.249176+0000","last_active":"2024-05-07T11:13:46.317912+0000","last_peered":"2024-05-07T11:13:46.317912+0000","last_clean":"2024-05-07T11:13:46.317912+0000","last_became_active":"2024-05-07T11:13:25.248831+0000","last_became_peered":"2024-05-07T11:13:25.248831+0000","last_unstale":"2024-05-07T11:13:46.317912+0000","last_undegraded":"2024-05-07T11:13:46.317912+0000","last_fullsized":"2024-05-07T11:13:46.317912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:48:30.756870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318098+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:13:46.318098+0000","last_peered":"2024-05-07T11:13:46.318098+0000","last_clean":"2024-05-07T11:13:46.318098+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:13:46.318098+0000","last_undegraded":"2024-05-07T11:13:46.318098+0000","last_fullsized":"2024-05-07T11:13:46.318098+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317401+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:13:46.317401+0000","last_peered":"2024-05-07T11:13:46.317401+0000","last_clean":"2024-05-07T11:13:46.317401+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:13:46.317401+0000","last_undegraded":"2024-05-07T11:13:46.317401+0000","last_fullsized":"2024-05-07T11:13:46.317401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318014+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:13:46.318014+0000","last_peered":"2024-05-07T11:13:46.318014+0000","last_clean":"2024-05-07T11:13:46.318014+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:13:46.318014+0000","last_undegraded":"2024-05-07T11:13:46.318014+0000","last_fullsized":"2024-05-07T11:13:46.318014+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318164+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:13:46.318164+0000","last_peered":"2024-05-07T11:13:46.318164+0000","last_clean":"2024-05-07T11:13:46.318164+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:13:46.318164+0000","last_undegraded":"2024-05-07T11:13:46.318164+0000","last_fullsized":"2024-05-07T11:13:46.318164+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317544+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:13:46.317544+0000","last_peered":"2024-05-07T11:13:46.317544+0000","last_clean":"2024-05-07T11:13:46.317544+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:13:46.317544+0000","last_undegraded":"2024-05-07T11:13:46.317544+0000","last_fullsized":"2024-05-07T11:13:46.317544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318546+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:13:46.318546+0000","last_peered":"2024-05-07T11:13:46.318546+0000","last_clean":"2024-05-07T11:13:46.318546+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:13:46.318546+0000","last_undegraded":"2024-05-07T11:13:46.318546+0000","last_fullsized":"2024-05-07T11:13:46.318546+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318380+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:13:46.318380+0000","last_peered":"2024-05-07T11:13:46.318380+0000","last_clean":"2024-05-07T11:13:46.318380+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:13:46.318380+0000","last_undegraded":"2024-05-07T11:13:46.318380+0000","last_fullsized":"2024-05-07T11:13:46.318380+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317403+0000","last_change":"2024-05-07T11:13:25.248884+0000","last_active":"2024-05-07T11:13:46.317403+0000","last_peered":"2024-05-07T11:13:46.317403+0000","last_clean":"2024-05-07T11:13:46.317403+0000","last_became_active":"2024-05-07T11:13:25.248619+0000","last_became_peered":"2024-05-07T11:13:25.248619+0000","last_unstale":"2024-05-07T11:13:46.317403+0000","last_undegraded":"2024-05-07T11:13:46.317403+0000","last_fullsized":"2024-05-07T11:13:46.317403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318385+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:13:46.318385+0000","last_peered":"2024-05-07T11:13:46.318385+0000","last_clean":"2024-05-07T11:13:46.318385+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:13:46.318385+0000","last_undegraded":"2024-05-07T11:13:46.318385+0000","last_fullsized":"2024-05-07T11:13:46.318385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379270+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:13:46.379270+0000","last_peered":"2024-05-07T11:13:46.379270+0000","last_clean":"2024-05-07T11:13:46.379270+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:13:46.379270+0000","last_undegraded":"2024-05-07T11:13:46.379270+0000","last_fullsized":"2024-05-07T11:13:46.379270+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317277+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:13:46.317277+0000","last_peered":"2024-05-07T11:13:46.317277+0000","last_clean":"2024-05-07T11:13:46.317277+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:13:46.317277+0000","last_undegraded":"2024-05-07T11:13:46.317277+0000","last_fullsized":"2024-05-07T11:13:46.317277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378532+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:13:46.378532+0000","last_peered":"2024-05-07T11:13:46.378532+0000","last_clean":"2024-05-07T11:13:46.378532+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:13:46.378532+0000","last_undegraded":"2024-05-07T11:13:46.378532+0000","last_fullsized":"2024-05-07T11:13:46.378532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.379195+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:13:46.379195+0000","last_peered":"2024-05-07T11:13:46.379195+0000","last_clean":"2024-05-07T11:13:46.379195+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:13:46.379195+0000","last_undegraded":"2024-05-07T11:13:46.379195+0000","last_fullsized":"2024-05-07T11:13:46.379195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317378+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:13:46.317378+0000","last_peered":"2024-05-07T11:13:46.317378+0000","last_clean":"2024-05-07T11:13:46.317378+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:13:46.317378+0000","last_undegraded":"2024-05-07T11:13:46.317378+0000","last_fullsized":"2024-05-07T11:13:46.317378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318051+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:13:46.318051+0000","last_peered":"2024-05-07T11:13:46.318051+0000","last_clean":"2024-05-07T11:13:46.318051+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:13:46.318051+0000","last_undegraded":"2024-05-07T11:13:46.318051+0000","last_fullsized":"2024-05-07T11:13:46.318051+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318165+0000","last_change":"2024-05-07T11:13:25.249281+0000","last_active":"2024-05-07T11:13:46.318165+0000","last_peered":"2024-05-07T11:13:46.318165+0000","last_clean":"2024-05-07T11:13:46.318165+0000","last_became_active":"2024-05-07T11:13:25.249068+0000","last_became_peered":"2024-05-07T11:13:25.249068+0000","last_unstale":"2024-05-07T11:13:46.318165+0000","last_undegraded":"2024-05-07T11:13:46.318165+0000","last_fullsized":"2024-05-07T11:13:46.318165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:30:57.180798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317350+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:13:46.317350+0000","last_peered":"2024-05-07T11:13:46.317350+0000","last_clean":"2024-05-07T11:13:46.317350+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:13:46.317350+0000","last_undegraded":"2024-05-07T11:13:46.317350+0000","last_fullsized":"2024-05-07T11:13:46.317350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318474+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:13:46.318474+0000","last_peered":"2024-05-07T11:13:46.318474+0000","last_clean":"2024-05-07T11:13:46.318474+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:13:46.318474+0000","last_undegraded":"2024-05-07T11:13:46.318474+0000","last_fullsized":"2024-05-07T11:13:46.318474+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317306+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:13:46.317306+0000","last_peered":"2024-05-07T11:13:46.317306+0000","last_clean":"2024-05-07T11:13:46.317306+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:13:46.317306+0000","last_undegraded":"2024-05-07T11:13:46.317306+0000","last_fullsized":"2024-05-07T11:13:46.317306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318170+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:13:46.318170+0000","last_peered":"2024-05-07T11:13:46.318170+0000","last_clean":"2024-05-07T11:13:46.318170+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:13:46.318170+0000","last_undegraded":"2024-05-07T11:13:46.318170+0000","last_fullsized":"2024-05-07T11:13:46.318170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317479+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:13:46.317479+0000","last_peered":"2024-05-07T11:13:46.317479+0000","last_clean":"2024-05-07T11:13:46.317479+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:13:46.317479+0000","last_undegraded":"2024-05-07T11:13:46.317479+0000","last_fullsized":"2024-05-07T11:13:46.317479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318095+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:13:46.318095+0000","last_peered":"2024-05-07T11:13:46.318095+0000","last_clean":"2024-05-07T11:13:46.318095+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:13:46.318095+0000","last_undegraded":"2024-05-07T11:13:46.318095+0000","last_fullsized":"2024-05-07T11:13:46.318095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317487+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:13:46.317487+0000","last_peered":"2024-05-07T11:13:46.317487+0000","last_clean":"2024-05-07T11:13:46.317487+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:13:46.317487+0000","last_undegraded":"2024-05-07T11:13:46.317487+0000","last_fullsized":"2024-05-07T11:13:46.317487+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317856+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:13:46.317856+0000","last_peered":"2024-05-07T11:13:46.317856+0000","last_clean":"2024-05-07T11:13:46.317856+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:13:46.317856+0000","last_undegraded":"2024-05-07T11:13:46.317856+0000","last_fullsized":"2024-05-07T11:13:46.317856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317655+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:13:46.317655+0000","last_peered":"2024-05-07T11:13:46.317655+0000","last_clean":"2024-05-07T11:13:46.317655+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:13:46.317655+0000","last_undegraded":"2024-05-07T11:13:46.317655+0000","last_fullsized":"2024-05-07T11:13:46.317655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317596+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:13:46.317596+0000","last_peered":"2024-05-07T11:13:46.317596+0000","last_clean":"2024-05-07T11:13:46.317596+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:13:46.317596+0000","last_undegraded":"2024-05-07T11:13:46.317596+0000","last_fullsized":"2024-05-07T11:13:46.317596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317660+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:13:46.317660+0000","last_peered":"2024-05-07T11:13:46.317660+0000","last_clean":"2024-05-07T11:13:46.317660+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:13:46.317660+0000","last_undegraded":"2024-05-07T11:13:46.317660+0000","last_fullsized":"2024-05-07T11:13:46.317660+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378399+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:13:46.378399+0000","last_peered":"2024-05-07T11:13:46.378399+0000","last_clean":"2024-05-07T11:13:46.378399+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:13:46.378399+0000","last_undegraded":"2024-05-07T11:13:46.378399+0000","last_fullsized":"2024-05-07T11:13:46.378399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378876+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:13:46.378876+0000","last_peered":"2024-05-07T11:13:46.378876+0000","last_clean":"2024-05-07T11:13:46.378876+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:13:46.378876+0000","last_undegraded":"2024-05-07T11:13:46.378876+0000","last_fullsized":"2024-05-07T11:13:46.378876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378592+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:13:46.378592+0000","last_peered":"2024-05-07T11:13:46.378592+0000","last_clean":"2024-05-07T11:13:46.378592+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:13:46.378592+0000","last_undegraded":"2024-05-07T11:13:46.378592+0000","last_fullsized":"2024-05-07T11:13:46.378592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317973+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:13:46.317973+0000","last_peered":"2024-05-07T11:13:46.317973+0000","last_clean":"2024-05-07T11:13:46.317973+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:13:46.317973+0000","last_undegraded":"2024-05-07T11:13:46.317973+0000","last_fullsized":"2024-05-07T11:13:46.317973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.317491+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:13:46.317491+0000","last_peered":"2024-05-07T11:13:46.317491+0000","last_clean":"2024-05-07T11:13:46.317491+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:13:46.317491+0000","last_undegraded":"2024-05-07T11:13:46.317491+0000","last_fullsized":"2024-05-07T11:13:46.317491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318266+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:13:46.318266+0000","last_peered":"2024-05-07T11:13:46.318266+0000","last_clean":"2024-05-07T11:13:46.318266+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:13:46.318266+0000","last_undegraded":"2024-05-07T11:13:46.318266+0000","last_fullsized":"2024-05-07T11:13:46.318266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.378420+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:13:46.378420+0000","last_peered":"2024-05-07T11:13:46.378420+0000","last_clean":"2024-05-07T11:13:46.378420+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:13:46.378420+0000","last_undegraded":"2024-05-07T11:13:46.378420+0000","last_fullsized":"2024-05-07T11:13:46.378420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-07T11:13:46.318363+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:13:46.318363+0000","last_peered":"2024-05-07T11:13:46.318363+0000","last_clean":"2024-05-07T11:13:46.318363+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:13:46.318363+0000","last_undegraded":"2024-05-07T11:13:46.318363+0000","last_fullsized":"2024-05-07T11:13:46.318363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":372736,"data_stored":720324,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738385,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":728230,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":127482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:13:48.123 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-07T11:13:48.123 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:13:48.123 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-05-07T11:13:48.123 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-05-07T11:13:48.123 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-05-07T11:13:48.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-05-07T11:13:48.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:48.189 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:48.189+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:48.231 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:48.231 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-05-07T11:13:48.231 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:48.272 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.505662498000007, 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:48.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:48.277 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.277 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.277 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.277 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:48.277 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:48.277 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 68.839107342000005, 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:48.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.281 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 68.609500249999996, 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 68.608825076000002, 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:48.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:48.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:48.289 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 68.608183255, 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:48.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:48.293 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 68.607714846999997, 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:48.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:48.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:48.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 68.605009326000001, 2024-05-07T11:13:48.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:48.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.302 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.227692945000001, 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:48.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:48.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:48.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:48.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:48.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.227636169999997, 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.308 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.227607699000004, 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.314 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:48.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:48.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:48.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:48.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:48.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.227568904999998, 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.325 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.227525581999998, 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:48.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:48.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:48.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:48.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.331 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.227503030999998, 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:48.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:48.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.227478970999996, 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:48.337 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.227460011000005, 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:48.343 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:48.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:48.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:48.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.347 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.227433339000001, 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:48.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:48.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.222929078999996, 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:48.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:48.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.221202551999994, 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.356 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:48.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:48.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:48.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.221050218000002, 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.360 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 64.220997245999996, 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:48.364 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:48.368 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:48.370 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:13:48.371 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:48.371 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:48.369+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:48.471 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:48.470+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:48.480 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:48.480 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:48.480 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:48.481 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:48.489 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:48.571 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:48.571+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:48.593 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:48.593 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:48.594 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:48.594 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:48.594 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:48.602 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:48.673 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:48.672+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:48.708 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:48.708 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:48.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:48.708 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.760236422999995, 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:48.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.436010535999998, 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.714 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.275535137000006, 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:48.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:48.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:48.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.275448768999993, 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:48.725 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.046301335999999, 2024-05-07T11:13:48.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.046253871000005, 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.664341483000001, 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.741 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:48.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.662146398999994, 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.747 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:48.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:48.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.752 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.661918178999997, 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:48.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:48.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:48.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.758 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.661739049000005, 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:48.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:48.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:48.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:48.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:48.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.661679175000003, 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.764 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:48.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:48.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.661631002999997, 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.769 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:48.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:48.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:48.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.661603021000005, 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:48.774 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:48.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.661570010999995, 2024-05-07T11:13:48.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.661476207000007, 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:48.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.661332764999997, 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:48.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.795 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.66114786, 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:48.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.660988790000005, 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.660545381000006, 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:48.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.660520117000004, 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:48.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:48.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:48.814 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:48.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:48.816 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:48.815+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:48.917 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:48.916+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:48.921 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:48.922 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:48.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:49.018 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:49.017+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:49.035 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:49.035 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:49.035 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:49.035 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:49.036 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:49.044 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:49.118 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:49.118+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:49.151 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.107111676000002, 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.107046956000005, 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:49.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:49.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.106950015999999, 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.106884678, 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.106857786000006, 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.106830208000005, 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.106794819000001, 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.188 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.106769212000003, 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:49.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:49.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:49.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.106739782000005, 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.193 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:49.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.104353807999999, 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.100095268999993, 2024-05-07T11:13:49.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:49.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:49.204 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.099447265999999, 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:49.208 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.098801946999998, 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:49.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:49.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:49.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:49.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:49.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:49.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:49.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.098528383000001, 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.214 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:49.218 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:49.219 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.097768379000001, 2024-05-07T11:13:49.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:49.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:49.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:49.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:49.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:49.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:49.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:49.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:49.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:49.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:49.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:49.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:49.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:49.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:49.226 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.226 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.226 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.227 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:49.227 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:49.227 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.097183759999993, 2024-05-07T11:13:49.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:49.228 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.228 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.228 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:49.228 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:49.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:49.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:49.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:49.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:49.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:49.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:49.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:49.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:49.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:49.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.235 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.093426950999998, 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:49.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:49.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:49.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:49.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.108410917, 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:49.240 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.241 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.241 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.241 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.241 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:49.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.241 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:49.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:49.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:49.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.105920472000001, 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:49.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.105184827000002, 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:49.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:49.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:49.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:49.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:49.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:49.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:49.261 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:49.263 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:49.262+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:49.263 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:49.364 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:49.363+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:49.379 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:49.379 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:49.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:49.465 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:49.465+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:49.534 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:49.535 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:49.535 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:49.535 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:49.535 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:49.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:49.586 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:49.585+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:49.649 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 70.882965409999997, 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 70.216410253999996, 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.986803162000001, 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.986127988000007, 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:49.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.985486167000005, 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.669 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.985017759000002, 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.982312238000006, 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:49.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:49.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.681 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.604995857000006, 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.604939082000001, 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:49.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.604910610999994, 2024-05-07T11:13:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:49.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:49.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:49.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:49.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.604871817000003, 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.699 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:49.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:49.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:49.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:49.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:49.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.604828494000003, 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:49.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:49.710 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.604805943000002, 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:49.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:49.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:49.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.604781883000001, 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:49.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:49.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:49.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.604762922999996, 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:49.722 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.604736251000006, 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.600231991000001, 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.598505463999999, 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.598353130000007, 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.598300158000001, 2024-05-07T11:13:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:49.747 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:49.749 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:49.749 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:49.748+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:49.850 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:49.849+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:49.858 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:49.859 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:49.859 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:49.859 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:49.867 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:49.891 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:49.951 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:49.950+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:49.972 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:49.972 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:49.981 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:50.019 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:50.020 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:50.039 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:50.039 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:50.058 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:50.058 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:50.065 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:50.065+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:50.128 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:50.129 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:50.135 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:50.179 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:50.179+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:50.244 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:50.245 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:50.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:50.254 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:50.253+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:50.354 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:50.354+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:50.372 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T11:13:50.400 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:50.400 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:50.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:50.455 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:50.455+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:50.514 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:50.514 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:50.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:50.566 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:50.565+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:50.637 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:50.637 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:50.646 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:50.659 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:50.659+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:50.761 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:50.760+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:50.792 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:50.792 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:50.801 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:50.862 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:50.861+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:50.905 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:50.905 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:50.914 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:50.963 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:50.963+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:51.026 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:51.027 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:51.036 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:51.064 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:51.064+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:51.140 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:51.140 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:51.150 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:51.194 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:51.194+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:51.255 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:51.255 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:51.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:51.306 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:51.305+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:51.341 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-05-07T11:13:51.367 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:51.367+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:51.378 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:51.378 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:51.388 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:51.468 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:51.467+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:51.534 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:51.534 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:51.543 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:51.586 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:51.586+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:51.647 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:51.647 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:51.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:51.670 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:51.670+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:51.772 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:51.771+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:51.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:51.873 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:51.873+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:51.896 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:51.974 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:51.974+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:52.001 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:52.002 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:52.012 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:52.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:52.075 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:52.074+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:52.120 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:52.121 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:52.129 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:52.175 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:52.175+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:52.204 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:52.232 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:52.232 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:52.234 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:52.234 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:52.243 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:52.249 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:52.249 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:52.276 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:52.275+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:52.377 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:52.377+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:52.389 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:52.389 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:52.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.441128075999998, 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:52.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:52.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:52.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:52.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:52.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.116902189000001, 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:52.395 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:52.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:52.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.400 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.956426789999995, 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:52.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:52.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:52.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.956340421999997, 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:52.406 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:52.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:52.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:52.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.727192989000002, 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.411 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:52.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:52.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:52.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:52.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:52.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:52.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:52.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:52.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:52.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:52.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:52.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:52.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:52.418 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.727145523999994, 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.423 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.345233136000004, 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:52.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:52.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.429 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.343038051999997, 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:52.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:52.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:52.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:52.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.342809832, 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:52.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:52.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:52.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:52.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.342630701999994, 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.342570828000007, 2024-05-07T11:13:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:52.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:52.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:52.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.342522656, 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.342494673999994, 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:52.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:52.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.342461663999998, 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:52.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:52.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:52.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.342367859999996, 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.342224418000001, 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:52.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:52.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:52.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.342039513000003, 2024-05-07T11:13:52.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.341880442999994, 2024-05-07T11:13:52.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.341437033999995, 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:52.489 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:52.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 68.341411769999993, 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:52.494 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:52.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:52.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:52.497 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.498 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.498 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.498 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:52.498 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:52.498 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:52.499 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:52.500 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:52.499+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:52.600 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:52.600+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:52.615 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:52.615 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:52.615 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:52.615 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:52.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:52.701 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:52.701+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:52.728 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:52.729 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:52.729 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:52.729 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:52.729 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:52.737 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:52.803 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:52.802+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:52.844 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:52.844 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:52.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:52.844 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:52.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.844 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.844 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:52.844 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.799950874999993, 2024-05-07T11:13:52.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:52.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:52.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:52.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.799886154999996, 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.851 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:52.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:52.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:52.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:52.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:52.856 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.799789215000004, 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.799723877000005, 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.799696984999997, 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:52.868 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.799669406999996, 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.874 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:52.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:52.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:52.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:52.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.799634018000006, 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.879 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:52.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:52.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.799608410999994, 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:52.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.887 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.799578980999996, 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:52.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:52.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.797193007000004, 2024-05-07T11:13:52.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.894 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.792934467999999, 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:52.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:52.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.792286465000004, 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:52.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.791641146000003, 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.791367582000007, 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.790607578000007, 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:52.911 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:52.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:52.914 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.790022958999998, 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:52.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:52.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:52.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.786266150000003, 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:52.918 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:52.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.801250116000006, 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:52.927 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.798759670999999, 2024-05-07T11:13:52.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:52.929 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.929 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.929 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.929 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:52.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 38.798024026, 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:52.934 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:52.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:52.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:52.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:52.939 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:52.941 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:52.941 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:52.940+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:53.042 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:53.041+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:53.059 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:53.059 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:53.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:53.143 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:53.143+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:53.215 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:53.216 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:53.216 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:53.216 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:53.216 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:53.225 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:53.241 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:13:53.241 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:13:53.241 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-05-07T11:13:53.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-07T11:13:53.245 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:53.244+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:53.330 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:53.330 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:53.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:53.330 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:53.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.330 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:53.330 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.563389216000004, 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:53.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:53.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:53.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:53.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.896834060000003, 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:53.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:53.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:53.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:53.341 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.667226967999994, 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.666551794, 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:53.346 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:53.350 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.665909972999998, 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:53.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.665441564999995, 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:53.354 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:53.358 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.662736043999999, 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.362 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.285419662999999, 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:53.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:53.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:53.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.285362887999995, 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.374 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.285334417000001, 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:53.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.285295622999996, 2024-05-07T11:13:53.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:53.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.285252299999996, 2024-05-07T11:13:53.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:53.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:53.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:53.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.285229748999996, 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.398 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.285205688999994, 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:53.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:53.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:53.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:53.404 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.285186729000003, 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:53.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:53.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.285160056999999, 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:53.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:53.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.280655796999994, 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:53.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:53.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:53.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.278929270000006, 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.278776936, 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.422 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:53.426 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.278723963999994, 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:53.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:53.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:53.430 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:53.431 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:53.431 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T11:13:53.433 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:53.433 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:53.431+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:53.532 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:53.532+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:53.551 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:53.551 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:53.551 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:53.551 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:53.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:53.633 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:53.632+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:53.665 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:53.665 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:53.666 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:53.666 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:53.666 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:53.675 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:53.711 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:13:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 38, 2024-05-07T11:13:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "712a8431-2ac1-4386-a81f-c899bab82549", 2024-05-07T11:13:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-05-07T11:12:28.567931+0000", 2024-05-07T11:13:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-05-07T11:13:51.334139+0000", 2024-05-07T11:13:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-05-07T11:12:36.689723+0000", 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-05-07T11:12:29.411691+0000", 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-05-07T11:13:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 4, 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "luminous", 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:36.979175+0000", 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.9900000095367432, 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.9900000095367432, 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 2, 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 2, 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:37.110970+0000", 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-05-07T11:13:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-05-07T11:13:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.5, 2024-05-07T11:13:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.5, 2024-05-07T11:13:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:13:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-05-07T11:13:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-05-07T11:13:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:13:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:13:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:41.627365+0000", 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-05-07T11:13:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "14", 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:53.728 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:13:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-05-07T11:13:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-05-07T11:13:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-05-07T11:13:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-05-07T11:13:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-05-07T11:13:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.4099999666213989, 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.4099999666213989, 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.4099999666213989, 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.4099999666213989, 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:42.384664+0000", 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:13:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:13:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:13:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:13:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:13:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.2200000286102295, 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.2200000286102295, 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:13:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.2200000286102295, 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.2200000286102295, 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cd7246e2-0069-4df7-a669-4abe038a28ad", 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:13:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 24, 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6800", 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6801", 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6802", 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6803", 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6806", 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6807", 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6804", 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6805", 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.88:6801/1378788154", 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.88:6803/1378788154", 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.88:6807/1378788154", 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.88:6805/1378788154", 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:13:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-05-07T11:13:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "7df5bb74-60c0-4a46-a3d1-494f777a4f88", 2024-05-07T11:13:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:13:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:13:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:13:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:13:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:13:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:13:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:13:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 24, 2024-05-07T11:13:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6800", 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6801", 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6802", 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6803", 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6806", 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6807", 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6804", 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6805", 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.149:6801/3051775179", 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.149:6803/3051775179", 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.149:6807/3051775179", 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.149:6805/3051775179", 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "ebed6b16-fba7-4b8a-a78e-1f84a500c31f", 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:13:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 0.7828826904296875, 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 17, 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6800", 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6801", 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6802", 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6803", 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6806", 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6807", 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6804", 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6805", 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.175:6801/2659225388", 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.175:6803/2659225388", 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.175:6807/2659225388", 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.175:6805/2659225388", 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.430581+0000", 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:13:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.433407+0000", 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.440186+0000", 2024-05-07T11:13:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:13:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [ 2024-05-07T11:13:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:13:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.0", 2024-05-07T11:13:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-05-07T11:13:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: 2, 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: 0 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-05-07T11:13:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-05-07T11:13:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-05-07T11:13:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-05-07T11:13:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-05-07T11:13:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-05-07T11:13:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-05-07T11:13:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:13:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-05-07T11:13:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:13:53.765 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:13:53.767 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:53.766+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:53.768 INFO:tasks.thrashosds.thrasher:j is {'epoch': 38, 'fsid': '712a8431-2ac1-4386-a81f-c899bab82549', 'created': '2024-05-07T11:12:28.567931+0000', 'modified': '2024-05-07T11:13:51.334139+0000', 'last_up_change': '2024-05-07T11:12:36.689723+0000', 'last_in_change': '2024-05-07T11:12:29.411691+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-07T11:12:41.627365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-05-07T11:12:42.384664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}], 'osds': [{'osd': 0, 'uuid': 'cd7246e2-0069-4df7-a669-4abe038a28ad', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6800', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6801', 'nonce': 1378788154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6802', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6803', 'nonce': 1378788154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6806', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6807', 'nonce': 1378788154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6804', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6805', 'nonce': 1378788154}]}, 'public_addr': '172.21.15.88:6801/1378788154', 'cluster_addr': '172.21.15.88:6803/1378788154', 'heartbeat_back_addr': '172.21.15.88:6807/1378788154', 'heartbeat_front_addr': '172.21.15.88:6805/1378788154', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7df5bb74-60c0-4a46-a3d1-494f777a4f88', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 3051775179}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 3051775179}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 3051775179}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 3051775179}]}, 'public_addr': '172.21.15.149:6801/3051775179', 'cluster_addr': '172.21.15.149:6803/3051775179', 'heartbeat_back_addr': '172.21.15.149:6807/3051775179', 'heartbeat_front_addr': '172.21.15.149:6805/3051775179', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'ebed6b16-fba7-4b8a-a78e-1f84a500c31f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7828826904296875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6800', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6801', 'nonce': 2659225388}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6802', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6803', 'nonce': 2659225388}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6806', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6807', 'nonce': 2659225388}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6804', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6805', 'nonce': 2659225388}]}, 'public_addr': '172.21.15.175:6801/2659225388', 'cluster_addr': '172.21.15.175:6803/2659225388', 'heartbeat_back_addr': '172.21.15.175:6807/2659225388', 'heartbeat_front_addr': '172.21.15.175:6805/2659225388', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.430581+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.433407+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.440186+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.0', 'osds': [2, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-07T11:13:53.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:13:53.783 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:53.783 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:53.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:53.783 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:53.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.783 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:53.783 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:53.783 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.833753883, 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:53.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:53.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:53.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:53.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.509527996000003, 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:53.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:53.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:53.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:53.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.796 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.349052596999996, 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:53.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.348966228999998, 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.803 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:53.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:53.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.119818796000004, 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.119771330999995, 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:53.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.737858943000006, 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.820 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.735663858999999, 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.826 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.735435639000002, 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.832 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:53.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.735256508999996, 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.838 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.735196634999994, 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.844 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:53.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.735148463000002, 2024-05-07T11:13:53.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:53.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:53.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.735120480999996, 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:53.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:53.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:53.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.735087471, 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:53.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:53.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.734993666999998, 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:53.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:53.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:53.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:53.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.734850225000002, 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:53.871 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.734665320000005, 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.877 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:53.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:53.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.734506249999995, 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.887 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.734062840999997, 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:53.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:53.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:53.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.734037576999995, 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:53.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:53.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.896 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.897 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.897 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:53.897 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:53.897 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:53.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:53.899 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:53.898+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:54.000 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:53.999+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:54.019 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:54.019 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:54.019 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:54.019 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:54.026 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:54.100 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:54.100+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:54.132 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:54.132 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:54.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:54.202 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:54.201+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:54.222 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:13:54.224 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:13:54.235 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-05-07T11:13:52.950510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90496,"kb_used_data":1104,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025024,"statfs":{"total":289910292480,"available":289817624576,"internally_reserved":0,"allocated":1130496,"data_stored":1618614,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000977"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.342023+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:13:51.342023+0000","last_peered":"2024-05-07T11:13:51.342023+0000","last_clean":"2024-05-07T11:13:51.342023+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:13:51.342023+0000","last_undegraded":"2024-05-07T11:13:51.342023+0000","last_fullsized":"2024-05-07T11:13:51.342023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341702+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:13:51.341702+0000","last_peered":"2024-05-07T11:13:51.341702+0000","last_clean":"2024-05-07T11:13:51.341702+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:13:51.341702+0000","last_undegraded":"2024-05-07T11:13:51.341702+0000","last_fullsized":"2024-05-07T11:13:51.341702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335027+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:13:48.335027+0000","last_peered":"2024-05-07T11:13:48.335027+0000","last_clean":"2024-05-07T11:13:48.335027+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:13:48.335027+0000","last_undegraded":"2024-05-07T11:13:48.335027+0000","last_fullsized":"2024-05-07T11:13:48.335027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334945+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:13:48.334945+0000","last_peered":"2024-05-07T11:13:48.334945+0000","last_clean":"2024-05-07T11:13:48.334945+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:13:48.334945+0000","last_undegraded":"2024-05-07T11:13:48.334945+0000","last_fullsized":"2024-05-07T11:13:48.334945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341484+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:13:51.341484+0000","last_peered":"2024-05-07T11:13:51.341484+0000","last_clean":"2024-05-07T11:13:51.341484+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:13:51.341484+0000","last_undegraded":"2024-05-07T11:13:51.341484+0000","last_fullsized":"2024-05-07T11:13:51.341484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.340862+0000","last_change":"2024-05-07T11:13:25.248711+0000","last_active":"2024-05-07T11:13:51.340862+0000","last_peered":"2024-05-07T11:13:51.340862+0000","last_clean":"2024-05-07T11:13:51.340862+0000","last_became_active":"2024-05-07T11:13:25.248452+0000","last_became_peered":"2024-05-07T11:13:25.248452+0000","last_unstale":"2024-05-07T11:13:51.340862+0000","last_undegraded":"2024-05-07T11:13:51.340862+0000","last_fullsized":"2024-05-07T11:13:51.340862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.340809+0000","last_change":"2024-05-07T11:13:25.248071+0000","last_active":"2024-05-07T11:13:51.340809+0000","last_peered":"2024-05-07T11:13:51.340809+0000","last_clean":"2024-05-07T11:13:51.340809+0000","last_became_active":"2024-05-07T11:13:25.247861+0000","last_became_peered":"2024-05-07T11:13:25.247861+0000","last_unstale":"2024-05-07T11:13:51.340809+0000","last_undegraded":"2024-05-07T11:13:51.340809+0000","last_fullsized":"2024-05-07T11:13:51.340809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.057596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334469+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:13:48.334469+0000","last_peered":"2024-05-07T11:13:48.334469+0000","last_clean":"2024-05-07T11:13:48.334469+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:13:48.334469+0000","last_undegraded":"2024-05-07T11:13:48.334469+0000","last_fullsized":"2024-05-07T11:13:48.334469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341508+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:13:51.341508+0000","last_peered":"2024-05-07T11:13:51.341508+0000","last_clean":"2024-05-07T11:13:51.341508+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:13:51.341508+0000","last_undegraded":"2024-05-07T11:13:51.341508+0000","last_fullsized":"2024-05-07T11:13:51.341508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341721+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:13:51.341721+0000","last_peered":"2024-05-07T11:13:51.341721+0000","last_clean":"2024-05-07T11:13:51.341721+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:13:51.341721+0000","last_undegraded":"2024-05-07T11:13:51.341721+0000","last_fullsized":"2024-05-07T11:13:51.341721+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341346+0000","last_change":"2024-05-07T11:13:25.249909+0000","last_active":"2024-05-07T11:13:51.341346+0000","last_peered":"2024-05-07T11:13:51.341346+0000","last_clean":"2024-05-07T11:13:51.341346+0000","last_became_active":"2024-05-07T11:13:25.249670+0000","last_became_peered":"2024-05-07T11:13:25.249670+0000","last_unstale":"2024-05-07T11:13:51.341346+0000","last_undegraded":"2024-05-07T11:13:51.341346+0000","last_fullsized":"2024-05-07T11:13:51.341346+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:31.697406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341597+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:13:51.341597+0000","last_peered":"2024-05-07T11:13:51.341597+0000","last_clean":"2024-05-07T11:13:51.341597+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:13:51.341597+0000","last_undegraded":"2024-05-07T11:13:51.341597+0000","last_fullsized":"2024-05-07T11:13:51.341597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341360+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:13:51.341360+0000","last_peered":"2024-05-07T11:13:51.341360+0000","last_clean":"2024-05-07T11:13:51.341360+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:13:51.341360+0000","last_undegraded":"2024-05-07T11:13:51.341360+0000","last_fullsized":"2024-05-07T11:13:51.341360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334714+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:13:48.334714+0000","last_peered":"2024-05-07T11:13:48.334714+0000","last_clean":"2024-05-07T11:13:48.334714+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:13:48.334714+0000","last_undegraded":"2024-05-07T11:13:48.334714+0000","last_fullsized":"2024-05-07T11:13:48.334714+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334705+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:13:48.334705+0000","last_peered":"2024-05-07T11:13:48.334705+0000","last_clean":"2024-05-07T11:13:48.334705+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:13:48.334705+0000","last_undegraded":"2024-05-07T11:13:48.334705+0000","last_fullsized":"2024-05-07T11:13:48.334705+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.340776+0000","last_change":"2024-05-07T11:13:25.248991+0000","last_active":"2024-05-07T11:13:51.340776+0000","last_peered":"2024-05-07T11:13:51.340776+0000","last_clean":"2024-05-07T11:13:51.340776+0000","last_became_active":"2024-05-07T11:13:25.248693+0000","last_became_peered":"2024-05-07T11:13:25.248693+0000","last_unstale":"2024-05-07T11:13:51.340776+0000","last_undegraded":"2024-05-07T11:13:51.340776+0000","last_fullsized":"2024-05-07T11:13:51.340776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:27:15.749485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341817+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:13:51.341817+0000","last_peered":"2024-05-07T11:13:51.341817+0000","last_clean":"2024-05-07T11:13:51.341817+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:13:51.341817+0000","last_undegraded":"2024-05-07T11:13:51.341817+0000","last_fullsized":"2024-05-07T11:13:51.341817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341979+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:13:51.341979+0000","last_peered":"2024-05-07T11:13:51.341979+0000","last_clean":"2024-05-07T11:13:51.341979+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:13:51.341979+0000","last_undegraded":"2024-05-07T11:13:51.341979+0000","last_fullsized":"2024-05-07T11:13:51.341979+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341609+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:13:51.341609+0000","last_peered":"2024-05-07T11:13:51.341609+0000","last_clean":"2024-05-07T11:13:51.341609+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:13:51.341609+0000","last_undegraded":"2024-05-07T11:13:51.341609+0000","last_fullsized":"2024-05-07T11:13:51.341609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334954+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:13:48.334954+0000","last_peered":"2024-05-07T11:13:48.334954+0000","last_clean":"2024-05-07T11:13:48.334954+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:13:48.334954+0000","last_undegraded":"2024-05-07T11:13:48.334954+0000","last_fullsized":"2024-05-07T11:13:48.334954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334923+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:13:48.334923+0000","last_peered":"2024-05-07T11:13:48.334923+0000","last_clean":"2024-05-07T11:13:48.334923+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:13:48.334923+0000","last_undegraded":"2024-05-07T11:13:48.334923+0000","last_fullsized":"2024-05-07T11:13:48.334923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341260+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:13:51.341260+0000","last_peered":"2024-05-07T11:13:51.341260+0000","last_clean":"2024-05-07T11:13:51.341260+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:13:51.341260+0000","last_undegraded":"2024-05-07T11:13:51.341260+0000","last_fullsized":"2024-05-07T11:13:51.341260+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.340814+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:13:51.340814+0000","last_peered":"2024-05-07T11:13:51.340814+0000","last_clean":"2024-05-07T11:13:51.340814+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:13:51.340814+0000","last_undegraded":"2024-05-07T11:13:51.340814+0000","last_fullsized":"2024-05-07T11:13:51.340814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341077+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:13:51.341077+0000","last_peered":"2024-05-07T11:13:51.341077+0000","last_clean":"2024-05-07T11:13:51.341077+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:13:51.341077+0000","last_undegraded":"2024-05-07T11:13:51.341077+0000","last_fullsized":"2024-05-07T11:13:51.341077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.342075+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:13:51.342075+0000","last_peered":"2024-05-07T11:13:51.342075+0000","last_clean":"2024-05-07T11:13:51.342075+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:13:51.342075+0000","last_undegraded":"2024-05-07T11:13:51.342075+0000","last_fullsized":"2024-05-07T11:13:51.342075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341665+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:13:51.341665+0000","last_peered":"2024-05-07T11:13:51.341665+0000","last_clean":"2024-05-07T11:13:51.341665+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:13:51.341665+0000","last_undegraded":"2024-05-07T11:13:51.341665+0000","last_fullsized":"2024-05-07T11:13:51.341665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341920+0000","last_change":"2024-05-07T11:13:25.249860+0000","last_active":"2024-05-07T11:13:51.341920+0000","last_peered":"2024-05-07T11:13:51.341920+0000","last_clean":"2024-05-07T11:13:51.341920+0000","last_became_active":"2024-05-07T11:13:25.249519+0000","last_became_peered":"2024-05-07T11:13:25.249519+0000","last_unstale":"2024-05-07T11:13:51.341920+0000","last_undegraded":"2024-05-07T11:13:51.341920+0000","last_fullsized":"2024-05-07T11:13:51.341920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341814+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:13:51.341814+0000","last_peered":"2024-05-07T11:13:51.341814+0000","last_clean":"2024-05-07T11:13:51.341814+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:13:51.341814+0000","last_undegraded":"2024-05-07T11:13:51.341814+0000","last_fullsized":"2024-05-07T11:13:51.341814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341344+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:13:51.341344+0000","last_peered":"2024-05-07T11:13:51.341344+0000","last_clean":"2024-05-07T11:13:51.341344+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:13:51.341344+0000","last_undegraded":"2024-05-07T11:13:51.341344+0000","last_fullsized":"2024-05-07T11:13:51.341344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341391+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:13:51.341391+0000","last_peered":"2024-05-07T11:13:51.341391+0000","last_clean":"2024-05-07T11:13:51.341391+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:13:51.341391+0000","last_undegraded":"2024-05-07T11:13:51.341391+0000","last_fullsized":"2024-05-07T11:13:51.341391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.340926+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:13:51.340926+0000","last_peered":"2024-05-07T11:13:51.340926+0000","last_clean":"2024-05-07T11:13:51.340926+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:13:51.340926+0000","last_undegraded":"2024-05-07T11:13:51.340926+0000","last_fullsized":"2024-05-07T11:13:51.340926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334533+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:13:48.334533+0000","last_peered":"2024-05-07T11:13:48.334533+0000","last_clean":"2024-05-07T11:13:48.334533+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:13:48.334533+0000","last_undegraded":"2024-05-07T11:13:48.334533+0000","last_fullsized":"2024-05-07T11:13:48.334533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341703+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:13:51.341703+0000","last_peered":"2024-05-07T11:13:51.341703+0000","last_clean":"2024-05-07T11:13:51.341703+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:13:51.341703+0000","last_undegraded":"2024-05-07T11:13:51.341703+0000","last_fullsized":"2024-05-07T11:13:51.341703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335094+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:13:48.335094+0000","last_peered":"2024-05-07T11:13:48.335094+0000","last_clean":"2024-05-07T11:13:48.335094+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:13:48.335094+0000","last_undegraded":"2024-05-07T11:13:48.335094+0000","last_fullsized":"2024-05-07T11:13:48.335094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341731+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:13:51.341731+0000","last_peered":"2024-05-07T11:13:51.341731+0000","last_clean":"2024-05-07T11:13:51.341731+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:13:51.341731+0000","last_undegraded":"2024-05-07T11:13:51.341731+0000","last_fullsized":"2024-05-07T11:13:51.341731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341105+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:13:51.341105+0000","last_peered":"2024-05-07T11:13:51.341105+0000","last_clean":"2024-05-07T11:13:51.341105+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:13:51.341105+0000","last_undegraded":"2024-05-07T11:13:51.341105+0000","last_fullsized":"2024-05-07T11:13:51.341105+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341794+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:13:51.341794+0000","last_peered":"2024-05-07T11:13:51.341794+0000","last_clean":"2024-05-07T11:13:51.341794+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:13:51.341794+0000","last_undegraded":"2024-05-07T11:13:51.341794+0000","last_fullsized":"2024-05-07T11:13:51.341794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341335+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:13:51.341335+0000","last_peered":"2024-05-07T11:13:51.341335+0000","last_clean":"2024-05-07T11:13:51.341335+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:13:51.341335+0000","last_undegraded":"2024-05-07T11:13:51.341335+0000","last_fullsized":"2024-05-07T11:13:51.341335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341498+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:13:51.341498+0000","last_peered":"2024-05-07T11:13:51.341498+0000","last_clean":"2024-05-07T11:13:51.341498+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:13:51.341498+0000","last_undegraded":"2024-05-07T11:13:51.341498+0000","last_fullsized":"2024-05-07T11:13:51.341498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334641+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:13:48.334641+0000","last_peered":"2024-05-07T11:13:48.334641+0000","last_clean":"2024-05-07T11:13:48.334641+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:13:48.334641+0000","last_undegraded":"2024-05-07T11:13:48.334641+0000","last_fullsized":"2024-05-07T11:13:48.334641+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335477+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:13:48.335477+0000","last_peered":"2024-05-07T11:13:48.335477+0000","last_clean":"2024-05-07T11:13:48.335477+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:13:48.335477+0000","last_undegraded":"2024-05-07T11:13:48.335477+0000","last_fullsized":"2024-05-07T11:13:48.335477+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341098+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:13:51.341098+0000","last_peered":"2024-05-07T11:13:51.341098+0000","last_clean":"2024-05-07T11:13:51.341098+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:13:51.341098+0000","last_undegraded":"2024-05-07T11:13:51.341098+0000","last_fullsized":"2024-05-07T11:13:51.341098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341986+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:13:51.341986+0000","last_peered":"2024-05-07T11:13:51.341986+0000","last_clean":"2024-05-07T11:13:51.341986+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:13:51.341986+0000","last_undegraded":"2024-05-07T11:13:51.341986+0000","last_fullsized":"2024-05-07T11:13:51.341986+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341172+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:13:51.341172+0000","last_peered":"2024-05-07T11:13:51.341172+0000","last_clean":"2024-05-07T11:13:51.341172+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:13:51.341172+0000","last_undegraded":"2024-05-07T11:13:51.341172+0000","last_fullsized":"2024-05-07T11:13:51.341172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341629+0000","last_change":"2024-05-07T11:13:25.249690+0000","last_active":"2024-05-07T11:13:51.341629+0000","last_peered":"2024-05-07T11:13:51.341629+0000","last_clean":"2024-05-07T11:13:51.341629+0000","last_became_active":"2024-05-07T11:13:25.249304+0000","last_became_peered":"2024-05-07T11:13:25.249304+0000","last_unstale":"2024-05-07T11:13:51.341629+0000","last_undegraded":"2024-05-07T11:13:51.341629+0000","last_fullsized":"2024-05-07T11:13:51.341629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:30.051793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334825+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:13:48.334825+0000","last_peered":"2024-05-07T11:13:48.334825+0000","last_clean":"2024-05-07T11:13:48.334825+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:13:48.334825+0000","last_undegraded":"2024-05-07T11:13:48.334825+0000","last_fullsized":"2024-05-07T11:13:48.334825+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341475+0000","last_change":"2024-05-07T11:13:25.249164+0000","last_active":"2024-05-07T11:13:51.341475+0000","last_peered":"2024-05-07T11:13:51.341475+0000","last_clean":"2024-05-07T11:13:51.341475+0000","last_became_active":"2024-05-07T11:13:25.248783+0000","last_became_peered":"2024-05-07T11:13:25.248783+0000","last_unstale":"2024-05-07T11:13:51.341475+0000","last_undegraded":"2024-05-07T11:13:51.341475+0000","last_fullsized":"2024-05-07T11:13:51.341475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:00.987017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341251+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:13:51.341251+0000","last_peered":"2024-05-07T11:13:51.341251+0000","last_clean":"2024-05-07T11:13:51.341251+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:13:51.341251+0000","last_undegraded":"2024-05-07T11:13:51.341251+0000","last_fullsized":"2024-05-07T11:13:51.341251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341441+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:13:51.341441+0000","last_peered":"2024-05-07T11:13:51.341441+0000","last_clean":"2024-05-07T11:13:51.341441+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:13:51.341441+0000","last_undegraded":"2024-05-07T11:13:51.341441+0000","last_fullsized":"2024-05-07T11:13:51.341441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335081+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:13:48.335081+0000","last_peered":"2024-05-07T11:13:48.335081+0000","last_clean":"2024-05-07T11:13:48.335081+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:13:48.335081+0000","last_undegraded":"2024-05-07T11:13:48.335081+0000","last_fullsized":"2024-05-07T11:13:48.335081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334963+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:13:48.334963+0000","last_peered":"2024-05-07T11:13:48.334963+0000","last_clean":"2024-05-07T11:13:48.334963+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:13:48.334963+0000","last_undegraded":"2024-05-07T11:13:48.334963+0000","last_fullsized":"2024-05-07T11:13:48.334963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335178+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:13:48.335178+0000","last_peered":"2024-05-07T11:13:48.335178+0000","last_clean":"2024-05-07T11:13:48.335178+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:13:48.335178+0000","last_undegraded":"2024-05-07T11:13:48.335178+0000","last_fullsized":"2024-05-07T11:13:48.335178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341297+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:13:51.341297+0000","last_peered":"2024-05-07T11:13:51.341297+0000","last_clean":"2024-05-07T11:13:51.341297+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:13:51.341297+0000","last_undegraded":"2024-05-07T11:13:51.341297+0000","last_fullsized":"2024-05-07T11:13:51.341297+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335167+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:13:48.335167+0000","last_peered":"2024-05-07T11:13:48.335167+0000","last_clean":"2024-05-07T11:13:48.335167+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:13:48.335167+0000","last_undegraded":"2024-05-07T11:13:48.335167+0000","last_fullsized":"2024-05-07T11:13:48.335167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341140+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:13:51.341140+0000","last_peered":"2024-05-07T11:13:51.341140+0000","last_clean":"2024-05-07T11:13:51.341140+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:13:51.341140+0000","last_undegraded":"2024-05-07T11:13:51.341140+0000","last_fullsized":"2024-05-07T11:13:51.341140+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341589+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:13:51.341589+0000","last_peered":"2024-05-07T11:13:51.341589+0000","last_clean":"2024-05-07T11:13:51.341589+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:13:51.341589+0000","last_undegraded":"2024-05-07T11:13:51.341589+0000","last_fullsized":"2024-05-07T11:13:51.341589+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":258,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334811+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:13:48.334811+0000","last_peered":"2024-05-07T11:13:48.334811+0000","last_clean":"2024-05-07T11:13:48.334811+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:13:48.334811+0000","last_undegraded":"2024-05-07T11:13:48.334811+0000","last_fullsized":"2024-05-07T11:13:48.334811+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335209+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:13:48.335209+0000","last_peered":"2024-05-07T11:13:48.335209+0000","last_clean":"2024-05-07T11:13:48.335209+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:13:48.335209+0000","last_undegraded":"2024-05-07T11:13:48.335209+0000","last_fullsized":"2024-05-07T11:13:48.335209+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341173+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:13:51.341173+0000","last_peered":"2024-05-07T11:13:51.341173+0000","last_clean":"2024-05-07T11:13:51.341173+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:13:51.341173+0000","last_undegraded":"2024-05-07T11:13:51.341173+0000","last_fullsized":"2024-05-07T11:13:51.341173+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341611+0000","last_change":"2024-05-07T11:13:25.249760+0000","last_active":"2024-05-07T11:13:51.341611+0000","last_peered":"2024-05-07T11:13:51.341611+0000","last_clean":"2024-05-07T11:13:51.341611+0000","last_became_active":"2024-05-07T11:13:25.249466+0000","last_became_peered":"2024-05-07T11:13:25.249466+0000","last_unstale":"2024-05-07T11:13:51.341611+0000","last_undegraded":"2024-05-07T11:13:51.341611+0000","last_fullsized":"2024-05-07T11:13:51.341611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334819+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:13:48.334819+0000","last_peered":"2024-05-07T11:13:48.334819+0000","last_clean":"2024-05-07T11:13:48.334819+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:13:48.334819+0000","last_undegraded":"2024-05-07T11:13:48.334819+0000","last_fullsized":"2024-05-07T11:13:48.334819+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341108+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:13:51.341108+0000","last_peered":"2024-05-07T11:13:51.341108+0000","last_clean":"2024-05-07T11:13:51.341108+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:13:51.341108+0000","last_undegraded":"2024-05-07T11:13:51.341108+0000","last_fullsized":"2024-05-07T11:13:51.341108+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341806+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:13:51.341806+0000","last_peered":"2024-05-07T11:13:51.341806+0000","last_clean":"2024-05-07T11:13:51.341806+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:13:51.341806+0000","last_undegraded":"2024-05-07T11:13:51.341806+0000","last_fullsized":"2024-05-07T11:13:51.341806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341211+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:13:51.341211+0000","last_peered":"2024-05-07T11:13:51.341211+0000","last_clean":"2024-05-07T11:13:51.341211+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:13:51.341211+0000","last_undegraded":"2024-05-07T11:13:51.341211+0000","last_fullsized":"2024-05-07T11:13:51.341211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341202+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:13:51.341202+0000","last_peered":"2024-05-07T11:13:51.341202+0000","last_clean":"2024-05-07T11:13:51.341202+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:13:51.341202+0000","last_undegraded":"2024-05-07T11:13:51.341202+0000","last_fullsized":"2024-05-07T11:13:51.341202+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341624+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:13:51.341624+0000","last_peered":"2024-05-07T11:13:51.341624+0000","last_clean":"2024-05-07T11:13:51.341624+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:13:51.341624+0000","last_undegraded":"2024-05-07T11:13:51.341624+0000","last_fullsized":"2024-05-07T11:13:51.341624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334996+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:13:48.334996+0000","last_peered":"2024-05-07T11:13:48.334996+0000","last_clean":"2024-05-07T11:13:48.334996+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:13:48.334996+0000","last_undegraded":"2024-05-07T11:13:48.334996+0000","last_fullsized":"2024-05-07T11:13:48.334996+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335119+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:13:48.335119+0000","last_peered":"2024-05-07T11:13:48.335119+0000","last_clean":"2024-05-07T11:13:48.335119+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:13:48.335119+0000","last_undegraded":"2024-05-07T11:13:48.335119+0000","last_fullsized":"2024-05-07T11:13:48.335119+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341680+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:13:51.341680+0000","last_peered":"2024-05-07T11:13:51.341680+0000","last_clean":"2024-05-07T11:13:51.341680+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:13:51.341680+0000","last_undegraded":"2024-05-07T11:13:51.341680+0000","last_fullsized":"2024-05-07T11:13:51.341680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341531+0000","last_change":"2024-05-07T11:13:25.249176+0000","last_active":"2024-05-07T11:13:51.341531+0000","last_peered":"2024-05-07T11:13:51.341531+0000","last_clean":"2024-05-07T11:13:51.341531+0000","last_became_active":"2024-05-07T11:13:25.248831+0000","last_became_peered":"2024-05-07T11:13:25.248831+0000","last_unstale":"2024-05-07T11:13:51.341531+0000","last_undegraded":"2024-05-07T11:13:51.341531+0000","last_fullsized":"2024-05-07T11:13:51.341531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:48:30.756870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341826+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:13:51.341826+0000","last_peered":"2024-05-07T11:13:51.341826+0000","last_clean":"2024-05-07T11:13:51.341826+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:13:51.341826+0000","last_undegraded":"2024-05-07T11:13:51.341826+0000","last_fullsized":"2024-05-07T11:13:51.341826+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341285+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:13:51.341285+0000","last_peered":"2024-05-07T11:13:51.341285+0000","last_clean":"2024-05-07T11:13:51.341285+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:13:51.341285+0000","last_undegraded":"2024-05-07T11:13:51.341285+0000","last_fullsized":"2024-05-07T11:13:51.341285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341821+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:13:51.341821+0000","last_peered":"2024-05-07T11:13:51.341821+0000","last_clean":"2024-05-07T11:13:51.341821+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:13:51.341821+0000","last_undegraded":"2024-05-07T11:13:51.341821+0000","last_fullsized":"2024-05-07T11:13:51.341821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341981+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:13:51.341981+0000","last_peered":"2024-05-07T11:13:51.341981+0000","last_clean":"2024-05-07T11:13:51.341981+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:13:51.341981+0000","last_undegraded":"2024-05-07T11:13:51.341981+0000","last_fullsized":"2024-05-07T11:13:51.341981+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341420+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:13:51.341420+0000","last_peered":"2024-05-07T11:13:51.341420+0000","last_clean":"2024-05-07T11:13:51.341420+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:13:51.341420+0000","last_undegraded":"2024-05-07T11:13:51.341420+0000","last_fullsized":"2024-05-07T11:13:51.341420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341897+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:13:51.341897+0000","last_peered":"2024-05-07T11:13:51.341897+0000","last_clean":"2024-05-07T11:13:51.341897+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:13:51.341897+0000","last_undegraded":"2024-05-07T11:13:51.341897+0000","last_fullsized":"2024-05-07T11:13:51.341897+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341916+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:13:51.341916+0000","last_peered":"2024-05-07T11:13:51.341916+0000","last_clean":"2024-05-07T11:13:51.341916+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:13:51.341916+0000","last_undegraded":"2024-05-07T11:13:51.341916+0000","last_fullsized":"2024-05-07T11:13:51.341916+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.340949+0000","last_change":"2024-05-07T11:13:25.248884+0000","last_active":"2024-05-07T11:13:51.340949+0000","last_peered":"2024-05-07T11:13:51.340949+0000","last_clean":"2024-05-07T11:13:51.340949+0000","last_became_active":"2024-05-07T11:13:25.248619+0000","last_became_peered":"2024-05-07T11:13:25.248619+0000","last_unstale":"2024-05-07T11:13:51.340949+0000","last_undegraded":"2024-05-07T11:13:51.340949+0000","last_fullsized":"2024-05-07T11:13:51.340949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341914+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:13:51.341914+0000","last_peered":"2024-05-07T11:13:51.341914+0000","last_clean":"2024-05-07T11:13:51.341914+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:13:51.341914+0000","last_undegraded":"2024-05-07T11:13:51.341914+0000","last_fullsized":"2024-05-07T11:13:51.341914+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335505+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:13:48.335505+0000","last_peered":"2024-05-07T11:13:48.335505+0000","last_clean":"2024-05-07T11:13:48.335505+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:13:48.335505+0000","last_undegraded":"2024-05-07T11:13:48.335505+0000","last_fullsized":"2024-05-07T11:13:48.335505+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341178+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:13:51.341178+0000","last_peered":"2024-05-07T11:13:51.341178+0000","last_clean":"2024-05-07T11:13:51.341178+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:13:51.341178+0000","last_undegraded":"2024-05-07T11:13:51.341178+0000","last_fullsized":"2024-05-07T11:13:51.341178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334847+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:13:48.334847+0000","last_peered":"2024-05-07T11:13:48.334847+0000","last_clean":"2024-05-07T11:13:48.334847+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:13:48.334847+0000","last_undegraded":"2024-05-07T11:13:48.334847+0000","last_fullsized":"2024-05-07T11:13:48.334847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'10","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335206+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:13:48.335206+0000","last_peered":"2024-05-07T11:13:48.335206+0000","last_clean":"2024-05-07T11:13:48.335206+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:13:48.335206+0000","last_undegraded":"2024-05-07T11:13:48.335206+0000","last_fullsized":"2024-05-07T11:13:48.335206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341001+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:13:51.341001+0000","last_peered":"2024-05-07T11:13:51.341001+0000","last_clean":"2024-05-07T11:13:51.341001+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:13:51.341001+0000","last_undegraded":"2024-05-07T11:13:51.341001+0000","last_fullsized":"2024-05-07T11:13:51.341001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341902+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:13:51.341902+0000","last_peered":"2024-05-07T11:13:51.341902+0000","last_clean":"2024-05-07T11:13:51.341902+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:13:51.341902+0000","last_undegraded":"2024-05-07T11:13:51.341902+0000","last_fullsized":"2024-05-07T11:13:51.341902+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341622+0000","last_change":"2024-05-07T11:13:25.249281+0000","last_active":"2024-05-07T11:13:51.341622+0000","last_peered":"2024-05-07T11:13:51.341622+0000","last_clean":"2024-05-07T11:13:51.341622+0000","last_became_active":"2024-05-07T11:13:25.249068+0000","last_became_peered":"2024-05-07T11:13:25.249068+0000","last_unstale":"2024-05-07T11:13:51.341622+0000","last_undegraded":"2024-05-07T11:13:51.341622+0000","last_fullsized":"2024-05-07T11:13:51.341622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:30:57.180798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.340962+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:13:51.340962+0000","last_peered":"2024-05-07T11:13:51.340962+0000","last_clean":"2024-05-07T11:13:51.340962+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:13:51.340962+0000","last_undegraded":"2024-05-07T11:13:51.340962+0000","last_fullsized":"2024-05-07T11:13:51.340962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341792+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:13:51.341792+0000","last_peered":"2024-05-07T11:13:51.341792+0000","last_clean":"2024-05-07T11:13:51.341792+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:13:51.341792+0000","last_undegraded":"2024-05-07T11:13:51.341792+0000","last_fullsized":"2024-05-07T11:13:51.341792+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.340903+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:13:51.340903+0000","last_peered":"2024-05-07T11:13:51.340903+0000","last_clean":"2024-05-07T11:13:51.340903+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:13:51.340903+0000","last_undegraded":"2024-05-07T11:13:51.340903+0000","last_fullsized":"2024-05-07T11:13:51.340903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.342094+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:13:51.342094+0000","last_peered":"2024-05-07T11:13:51.342094+0000","last_clean":"2024-05-07T11:13:51.342094+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:13:51.342094+0000","last_undegraded":"2024-05-07T11:13:51.342094+0000","last_fullsized":"2024-05-07T11:13:51.342094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.340997+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:13:51.340997+0000","last_peered":"2024-05-07T11:13:51.340997+0000","last_clean":"2024-05-07T11:13:51.340997+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:13:51.340997+0000","last_undegraded":"2024-05-07T11:13:51.340997+0000","last_fullsized":"2024-05-07T11:13:51.340997+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341508+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:13:51.341508+0000","last_peered":"2024-05-07T11:13:51.341508+0000","last_clean":"2024-05-07T11:13:51.341508+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:13:51.341508+0000","last_undegraded":"2024-05-07T11:13:51.341508+0000","last_fullsized":"2024-05-07T11:13:51.341508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341069+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:13:51.341069+0000","last_peered":"2024-05-07T11:13:51.341069+0000","last_clean":"2024-05-07T11:13:51.341069+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:13:51.341069+0000","last_undegraded":"2024-05-07T11:13:51.341069+0000","last_fullsized":"2024-05-07T11:13:51.341069+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341710+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:13:51.341710+0000","last_peered":"2024-05-07T11:13:51.341710+0000","last_clean":"2024-05-07T11:13:51.341710+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:13:51.341710+0000","last_undegraded":"2024-05-07T11:13:51.341710+0000","last_fullsized":"2024-05-07T11:13:51.341710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":61,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341432+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:13:51.341432+0000","last_peered":"2024-05-07T11:13:51.341432+0000","last_clean":"2024-05-07T11:13:51.341432+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:13:51.341432+0000","last_undegraded":"2024-05-07T11:13:51.341432+0000","last_fullsized":"2024-05-07T11:13:51.341432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341597+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:13:51.341597+0000","last_peered":"2024-05-07T11:13:51.341597+0000","last_clean":"2024-05-07T11:13:51.341597+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:13:51.341597+0000","last_undegraded":"2024-05-07T11:13:51.341597+0000","last_fullsized":"2024-05-07T11:13:51.341597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":61,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341550+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:13:51.341550+0000","last_peered":"2024-05-07T11:13:51.341550+0000","last_clean":"2024-05-07T11:13:51.341550+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:13:51.341550+0000","last_undegraded":"2024-05-07T11:13:51.341550+0000","last_fullsized":"2024-05-07T11:13:51.341550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334734+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:13:48.334734+0000","last_peered":"2024-05-07T11:13:48.334734+0000","last_clean":"2024-05-07T11:13:48.334734+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:13:48.334734+0000","last_undegraded":"2024-05-07T11:13:48.334734+0000","last_fullsized":"2024-05-07T11:13:48.334734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.335254+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:13:48.335254+0000","last_peered":"2024-05-07T11:13:48.335254+0000","last_clean":"2024-05-07T11:13:48.335254+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:13:48.335254+0000","last_undegraded":"2024-05-07T11:13:48.335254+0000","last_fullsized":"2024-05-07T11:13:48.335254+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334849+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:13:48.334849+0000","last_peered":"2024-05-07T11:13:48.334849+0000","last_clean":"2024-05-07T11:13:48.334849+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:13:48.334849+0000","last_undegraded":"2024-05-07T11:13:48.334849+0000","last_fullsized":"2024-05-07T11:13:48.334849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341806+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:13:51.341806+0000","last_peered":"2024-05-07T11:13:51.341806+0000","last_clean":"2024-05-07T11:13:51.341806+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:13:51.341806+0000","last_undegraded":"2024-05-07T11:13:51.341806+0000","last_fullsized":"2024-05-07T11:13:51.341806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341408+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:13:51.341408+0000","last_peered":"2024-05-07T11:13:51.341408+0000","last_clean":"2024-05-07T11:13:51.341408+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:13:51.341408+0000","last_undegraded":"2024-05-07T11:13:51.341408+0000","last_fullsized":"2024-05-07T11:13:51.341408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":61,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341793+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:13:51.341793+0000","last_peered":"2024-05-07T11:13:51.341793+0000","last_clean":"2024-05-07T11:13:51.341793+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:13:51.341793+0000","last_undegraded":"2024-05-07T11:13:51.341793+0000","last_fullsized":"2024-05-07T11:13:51.341793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-07T11:13:48.334647+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:13:48.334647+0000","last_peered":"2024-05-07T11:13:48.334647+0000","last_clean":"2024-05-07T11:13:48.334647+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:13:48.334647+0000","last_undegraded":"2024-05-07T11:13:48.334647+0000","last_fullsized":"2024-05-07T11:13:48.334647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":64,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-07T11:13:51.341678+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:13:51.341678+0000","last_peered":"2024-05-07T11:13:51.341678+0000","last_clean":"2024-05-07T11:13:51.341678+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:13:51.341678+0000","last_undegraded":"2024-05-07T11:13:51.341678+0000","last_fullsized":"2024-05-07T11:13:51.341678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":405504,"data_stored":737360,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":405504,"data_stored":740997,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":140257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:13:54.239 INFO:tasks.thrashosds.thrasher:Setting 4.31 to [2, 1] 2024-05-07T11:13:54.239 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.31', '2', '1'] 2024-05-07T11:13:54.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.31 2 1 2024-05-07T11:13:54.248 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:54.248 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:54.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:54.248 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:54.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.248 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:54.248 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:54.248 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.204016233999994, 2024-05-07T11:13:54.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:54.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:54.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:54.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.203951513999996, 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.203854574000005, 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.260 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:54.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:54.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:54.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.203789236000006, 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.271 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.203762343999998, 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:54.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:54.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.203734765999997, 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.203699377000007, 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.203673769999995, 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.203644339999997, 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.201258366000005, 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.196999826999999, 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.196351824000004, 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.195706505000004, 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.195432941000007, 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.194672937000007, 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.194088317999999, 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.190331509000004, 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.205315475000006, 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 45.20282503, 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.334 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:54.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:54.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:54.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.202089385000001, 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:54.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:54.347 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:54.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-05-07T11:13:54.350 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:54.349+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:54.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:54.450 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:54.449+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:54.466 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:54.466 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:54.466 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:54.467 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:54.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:54.534 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:54.534 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:54.551 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:54.550+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:54.559 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:54.559 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:54.578 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:54.578 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:54.581 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:54.581 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:54.590 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:54.652 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:54.651+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:54.696 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:54.696 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:54.705 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:54.753 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:54.752+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:54.816 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:54.817 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:54.825 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:54.854 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:54.854+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:54.955 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:54.954+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:54.970 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:54.970 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:54.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:55.056 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:55.055+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:55.084 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:55.085 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:55.094 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:55.157 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:55.157+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:55.202 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:55.202 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:55.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:55.257 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:55.257+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:55.315 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:55.315 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:55.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:55.347 INFO:teuthology.orchestra.run.smithi062.stderr:set 4.31 pg_upmap mapping to [2,1] 2024-05-07T11:13:55.358 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:55.358+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:55.430 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:55.430 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:55.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:55.483 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:55.483+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:55.547 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:55.548 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:55.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:55.598 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:55.597+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:55.661 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:55.661+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:55.702 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:55.703 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:55.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:55.762 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:55.762+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:55.857 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:55.857 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:55.863 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:55.863+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:55.866 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:55.965 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:55.964+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:55.977 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:55.977 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:55.986 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:56.066 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:56.065+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:56.132 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:56.132 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:56.140 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:56.167 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:56.167+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:56.247 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:56.247 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:56.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:56.268 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:56.267+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:56.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T11:13:56.368 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:56.368 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:56.369 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:56.368+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:56.377 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:56.469 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:56.469+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:56.481 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:56.481 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:56.490 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:56.570 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:56.569+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:56.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:13:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:56.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:56.677 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:56.671+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:56.718 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:56.718 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:56.728 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:56.772 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:56.772+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:56.790 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:56.790 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:56.824 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:56.824 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:56.833 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:56.833 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:56.833 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:56.833 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:56.834 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:56.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:56.857 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:56.873 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:56.872+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:56.950 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:56.950 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:56.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:56.950 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:56.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.950 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:56.950 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:56.950 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.183325472000007, 2024-05-07T11:13:56.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:56.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.954 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.516770316000006, 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:56.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:56.958 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.287163223999997, 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:56.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.286488050000003, 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:56.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:56.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.285846229000001, 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.967 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:56.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:56.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.285377820999997, 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:56.971 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:56.975 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.282672300000002, 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:56.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:56.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.979 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.905355919000002, 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:56.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:56.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:56.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:56.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:56.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.905299143999997, 2024-05-07T11:13:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.905270673000004, 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.991 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:56.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:56.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:56.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.996 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.905231878999999, 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:56.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:56.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:57.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.905188555999999, 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:57.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:57.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:57.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.905166004999998, 2024-05-07T11:13:57.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.905141944999997, 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.014 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:57.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:57.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:57.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:57.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.905122985000006, 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.027 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.905096313000001, 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:57.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:57.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.900592052999997, 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.898865525999994, 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:57.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.898713192000002, 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.040 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 72.898660219999996, 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:57.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:57.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:57.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:57.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:57.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:57.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:57.048 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.048 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.048 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.048 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:57.048 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:57.048 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:57.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:57.050 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:57.049+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:57.150 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:57.150+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:57.160 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:57.160 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:57.160 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:57.161 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:57.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:57.251 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:57.250+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:57.314 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:57.314 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:57.314 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:57.314 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:57.314 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:57.322 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:57.352 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:57.351+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-05-07T11:13:57.430 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.481291892000002, 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.157066005000004, 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.996590605999998, 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.996504238, 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.767356805000006, 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.767309339999997, 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.461 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:57.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:57.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:57.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:57.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.385396951999994, 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:57.466 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:57.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:57.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:57.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:57.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:57.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:57.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:57.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:57.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:57.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:57.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:57.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:57.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:57.473 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.383201868, 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:57.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:57.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:57.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:57.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:57.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:57.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:57.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:57.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:57.480 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.382973648000004, 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:57.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:57.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:57.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.487 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.382794517999997, 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.382734643999996, 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:57.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:57.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:57.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:57.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:57.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:57.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.382686472000003, 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:57.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.504 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.382658489999997, 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:57.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.382625480000002, 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:57.510 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:57.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:57.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:57.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.382531675999999, 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:57.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:57.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.382388234000004, 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:57.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:57.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:57.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.382203329000006, 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.528 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:57.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:57.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:57.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:57.533 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.382044258999997, 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:57.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:57.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.381600849999998, 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:57.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:57.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:57.544 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 73.381575585999997, 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:57.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:57.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:57.548 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:57.550 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:57.549+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:57.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:57.651 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:57.650+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:57.667 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:57.667 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:13:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:57.676 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:57.752 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:57.751+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:57.783 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:13:57.783 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:13:57.783 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:13:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:57.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:57.852 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:57.852+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:57.938 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:13:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:13:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:13:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.894263817999999, 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:13:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:13:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:13:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:13:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.894199098000001, 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:13:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.894102157999995, 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.894036819999997, 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:13:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:13:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:13:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.894009928000003, 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:13:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:13:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.893982350000002, 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.893946960999997, 2024-05-07T11:13:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:13:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.893921354, 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:13:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:13:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.893891924000002, 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.891505949999996, 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:57.990 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.887247411000004, 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.994 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.886599407999995, 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:13:57.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:13:57.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:13:57.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.885954088999995, 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:57.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.885680524999998, 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:58.003 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:58.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.884920520999998, 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:13:58.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:13:58.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:58.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.884335902000004, 2024-05-07T11:13:58.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:13:58.014 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 73.880579092999994, 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:58.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:58.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.018 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 71.895563058999997, 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:58.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:58.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:58.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 48.893072613999998, 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:58.024 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:58.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:13:58.029 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 43.892336968999999, 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:13:58.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:13:58.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:58.035 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.035 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:13:58.035 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:13:58.035 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:13:58.036 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:58.037 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:58.036+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:58.137 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:58.136+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:58.154 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:58.154 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:58.154 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:13:58.154 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:58.163 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:58.238 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:58.238+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:58.269 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:58.269 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:13:58.269 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:13:58.269 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:13:58.269 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:58.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:58.339 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:58.339+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:58.385 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:13:58.385 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:13:58.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:13:58.385 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:13:58.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.385 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:13:58.385 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:58.385 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.618066236999994, 2024-05-07T11:13:58.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:13:58.385 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:13:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:13:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.951511081000007, 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:13:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.721903988999998, 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:13:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.721228815000003, 2024-05-07T11:13:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:13:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:13:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:13:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:13:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:13:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.720586994000001, 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:13:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.720118585999998, 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.717413065000002, 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:13:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:13:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:13:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.340096684000002, 2024-05-07T11:13:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:13:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:13:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:13:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:13:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:13:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:13:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.340039908999998, 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:13:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.340011438000005, 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:13:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:13:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.339972643999999, 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:13:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:13:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:13:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:13:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:13:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:13:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.339929321, 2024-05-07T11:13:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.339906769999999, 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:13:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:13:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:13:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:13:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:13:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.339882709999998, 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:13:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:13:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:13:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.339863750000006, 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.339837078000002, 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.335332817999998, 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.333606290999995, 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:13:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:13:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:13:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.333453957000003, 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.333400984999997, 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.484 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:13:58.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:13:58.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:13:58.488 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:13:58.489 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:13:58.490 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:58.491 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:58.489+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:58.590 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:58.590+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:58.608 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:58.608 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:58.608 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:13:58.608 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:58.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:58.701 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:58.701+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:58.764 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:58.764 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:13:58.765 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:13:58.765 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:13:58.765 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:58.773 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:13:58.792 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:58.792+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:58.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:13:58.892 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:58.892+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:58.921 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:13:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:13:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:13:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 79.972844358000003, 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:13:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:13:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:13:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 79.648618471000006, 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:13:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:13:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:58.933 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 79.488143072, 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:58.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 79.488056704000002, 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.939 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:13:58.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:13:58.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:13:58.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 79.258909270999993, 2024-05-07T11:13:58.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:13:58.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 79.258861805999999, 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.951 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:13:58.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:13:58.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:13:58.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:13:58.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:13:58.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:13:58.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:13:58.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.957 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.876949417999995, 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:13:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:13:58.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:13:58.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.874754334000002, 2024-05-07T11:13:58.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:13:58.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:13:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:13:58.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:13:58.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:58.970 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.874526114000005, 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:13:58.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:13:58.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:13:58.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:13:58.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:13:58.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:13:58.977 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.874346983999999, 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:13:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:13:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:13:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:13:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:13:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.874287109999997, 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.874238938000005, 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.874210955999999, 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:13:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:13:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:13:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:13:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.874177946000003, 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:13:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.874084142000001, 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.873940700000006, 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:13:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:13:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:13:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:13:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.873755794999994, 2024-05-07T11:13:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:13:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:13:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:13:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.873596724999999, 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:13:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:13:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:13:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.873153316, 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:13:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:13:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 74.873128051999998, 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:13:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:13:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:13:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:13:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:13:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:13:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:13:59.037 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:13:59.038 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:13:59.039 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:13:59.039 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:13:59.039 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:13:59.040 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:13:59.040 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:59.038+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:59.045 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:13:59.045 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:13:59.140 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:59.139+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:59.151 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:59.151 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:59.160 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:13:59.240 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:59.240+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:59.265 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:59.266 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:59.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:13:59.341 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:13:59.341+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:13:59.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:13:59.378 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:59.378 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:59.386 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:13:59.442 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:13:59.442+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:13:59.497 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:59.497 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:59.506 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:13:59.544 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:59.543+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:59.611 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:59.611 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:59.620 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:13:59.644 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:59.644+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:59.725 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:59.725 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:59.735 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:13:59.780 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:59.780+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:59.846 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:13:59.846 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:13:59.846 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:59.846+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:13:59.855 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:13:59.947 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:13:59.947+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:00.000 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:00.000 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:00.010 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:00.048 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:00.047+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:00.149 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:00.148+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:00.155 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:00.155 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:00.165 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:00.249 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:00.249+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:00.274 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:00.275 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:00.286 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:00.350 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:00.350+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:00.363 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:14:00.363 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:14:00.363 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-05-07T11:14:00.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-07T11:14:00.376 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:14:00.392 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:00.392 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:00.401 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:00.451 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:00.451+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:00.547 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:00.547 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:00.552 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:00.552+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:00.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:00.653 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:00.653+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:00.673 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:00.673 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:00.682 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:14:00.682 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:14:00.682 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 42, 2024-05-07T11:14:00.682 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "712a8431-2ac1-4386-a81f-c899bab82549", 2024-05-07T11:14:00.682 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-05-07T11:12:28.567931+0000", 2024-05-07T11:14:00.682 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-05-07T11:14:00.364146+0000", 2024-05-07T11:14:00.682 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-05-07T11:12:36.689723+0000", 2024-05-07T11:14:00.682 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-05-07T11:12:29.411691+0000", 2024-05-07T11:14:00.682 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-07T11:14:00.682 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5804032, 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "nodeep-scrub", 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-07T11:14:00.683 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 4, 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "luminous", 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:36.979175+0000", 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:14:00.684 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-05-07T11:14:00.685 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:14:00.686 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:14:00.687 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:14:00.688 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:14:00.689 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.9900000095367432, 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.9900000095367432, 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 2, 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 2, 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:37.110970+0000", 2024-05-07T11:14:00.690 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:14:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:14:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:14:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:14:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:14:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:14:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:14:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:14:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:14:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:14:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:14:00.692 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:14:00.692 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-05-07T11:14:00.692 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-05-07T11:14:00.693 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-05-07T11:14:00.693 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-05-07T11:14:00.693 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-05-07T11:14:00.693 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:14:00.693 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:14:00.693 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:14:00.693 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:14:00.693 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:14:00.693 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:14:00.694 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:14:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.5, 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.5, 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:14:00.697 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:41.627365+0000", 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:14:00.699 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "14", 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:14:00.700 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:14:00.701 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-05-07T11:14:00.702 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.4099999666213989, 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.4099999666213989, 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.4099999666213989, 2024-05-07T11:14:00.703 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.4099999666213989, 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:42.384664+0000", 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:14:00.704 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:14:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:14:00.706 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:14:00.707 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:14:00.708 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.2200000286102295, 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.2200000286102295, 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.2200000286102295, 2024-05-07T11:14:00.709 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.2200000286102295, 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cd7246e2-0069-4df7-a669-4abe038a28ad", 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:14:00.710 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 24, 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6800", 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.711 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6801", 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6802", 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.712 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6803", 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6806", 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.713 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6807", 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6804", 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6805", 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.88:6801/1378788154", 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.88:6803/1378788154", 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.88:6807/1378788154", 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.88:6805/1378788154", 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:14:00.715 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "7df5bb74-60c0-4a46-a3d1-494f777a4f88", 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 24, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:14:00.716 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6800", 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6801", 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6802", 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6803", 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6806", 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6807", 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6804", 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6805", 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.149:6801/3051775179", 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.149:6803/3051775179", 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.149:6807/3051775179", 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.149:6805/3051775179", 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "ebed6b16-fba7-4b8a-a78e-1f84a500c31f", 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:14:00.721 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 0.7828826904296875, 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 17, 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.722 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6800", 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6801", 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6802", 2024-05-07T11:14:00.723 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6803", 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6806", 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:00.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6807", 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6804", 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6805", 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.175:6801/2659225388", 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.175:6803/2659225388", 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.175:6807/2659225388", 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.175:6805/2659225388", 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:14:00.726 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.430581+0000", 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.727 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.433407+0000", 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:14:00.728 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.440186+0000", 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [ 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.0", 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: 2, 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: 0 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-05-07T11:14:00.729 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:00.730 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:00.731 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:14:00.733 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:00.734 INFO:tasks.thrashosds.thrasher:j is {'epoch': 42, 'fsid': '712a8431-2ac1-4386-a81f-c899bab82549', 'created': '2024-05-07T11:12:28.567931+0000', 'modified': '2024-05-07T11:14:00.364146+0000', 'last_up_change': '2024-05-07T11:12:36.689723+0000', 'last_in_change': '2024-05-07T11:12:29.411691+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-07T11:12:41.627365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-05-07T11:12:42.384664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}], 'osds': [{'osd': 0, 'uuid': 'cd7246e2-0069-4df7-a669-4abe038a28ad', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6800', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6801', 'nonce': 1378788154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6802', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6803', 'nonce': 1378788154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6806', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6807', 'nonce': 1378788154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6804', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6805', 'nonce': 1378788154}]}, 'public_addr': '172.21.15.88:6801/1378788154', 'cluster_addr': '172.21.15.88:6803/1378788154', 'heartbeat_back_addr': '172.21.15.88:6807/1378788154', 'heartbeat_front_addr': '172.21.15.88:6805/1378788154', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7df5bb74-60c0-4a46-a3d1-494f777a4f88', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 3051775179}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 3051775179}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 3051775179}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 3051775179}]}, 'public_addr': '172.21.15.149:6801/3051775179', 'cluster_addr': '172.21.15.149:6803/3051775179', 'heartbeat_back_addr': '172.21.15.149:6807/3051775179', 'heartbeat_front_addr': '172.21.15.149:6805/3051775179', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'ebed6b16-fba7-4b8a-a78e-1f84a500c31f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7828826904296875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6800', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6801', 'nonce': 2659225388}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6802', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6803', 'nonce': 2659225388}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6806', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6807', 'nonce': 2659225388}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6804', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6805', 'nonce': 2659225388}]}, 'public_addr': '172.21.15.175:6801/2659225388', 'cluster_addr': '172.21.15.175:6803/2659225388', 'heartbeat_back_addr': '172.21.15.175:6807/2659225388', 'heartbeat_front_addr': '172.21.15.175:6805/2659225388', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.430581+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.433407+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.440186+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.0', 'osds': [2, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-07T11:14:00.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:14:00.754 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:00.754+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:00.841 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:00.841 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:00.851 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:00.894 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:00.894+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:00.956 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:00.956 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:00.956 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:00.956+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:00.965 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:01.055 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:14:01.057 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:14:01.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:01.059 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:01.058+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:01.069 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-05-07T11:14:00.952003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90548,"kb_used_data":1160,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024972,"statfs":{"total":289910292480,"available":289817571328,"internally_reserved":0,"allocated":1187840,"data_stored":1648419,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000950"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353216+0000","last_change":"2024-05-07T11:12:44.052206+0000","last_active":"2024-05-07T11:13:55.353216+0000","last_peered":"2024-05-07T11:13:55.353216+0000","last_clean":"2024-05-07T11:13:55.353216+0000","last_became_active":"2024-05-07T11:12:44.051564+0000","last_became_peered":"2024-05-07T11:12:44.051564+0000","last_unstale":"2024-05-07T11:13:55.353216+0000","last_undegraded":"2024-05-07T11:13:55.353216+0000","last_fullsized":"2024-05-07T11:13:55.353216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352989+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:13:55.352989+0000","last_peered":"2024-05-07T11:13:55.352989+0000","last_clean":"2024-05-07T11:13:55.352989+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:13:55.352989+0000","last_undegraded":"2024-05-07T11:13:55.352989+0000","last_fullsized":"2024-05-07T11:13:55.352989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229639+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:13:56.229639+0000","last_peered":"2024-05-07T11:13:56.229639+0000","last_clean":"2024-05-07T11:13:56.229639+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:13:56.229639+0000","last_undegraded":"2024-05-07T11:13:56.229639+0000","last_fullsized":"2024-05-07T11:13:56.229639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230028+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:13:56.230028+0000","last_peered":"2024-05-07T11:13:56.230028+0000","last_clean":"2024-05-07T11:13:56.230028+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:13:56.230028+0000","last_undegraded":"2024-05-07T11:13:56.230028+0000","last_fullsized":"2024-05-07T11:13:56.230028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352771+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:13:55.352771+0000","last_peered":"2024-05-07T11:13:55.352771+0000","last_clean":"2024-05-07T11:13:55.352771+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:13:55.352771+0000","last_undegraded":"2024-05-07T11:13:55.352771+0000","last_fullsized":"2024-05-07T11:13:55.352771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352115+0000","last_change":"2024-05-07T11:13:25.248711+0000","last_active":"2024-05-07T11:13:55.352115+0000","last_peered":"2024-05-07T11:13:55.352115+0000","last_clean":"2024-05-07T11:13:55.352115+0000","last_became_active":"2024-05-07T11:13:25.248452+0000","last_became_peered":"2024-05-07T11:13:25.248452+0000","last_unstale":"2024-05-07T11:13:55.352115+0000","last_undegraded":"2024-05-07T11:13:55.352115+0000","last_fullsized":"2024-05-07T11:13:55.352115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352054+0000","last_change":"2024-05-07T11:13:25.248071+0000","last_active":"2024-05-07T11:13:55.352054+0000","last_peered":"2024-05-07T11:13:55.352054+0000","last_clean":"2024-05-07T11:13:55.352054+0000","last_became_active":"2024-05-07T11:13:25.247861+0000","last_became_peered":"2024-05-07T11:13:25.247861+0000","last_unstale":"2024-05-07T11:13:55.352054+0000","last_undegraded":"2024-05-07T11:13:55.352054+0000","last_fullsized":"2024-05-07T11:13:55.352054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.057596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229567+0000","last_change":"2024-05-07T11:12:44.055757+0000","last_active":"2024-05-07T11:13:56.229567+0000","last_peered":"2024-05-07T11:13:56.229567+0000","last_clean":"2024-05-07T11:13:56.229567+0000","last_became_active":"2024-05-07T11:12:44.054528+0000","last_became_peered":"2024-05-07T11:12:44.054528+0000","last_unstale":"2024-05-07T11:13:56.229567+0000","last_undegraded":"2024-05-07T11:13:56.229567+0000","last_fullsized":"2024-05-07T11:13:56.229567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352869+0000","last_change":"2024-05-07T11:12:44.052926+0000","last_active":"2024-05-07T11:13:55.352869+0000","last_peered":"2024-05-07T11:13:55.352869+0000","last_clean":"2024-05-07T11:13:55.352869+0000","last_became_active":"2024-05-07T11:12:44.052074+0000","last_became_peered":"2024-05-07T11:12:44.052074+0000","last_unstale":"2024-05-07T11:13:55.352869+0000","last_undegraded":"2024-05-07T11:13:55.352869+0000","last_fullsized":"2024-05-07T11:13:55.352869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353016+0000","last_change":"2024-05-07T11:12:44.053366+0000","last_active":"2024-05-07T11:13:55.353016+0000","last_peered":"2024-05-07T11:13:55.353016+0000","last_clean":"2024-05-07T11:13:55.353016+0000","last_became_active":"2024-05-07T11:12:44.051814+0000","last_became_peered":"2024-05-07T11:12:44.051814+0000","last_unstale":"2024-05-07T11:13:55.353016+0000","last_undegraded":"2024-05-07T11:13:55.353016+0000","last_fullsized":"2024-05-07T11:13:55.353016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352668+0000","last_change":"2024-05-07T11:13:25.249909+0000","last_active":"2024-05-07T11:13:55.352668+0000","last_peered":"2024-05-07T11:13:55.352668+0000","last_clean":"2024-05-07T11:13:55.352668+0000","last_became_active":"2024-05-07T11:13:25.249670+0000","last_became_peered":"2024-05-07T11:13:25.249670+0000","last_unstale":"2024-05-07T11:13:55.352668+0000","last_undegraded":"2024-05-07T11:13:55.352668+0000","last_fullsized":"2024-05-07T11:13:55.352668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:31.697406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352800+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:13:55.352800+0000","last_peered":"2024-05-07T11:13:55.352800+0000","last_clean":"2024-05-07T11:13:55.352800+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:13:55.352800+0000","last_undegraded":"2024-05-07T11:13:55.352800+0000","last_fullsized":"2024-05-07T11:13:55.352800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352662+0000","last_change":"2024-05-07T11:12:44.052115+0000","last_active":"2024-05-07T11:13:55.352662+0000","last_peered":"2024-05-07T11:13:55.352662+0000","last_clean":"2024-05-07T11:13:55.352662+0000","last_became_active":"2024-05-07T11:12:44.051537+0000","last_became_peered":"2024-05-07T11:12:44.051537+0000","last_unstale":"2024-05-07T11:13:55.352662+0000","last_undegraded":"2024-05-07T11:13:55.352662+0000","last_fullsized":"2024-05-07T11:13:55.352662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:49.397708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229754+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:13:56.229754+0000","last_peered":"2024-05-07T11:13:56.229754+0000","last_clean":"2024-05-07T11:13:56.229754+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:13:56.229754+0000","last_undegraded":"2024-05-07T11:13:56.229754+0000","last_fullsized":"2024-05-07T11:13:56.229754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229445+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:13:56.229445+0000","last_peered":"2024-05-07T11:13:56.229445+0000","last_clean":"2024-05-07T11:13:56.229445+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:13:56.229445+0000","last_undegraded":"2024-05-07T11:13:56.229445+0000","last_fullsized":"2024-05-07T11:13:56.229445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352065+0000","last_change":"2024-05-07T11:13:25.248991+0000","last_active":"2024-05-07T11:13:55.352065+0000","last_peered":"2024-05-07T11:13:55.352065+0000","last_clean":"2024-05-07T11:13:55.352065+0000","last_became_active":"2024-05-07T11:13:25.248693+0000","last_became_peered":"2024-05-07T11:13:25.248693+0000","last_unstale":"2024-05-07T11:13:55.352065+0000","last_undegraded":"2024-05-07T11:13:55.352065+0000","last_fullsized":"2024-05-07T11:13:55.352065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:27:15.749485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353142+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:13:55.353142+0000","last_peered":"2024-05-07T11:13:55.353142+0000","last_clean":"2024-05-07T11:13:55.353142+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:13:55.353142+0000","last_undegraded":"2024-05-07T11:13:55.353142+0000","last_fullsized":"2024-05-07T11:13:55.353142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353215+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:13:55.353215+0000","last_peered":"2024-05-07T11:13:55.353215+0000","last_clean":"2024-05-07T11:13:55.353215+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:13:55.353215+0000","last_undegraded":"2024-05-07T11:13:55.353215+0000","last_fullsized":"2024-05-07T11:13:55.353215+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352831+0000","last_change":"2024-05-07T11:12:44.051645+0000","last_active":"2024-05-07T11:13:55.352831+0000","last_peered":"2024-05-07T11:13:55.352831+0000","last_clean":"2024-05-07T11:13:55.352831+0000","last_became_active":"2024-05-07T11:12:44.051236+0000","last_became_peered":"2024-05-07T11:12:44.051236+0000","last_unstale":"2024-05-07T11:13:55.352831+0000","last_undegraded":"2024-05-07T11:13:55.352831+0000","last_fullsized":"2024-05-07T11:13:55.352831+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229983+0000","last_change":"2024-05-07T11:12:44.055985+0000","last_active":"2024-05-07T11:13:56.229983+0000","last_peered":"2024-05-07T11:13:56.229983+0000","last_clean":"2024-05-07T11:13:56.229983+0000","last_became_active":"2024-05-07T11:12:44.054916+0000","last_became_peered":"2024-05-07T11:12:44.054916+0000","last_unstale":"2024-05-07T11:13:56.229983+0000","last_undegraded":"2024-05-07T11:13:56.229983+0000","last_fullsized":"2024-05-07T11:13:56.229983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:33.749419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229531+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:13:56.229531+0000","last_peered":"2024-05-07T11:13:56.229531+0000","last_clean":"2024-05-07T11:13:56.229531+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:13:56.229531+0000","last_undegraded":"2024-05-07T11:13:56.229531+0000","last_fullsized":"2024-05-07T11:13:56.229531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352490+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:13:55.352490+0000","last_peered":"2024-05-07T11:13:55.352490+0000","last_clean":"2024-05-07T11:13:55.352490+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:13:55.352490+0000","last_undegraded":"2024-05-07T11:13:55.352490+0000","last_fullsized":"2024-05-07T11:13:55.352490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352056+0000","last_change":"2024-05-07T11:12:44.053766+0000","last_active":"2024-05-07T11:13:55.352056+0000","last_peered":"2024-05-07T11:13:55.352056+0000","last_clean":"2024-05-07T11:13:55.352056+0000","last_became_active":"2024-05-07T11:12:44.053111+0000","last_became_peered":"2024-05-07T11:12:44.053111+0000","last_unstale":"2024-05-07T11:13:55.352056+0000","last_undegraded":"2024-05-07T11:13:55.352056+0000","last_fullsized":"2024-05-07T11:13:55.352056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352349+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:13:55.352349+0000","last_peered":"2024-05-07T11:13:55.352349+0000","last_clean":"2024-05-07T11:13:55.352349+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:13:55.352349+0000","last_undegraded":"2024-05-07T11:13:55.352349+0000","last_fullsized":"2024-05-07T11:13:55.352349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353284+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:13:55.353284+0000","last_peered":"2024-05-07T11:13:55.353284+0000","last_clean":"2024-05-07T11:13:55.353284+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:13:55.353284+0000","last_undegraded":"2024-05-07T11:13:55.353284+0000","last_fullsized":"2024-05-07T11:13:55.353284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353007+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:13:55.353007+0000","last_peered":"2024-05-07T11:13:55.353007+0000","last_clean":"2024-05-07T11:13:55.353007+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:13:55.353007+0000","last_undegraded":"2024-05-07T11:13:55.353007+0000","last_fullsized":"2024-05-07T11:13:55.353007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353315+0000","last_change":"2024-05-07T11:13:25.249860+0000","last_active":"2024-05-07T11:13:55.353315+0000","last_peered":"2024-05-07T11:13:55.353315+0000","last_clean":"2024-05-07T11:13:55.353315+0000","last_became_active":"2024-05-07T11:13:25.249519+0000","last_became_peered":"2024-05-07T11:13:25.249519+0000","last_unstale":"2024-05-07T11:13:55.353315+0000","last_undegraded":"2024-05-07T11:13:55.353315+0000","last_fullsized":"2024-05-07T11:13:55.353315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352970+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:13:55.352970+0000","last_peered":"2024-05-07T11:13:55.352970+0000","last_clean":"2024-05-07T11:13:55.352970+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:13:55.352970+0000","last_undegraded":"2024-05-07T11:13:55.352970+0000","last_fullsized":"2024-05-07T11:13:55.352970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352565+0000","last_change":"2024-05-07T11:12:44.046304+0000","last_active":"2024-05-07T11:13:55.352565+0000","last_peered":"2024-05-07T11:13:55.352565+0000","last_clean":"2024-05-07T11:13:55.352565+0000","last_became_active":"2024-05-07T11:12:44.045500+0000","last_became_peered":"2024-05-07T11:12:44.045500+0000","last_unstale":"2024-05-07T11:13:55.352565+0000","last_undegraded":"2024-05-07T11:13:55.352565+0000","last_fullsized":"2024-05-07T11:13:55.352565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352659+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:13:55.352659+0000","last_peered":"2024-05-07T11:13:55.352659+0000","last_clean":"2024-05-07T11:13:55.352659+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:13:55.352659+0000","last_undegraded":"2024-05-07T11:13:55.352659+0000","last_fullsized":"2024-05-07T11:13:55.352659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352173+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:13:55.352173+0000","last_peered":"2024-05-07T11:13:55.352173+0000","last_clean":"2024-05-07T11:13:55.352173+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:13:55.352173+0000","last_undegraded":"2024-05-07T11:13:55.352173+0000","last_fullsized":"2024-05-07T11:13:55.352173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229448+0000","last_change":"2024-05-07T11:12:44.058369+0000","last_active":"2024-05-07T11:13:56.229448+0000","last_peered":"2024-05-07T11:13:56.229448+0000","last_clean":"2024-05-07T11:13:56.229448+0000","last_became_active":"2024-05-07T11:12:44.055922+0000","last_became_peered":"2024-05-07T11:12:44.055922+0000","last_unstale":"2024-05-07T11:13:56.229448+0000","last_undegraded":"2024-05-07T11:13:56.229448+0000","last_fullsized":"2024-05-07T11:13:56.229448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352914+0000","last_change":"2024-05-07T11:12:44.046054+0000","last_active":"2024-05-07T11:13:55.352914+0000","last_peered":"2024-05-07T11:13:55.352914+0000","last_clean":"2024-05-07T11:13:55.352914+0000","last_became_active":"2024-05-07T11:12:44.045452+0000","last_became_peered":"2024-05-07T11:12:44.045452+0000","last_unstale":"2024-05-07T11:13:55.352914+0000","last_undegraded":"2024-05-07T11:13:55.352914+0000","last_fullsized":"2024-05-07T11:13:55.352914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230585+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:13:56.230585+0000","last_peered":"2024-05-07T11:13:56.230585+0000","last_clean":"2024-05-07T11:13:56.230585+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:13:56.230585+0000","last_undegraded":"2024-05-07T11:13:56.230585+0000","last_fullsized":"2024-05-07T11:13:56.230585+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353130+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:13:55.353130+0000","last_peered":"2024-05-07T11:13:55.353130+0000","last_clean":"2024-05-07T11:13:55.353130+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:13:55.353130+0000","last_undegraded":"2024-05-07T11:13:55.353130+0000","last_fullsized":"2024-05-07T11:13:55.353130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352331+0000","last_change":"2024-05-07T11:12:43.050429+0000","last_active":"2024-05-07T11:13:55.352331+0000","last_peered":"2024-05-07T11:13:55.352331+0000","last_clean":"2024-05-07T11:13:55.352331+0000","last_became_active":"2024-05-07T11:12:43.049450+0000","last_became_peered":"2024-05-07T11:12:43.049450+0000","last_unstale":"2024-05-07T11:13:55.352331+0000","last_undegraded":"2024-05-07T11:13:55.352331+0000","last_fullsized":"2024-05-07T11:13:55.352331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353099+0000","last_change":"2024-05-07T11:12:44.054227+0000","last_active":"2024-05-07T11:13:55.353099+0000","last_peered":"2024-05-07T11:13:55.353099+0000","last_clean":"2024-05-07T11:13:55.353099+0000","last_became_active":"2024-05-07T11:12:44.053256+0000","last_became_peered":"2024-05-07T11:12:44.053256+0000","last_unstale":"2024-05-07T11:13:55.353099+0000","last_undegraded":"2024-05-07T11:13:55.353099+0000","last_fullsized":"2024-05-07T11:13:55.353099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352537+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:13:55.352537+0000","last_peered":"2024-05-07T11:13:55.352537+0000","last_clean":"2024-05-07T11:13:55.352537+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:13:55.352537+0000","last_undegraded":"2024-05-07T11:13:55.352537+0000","last_fullsized":"2024-05-07T11:13:55.352537+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352930+0000","last_change":"2024-05-07T11:12:44.054268+0000","last_active":"2024-05-07T11:13:55.352930+0000","last_peered":"2024-05-07T11:13:55.352930+0000","last_clean":"2024-05-07T11:13:55.352930+0000","last_became_active":"2024-05-07T11:12:44.053874+0000","last_became_peered":"2024-05-07T11:12:44.053874+0000","last_unstale":"2024-05-07T11:13:55.352930+0000","last_undegraded":"2024-05-07T11:13:55.352930+0000","last_fullsized":"2024-05-07T11:13:55.352930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":70,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230281+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:13:56.230281+0000","last_peered":"2024-05-07T11:13:56.230281+0000","last_clean":"2024-05-07T11:13:56.230281+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:13:56.230281+0000","last_undegraded":"2024-05-07T11:13:56.230281+0000","last_fullsized":"2024-05-07T11:13:56.230281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":63,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230978+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:13:56.230978+0000","last_peered":"2024-05-07T11:13:56.230978+0000","last_clean":"2024-05-07T11:13:56.230978+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:13:56.230978+0000","last_undegraded":"2024-05-07T11:13:56.230978+0000","last_fullsized":"2024-05-07T11:13:56.230978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352379+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:13:55.352379+0000","last_peered":"2024-05-07T11:13:55.352379+0000","last_clean":"2024-05-07T11:13:55.352379+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:13:55.352379+0000","last_undegraded":"2024-05-07T11:13:55.352379+0000","last_fullsized":"2024-05-07T11:13:55.352379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":66,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353222+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:13:55.353222+0000","last_peered":"2024-05-07T11:13:55.353222+0000","last_clean":"2024-05-07T11:13:55.353222+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:13:55.353222+0000","last_undegraded":"2024-05-07T11:13:55.353222+0000","last_fullsized":"2024-05-07T11:13:55.353222+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352414+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:13:55.352414+0000","last_peered":"2024-05-07T11:13:55.352414+0000","last_clean":"2024-05-07T11:13:55.352414+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:13:55.352414+0000","last_undegraded":"2024-05-07T11:13:55.352414+0000","last_fullsized":"2024-05-07T11:13:55.352414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352953+0000","last_change":"2024-05-07T11:13:25.249690+0000","last_active":"2024-05-07T11:13:55.352953+0000","last_peered":"2024-05-07T11:13:55.352953+0000","last_clean":"2024-05-07T11:13:55.352953+0000","last_became_active":"2024-05-07T11:13:25.249304+0000","last_became_peered":"2024-05-07T11:13:25.249304+0000","last_unstale":"2024-05-07T11:13:55.352953+0000","last_undegraded":"2024-05-07T11:13:55.352953+0000","last_fullsized":"2024-05-07T11:13:55.352953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:30.051793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229593+0000","last_change":"2024-05-07T11:12:44.057116+0000","last_active":"2024-05-07T11:13:56.229593+0000","last_peered":"2024-05-07T11:13:56.229593+0000","last_clean":"2024-05-07T11:13:56.229593+0000","last_became_active":"2024-05-07T11:12:44.056371+0000","last_became_peered":"2024-05-07T11:12:44.056371+0000","last_unstale":"2024-05-07T11:13:56.229593+0000","last_undegraded":"2024-05-07T11:13:56.229593+0000","last_fullsized":"2024-05-07T11:13:56.229593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352656+0000","last_change":"2024-05-07T11:13:25.249164+0000","last_active":"2024-05-07T11:13:55.352656+0000","last_peered":"2024-05-07T11:13:55.352656+0000","last_clean":"2024-05-07T11:13:55.352656+0000","last_became_active":"2024-05-07T11:13:25.248783+0000","last_became_peered":"2024-05-07T11:13:25.248783+0000","last_unstale":"2024-05-07T11:13:55.352656+0000","last_undegraded":"2024-05-07T11:13:55.352656+0000","last_fullsized":"2024-05-07T11:13:55.352656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:00.987017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352486+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:13:55.352486+0000","last_peered":"2024-05-07T11:13:55.352486+0000","last_clean":"2024-05-07T11:13:55.352486+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:13:55.352486+0000","last_undegraded":"2024-05-07T11:13:55.352486+0000","last_fullsized":"2024-05-07T11:13:55.352486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":66,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352659+0000","last_change":"2024-05-07T11:12:43.049823+0000","last_active":"2024-05-07T11:13:55.352659+0000","last_peered":"2024-05-07T11:13:55.352659+0000","last_clean":"2024-05-07T11:13:55.352659+0000","last_became_active":"2024-05-07T11:12:43.048434+0000","last_became_peered":"2024-05-07T11:12:43.048434+0000","last_unstale":"2024-05-07T11:13:55.352659+0000","last_undegraded":"2024-05-07T11:13:55.352659+0000","last_fullsized":"2024-05-07T11:13:55.352659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229907+0000","last_change":"2024-05-07T11:12:44.056971+0000","last_active":"2024-05-07T11:13:56.229907+0000","last_peered":"2024-05-07T11:13:56.229907+0000","last_clean":"2024-05-07T11:13:56.229907+0000","last_became_active":"2024-05-07T11:12:44.056578+0000","last_became_peered":"2024-05-07T11:12:44.056578+0000","last_unstale":"2024-05-07T11:13:56.229907+0000","last_undegraded":"2024-05-07T11:13:56.229907+0000","last_fullsized":"2024-05-07T11:13:56.229907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:59.266019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230458+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:13:56.230458+0000","last_peered":"2024-05-07T11:13:56.230458+0000","last_clean":"2024-05-07T11:13:56.230458+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:13:56.230458+0000","last_undegraded":"2024-05-07T11:13:56.230458+0000","last_fullsized":"2024-05-07T11:13:56.230458+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229585+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:13:56.229585+0000","last_peered":"2024-05-07T11:13:56.229585+0000","last_clean":"2024-05-07T11:13:56.229585+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:13:56.229585+0000","last_undegraded":"2024-05-07T11:13:56.229585+0000","last_fullsized":"2024-05-07T11:13:56.229585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352601+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:13:55.352601+0000","last_peered":"2024-05-07T11:13:55.352601+0000","last_clean":"2024-05-07T11:13:55.352601+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:13:55.352601+0000","last_undegraded":"2024-05-07T11:13:55.352601+0000","last_fullsized":"2024-05-07T11:13:55.352601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230103+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:13:56.230103+0000","last_peered":"2024-05-07T11:13:56.230103+0000","last_clean":"2024-05-07T11:13:56.230103+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:13:56.230103+0000","last_undegraded":"2024-05-07T11:13:56.230103+0000","last_fullsized":"2024-05-07T11:13:56.230103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352442+0000","last_change":"2024-05-07T11:12:43.046139+0000","last_active":"2024-05-07T11:13:55.352442+0000","last_peered":"2024-05-07T11:13:55.352442+0000","last_clean":"2024-05-07T11:13:55.352442+0000","last_became_active":"2024-05-07T11:12:43.045879+0000","last_became_peered":"2024-05-07T11:12:43.045879+0000","last_unstale":"2024-05-07T11:13:55.352442+0000","last_undegraded":"2024-05-07T11:13:55.352442+0000","last_fullsized":"2024-05-07T11:13:55.352442+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:09.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352983+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:13:55.352983+0000","last_peered":"2024-05-07T11:13:55.352983+0000","last_clean":"2024-05-07T11:13:55.352983+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:13:55.352983+0000","last_undegraded":"2024-05-07T11:13:55.352983+0000","last_fullsized":"2024-05-07T11:13:55.352983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":264,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230394+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:13:56.230394+0000","last_peered":"2024-05-07T11:13:56.230394+0000","last_clean":"2024-05-07T11:13:56.230394+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:13:56.230394+0000","last_undegraded":"2024-05-07T11:13:56.230394+0000","last_fullsized":"2024-05-07T11:13:56.230394+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230649+0000","last_change":"2024-05-07T11:12:38.712216+0000","last_active":"2024-05-07T11:13:56.230649+0000","last_peered":"2024-05-07T11:13:56.230649+0000","last_clean":"2024-05-07T11:13:56.230649+0000","last_became_active":"2024-05-07T11:12:38.711933+0000","last_became_peered":"2024-05-07T11:12:38.711933+0000","last_unstale":"2024-05-07T11:13:56.230649+0000","last_undegraded":"2024-05-07T11:13:56.230649+0000","last_fullsized":"2024-05-07T11:13:56.230649+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:00.347869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352418+0000","last_change":"2024-05-07T11:12:43.048325+0000","last_active":"2024-05-07T11:13:55.352418+0000","last_peered":"2024-05-07T11:13:55.352418+0000","last_clean":"2024-05-07T11:13:55.352418+0000","last_became_active":"2024-05-07T11:12:43.046926+0000","last_became_peered":"2024-05-07T11:12:43.046926+0000","last_unstale":"2024-05-07T11:13:55.352418+0000","last_undegraded":"2024-05-07T11:13:55.352418+0000","last_fullsized":"2024-05-07T11:13:55.352418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352941+0000","last_change":"2024-05-07T11:13:25.249760+0000","last_active":"2024-05-07T11:13:55.352941+0000","last_peered":"2024-05-07T11:13:55.352941+0000","last_clean":"2024-05-07T11:13:55.352941+0000","last_became_active":"2024-05-07T11:13:25.249466+0000","last_became_peered":"2024-05-07T11:13:25.249466+0000","last_unstale":"2024-05-07T11:13:55.352941+0000","last_undegraded":"2024-05-07T11:13:55.352941+0000","last_fullsized":"2024-05-07T11:13:55.352941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230330+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:13:56.230330+0000","last_peered":"2024-05-07T11:13:56.230330+0000","last_clean":"2024-05-07T11:13:56.230330+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:13:56.230330+0000","last_undegraded":"2024-05-07T11:13:56.230330+0000","last_fullsized":"2024-05-07T11:13:56.230330+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352374+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:13:55.352374+0000","last_peered":"2024-05-07T11:13:55.352374+0000","last_clean":"2024-05-07T11:13:55.352374+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:13:55.352374+0000","last_undegraded":"2024-05-07T11:13:55.352374+0000","last_fullsized":"2024-05-07T11:13:55.352374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353107+0000","last_change":"2024-05-07T11:12:44.052405+0000","last_active":"2024-05-07T11:13:55.353107+0000","last_peered":"2024-05-07T11:13:55.353107+0000","last_clean":"2024-05-07T11:13:55.353107+0000","last_became_active":"2024-05-07T11:12:44.051294+0000","last_became_peered":"2024-05-07T11:12:44.051294+0000","last_unstale":"2024-05-07T11:13:55.353107+0000","last_undegraded":"2024-05-07T11:13:55.353107+0000","last_fullsized":"2024-05-07T11:13:55.353107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352485+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:13:55.352485+0000","last_peered":"2024-05-07T11:13:55.352485+0000","last_clean":"2024-05-07T11:13:55.352485+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:13:55.352485+0000","last_undegraded":"2024-05-07T11:13:55.352485+0000","last_fullsized":"2024-05-07T11:13:55.352485+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352479+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:13:55.352479+0000","last_peered":"2024-05-07T11:13:55.352479+0000","last_clean":"2024-05-07T11:13:55.352479+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:13:55.352479+0000","last_undegraded":"2024-05-07T11:13:55.352479+0000","last_fullsized":"2024-05-07T11:13:55.352479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352997+0000","last_change":"2024-05-07T11:12:44.052682+0000","last_active":"2024-05-07T11:13:55.352997+0000","last_peered":"2024-05-07T11:13:55.352997+0000","last_clean":"2024-05-07T11:13:55.352997+0000","last_became_active":"2024-05-07T11:12:44.051470+0000","last_became_peered":"2024-05-07T11:12:44.051470+0000","last_unstale":"2024-05-07T11:13:55.352997+0000","last_undegraded":"2024-05-07T11:13:55.352997+0000","last_fullsized":"2024-05-07T11:13:55.352997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230506+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:13:56.230506+0000","last_peered":"2024-05-07T11:13:56.230506+0000","last_clean":"2024-05-07T11:13:56.230506+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:13:56.230506+0000","last_undegraded":"2024-05-07T11:13:56.230506+0000","last_fullsized":"2024-05-07T11:13:56.230506+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230613+0000","last_change":"2024-05-07T11:12:43.053069+0000","last_active":"2024-05-07T11:13:56.230613+0000","last_peered":"2024-05-07T11:13:56.230613+0000","last_clean":"2024-05-07T11:13:56.230613+0000","last_became_active":"2024-05-07T11:12:43.052548+0000","last_became_peered":"2024-05-07T11:12:43.052548+0000","last_unstale":"2024-05-07T11:13:56.230613+0000","last_undegraded":"2024-05-07T11:13:56.230613+0000","last_fullsized":"2024-05-07T11:13:56.230613+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352736+0000","last_change":"2024-05-07T11:12:44.051878+0000","last_active":"2024-05-07T11:13:55.352736+0000","last_peered":"2024-05-07T11:13:55.352736+0000","last_clean":"2024-05-07T11:13:55.352736+0000","last_became_active":"2024-05-07T11:12:44.051278+0000","last_became_peered":"2024-05-07T11:12:44.051278+0000","last_unstale":"2024-05-07T11:13:55.352736+0000","last_undegraded":"2024-05-07T11:13:55.352736+0000","last_fullsized":"2024-05-07T11:13:55.352736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352728+0000","last_change":"2024-05-07T11:13:25.249176+0000","last_active":"2024-05-07T11:13:55.352728+0000","last_peered":"2024-05-07T11:13:55.352728+0000","last_clean":"2024-05-07T11:13:55.352728+0000","last_became_active":"2024-05-07T11:13:25.248831+0000","last_became_peered":"2024-05-07T11:13:25.248831+0000","last_unstale":"2024-05-07T11:13:55.352728+0000","last_undegraded":"2024-05-07T11:13:55.352728+0000","last_fullsized":"2024-05-07T11:13:55.352728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:48:30.756870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352829+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:13:55.352829+0000","last_peered":"2024-05-07T11:13:55.352829+0000","last_clean":"2024-05-07T11:13:55.352829+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:13:55.352829+0000","last_undegraded":"2024-05-07T11:13:55.352829+0000","last_fullsized":"2024-05-07T11:13:55.352829+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352545+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:13:55.352545+0000","last_peered":"2024-05-07T11:13:55.352545+0000","last_clean":"2024-05-07T11:13:55.352545+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:13:55.352545+0000","last_undegraded":"2024-05-07T11:13:55.352545+0000","last_fullsized":"2024-05-07T11:13:55.352545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352800+0000","last_change":"2024-05-07T11:12:43.047487+0000","last_active":"2024-05-07T11:13:55.352800+0000","last_peered":"2024-05-07T11:13:55.352800+0000","last_clean":"2024-05-07T11:13:55.352800+0000","last_became_active":"2024-05-07T11:12:43.046888+0000","last_became_peered":"2024-05-07T11:12:43.046888+0000","last_unstale":"2024-05-07T11:13:55.352800+0000","last_undegraded":"2024-05-07T11:13:55.352800+0000","last_fullsized":"2024-05-07T11:13:55.352800+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:11.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353362+0000","last_change":"2024-05-07T11:12:38.710318+0000","last_active":"2024-05-07T11:13:55.353362+0000","last_peered":"2024-05-07T11:13:55.353362+0000","last_clean":"2024-05-07T11:13:55.353362+0000","last_became_active":"2024-05-07T11:12:38.710037+0000","last_became_peered":"2024-05-07T11:12:38.710037+0000","last_unstale":"2024-05-07T11:13:55.353362+0000","last_undegraded":"2024-05-07T11:13:55.353362+0000","last_fullsized":"2024-05-07T11:13:55.353362+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:18.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352770+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:13:55.352770+0000","last_peered":"2024-05-07T11:13:55.352770+0000","last_clean":"2024-05-07T11:13:55.352770+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:13:55.352770+0000","last_undegraded":"2024-05-07T11:13:55.352770+0000","last_fullsized":"2024-05-07T11:13:55.352770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":66,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353160+0000","last_change":"2024-05-07T11:12:43.049259+0000","last_active":"2024-05-07T11:13:55.353160+0000","last_peered":"2024-05-07T11:13:55.353160+0000","last_clean":"2024-05-07T11:13:55.353160+0000","last_became_active":"2024-05-07T11:12:43.047374+0000","last_became_peered":"2024-05-07T11:12:43.047374+0000","last_unstale":"2024-05-07T11:13:55.353160+0000","last_undegraded":"2024-05-07T11:13:55.353160+0000","last_fullsized":"2024-05-07T11:13:55.353160+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:18:39.296587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353177+0000","last_change":"2024-05-07T11:12:38.707840+0000","last_active":"2024-05-07T11:13:55.353177+0000","last_peered":"2024-05-07T11:13:55.353177+0000","last_clean":"2024-05-07T11:13:55.353177+0000","last_became_active":"2024-05-07T11:12:38.707611+0000","last_became_peered":"2024-05-07T11:12:38.707611+0000","last_unstale":"2024-05-07T11:13:55.353177+0000","last_undegraded":"2024-05-07T11:13:55.353177+0000","last_fullsized":"2024-05-07T11:13:55.353177+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:41.349886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352244+0000","last_change":"2024-05-07T11:13:25.248884+0000","last_active":"2024-05-07T11:13:55.352244+0000","last_peered":"2024-05-07T11:13:55.352244+0000","last_clean":"2024-05-07T11:13:55.352244+0000","last_became_active":"2024-05-07T11:13:25.248619+0000","last_became_peered":"2024-05-07T11:13:25.248619+0000","last_unstale":"2024-05-07T11:13:55.352244+0000","last_undegraded":"2024-05-07T11:13:55.352244+0000","last_fullsized":"2024-05-07T11:13:55.352244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":67,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353174+0000","last_change":"2024-05-07T11:12:43.049290+0000","last_active":"2024-05-07T11:13:55.353174+0000","last_peered":"2024-05-07T11:13:55.353174+0000","last_clean":"2024-05-07T11:13:55.353174+0000","last_became_active":"2024-05-07T11:12:43.048354+0000","last_became_peered":"2024-05-07T11:12:43.048354+0000","last_unstale":"2024-05-07T11:13:55.353174+0000","last_undegraded":"2024-05-07T11:13:55.353174+0000","last_fullsized":"2024-05-07T11:13:55.353174+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:07:06.624812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.231016+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:13:56.231016+0000","last_peered":"2024-05-07T11:13:56.231016+0000","last_clean":"2024-05-07T11:13:56.231016+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:13:56.231016+0000","last_undegraded":"2024-05-07T11:13:56.231016+0000","last_fullsized":"2024-05-07T11:13:56.231016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352448+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:13:55.352448+0000","last_peered":"2024-05-07T11:13:55.352448+0000","last_clean":"2024-05-07T11:13:55.352448+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:13:55.352448+0000","last_undegraded":"2024-05-07T11:13:55.352448+0000","last_fullsized":"2024-05-07T11:13:55.352448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229637+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:13:56.229637+0000","last_peered":"2024-05-07T11:13:56.229637+0000","last_clean":"2024-05-07T11:13:56.229637+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:13:56.229637+0000","last_undegraded":"2024-05-07T11:13:56.229637+0000","last_fullsized":"2024-05-07T11:13:56.229637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'10","reported_seq":72,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230671+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:13:56.230671+0000","last_peered":"2024-05-07T11:13:56.230671+0000","last_clean":"2024-05-07T11:13:56.230671+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:13:56.230671+0000","last_undegraded":"2024-05-07T11:13:56.230671+0000","last_fullsized":"2024-05-07T11:13:56.230671+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352272+0000","last_change":"2024-05-07T11:12:44.046406+0000","last_active":"2024-05-07T11:13:55.352272+0000","last_peered":"2024-05-07T11:13:55.352272+0000","last_clean":"2024-05-07T11:13:55.352272+0000","last_became_active":"2024-05-07T11:12:44.045668+0000","last_became_peered":"2024-05-07T11:12:44.045668+0000","last_unstale":"2024-05-07T11:13:55.352272+0000","last_undegraded":"2024-05-07T11:13:55.352272+0000","last_fullsized":"2024-05-07T11:13:55.352272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:16.452767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":67,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353256+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:13:55.353256+0000","last_peered":"2024-05-07T11:13:55.353256+0000","last_clean":"2024-05-07T11:13:55.353256+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:13:55.353256+0000","last_undegraded":"2024-05-07T11:13:55.353256+0000","last_fullsized":"2024-05-07T11:13:55.353256+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352914+0000","last_change":"2024-05-07T11:13:25.249281+0000","last_active":"2024-05-07T11:13:55.352914+0000","last_peered":"2024-05-07T11:13:55.352914+0000","last_clean":"2024-05-07T11:13:55.352914+0000","last_became_active":"2024-05-07T11:13:25.249068+0000","last_became_peered":"2024-05-07T11:13:25.249068+0000","last_unstale":"2024-05-07T11:13:55.352914+0000","last_undegraded":"2024-05-07T11:13:55.352914+0000","last_fullsized":"2024-05-07T11:13:55.352914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:30:57.180798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352182+0000","last_change":"2024-05-07T11:12:44.053781+0000","last_active":"2024-05-07T11:13:55.352182+0000","last_peered":"2024-05-07T11:13:55.352182+0000","last_clean":"2024-05-07T11:13:55.352182+0000","last_became_active":"2024-05-07T11:12:44.052954+0000","last_became_peered":"2024-05-07T11:12:44.052954+0000","last_unstale":"2024-05-07T11:13:55.352182+0000","last_undegraded":"2024-05-07T11:13:55.352182+0000","last_fullsized":"2024-05-07T11:13:55.352182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353106+0000","last_change":"2024-05-07T11:12:43.050171+0000","last_active":"2024-05-07T11:13:55.353106+0000","last_peered":"2024-05-07T11:13:55.353106+0000","last_clean":"2024-05-07T11:13:55.353106+0000","last_became_active":"2024-05-07T11:12:43.049081+0000","last_became_peered":"2024-05-07T11:12:43.049081+0000","last_unstale":"2024-05-07T11:13:55.353106+0000","last_undegraded":"2024-05-07T11:13:55.353106+0000","last_fullsized":"2024-05-07T11:13:55.353106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:47.916255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352173+0000","last_change":"2024-05-07T11:12:44.050693+0000","last_active":"2024-05-07T11:13:55.352173+0000","last_peered":"2024-05-07T11:13:55.352173+0000","last_clean":"2024-05-07T11:13:55.352173+0000","last_became_active":"2024-05-07T11:12:44.050137+0000","last_became_peered":"2024-05-07T11:12:44.050137+0000","last_unstale":"2024-05-07T11:13:55.352173+0000","last_undegraded":"2024-05-07T11:13:55.352173+0000","last_fullsized":"2024-05-07T11:13:55.352173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353296+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:13:55.353296+0000","last_peered":"2024-05-07T11:13:55.353296+0000","last_clean":"2024-05-07T11:13:55.353296+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:13:55.353296+0000","last_undegraded":"2024-05-07T11:13:55.353296+0000","last_fullsized":"2024-05-07T11:13:55.353296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352267+0000","last_change":"2024-05-07T11:12:43.051662+0000","last_active":"2024-05-07T11:13:55.352267+0000","last_peered":"2024-05-07T11:13:55.352267+0000","last_clean":"2024-05-07T11:13:55.352267+0000","last_became_active":"2024-05-07T11:12:43.051356+0000","last_became_peered":"2024-05-07T11:12:43.051356+0000","last_unstale":"2024-05-07T11:13:55.352267+0000","last_undegraded":"2024-05-07T11:13:55.352267+0000","last_fullsized":"2024-05-07T11:13:55.352267+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:02:04.797052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352908+0000","last_change":"2024-05-07T11:12:44.053455+0000","last_active":"2024-05-07T11:13:55.352908+0000","last_peered":"2024-05-07T11:13:55.352908+0000","last_clean":"2024-05-07T11:13:55.352908+0000","last_became_active":"2024-05-07T11:12:44.052754+0000","last_became_peered":"2024-05-07T11:12:44.052754+0000","last_unstale":"2024-05-07T11:13:55.352908+0000","last_undegraded":"2024-05-07T11:13:55.352908+0000","last_fullsized":"2024-05-07T11:13:55.352908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352347+0000","last_change":"2024-05-07T11:12:43.049355+0000","last_active":"2024-05-07T11:13:55.352347+0000","last_peered":"2024-05-07T11:13:55.352347+0000","last_clean":"2024-05-07T11:13:55.352347+0000","last_became_active":"2024-05-07T11:12:43.048381+0000","last_became_peered":"2024-05-07T11:12:43.048381+0000","last_unstale":"2024-05-07T11:13:55.352347+0000","last_undegraded":"2024-05-07T11:13:55.352347+0000","last_fullsized":"2024-05-07T11:13:55.352347+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:51.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353056+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:13:55.353056+0000","last_peered":"2024-05-07T11:13:55.353056+0000","last_clean":"2024-05-07T11:13:55.353056+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:13:55.353056+0000","last_undegraded":"2024-05-07T11:13:55.353056+0000","last_fullsized":"2024-05-07T11:13:55.353056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352681+0000","last_change":"2024-05-07T11:12:43.046136+0000","last_active":"2024-05-07T11:13:55.352681+0000","last_peered":"2024-05-07T11:13:55.352681+0000","last_clean":"2024-05-07T11:13:55.352681+0000","last_became_active":"2024-05-07T11:12:43.045886+0000","last_became_peered":"2024-05-07T11:12:43.045886+0000","last_unstale":"2024-05-07T11:13:55.352681+0000","last_undegraded":"2024-05-07T11:13:55.352681+0000","last_fullsized":"2024-05-07T11:13:55.352681+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:27.986605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352797+0000","last_change":"2024-05-07T11:12:44.047935+0000","last_active":"2024-05-07T11:13:55.352797+0000","last_peered":"2024-05-07T11:13:55.352797+0000","last_clean":"2024-05-07T11:13:55.352797+0000","last_became_active":"2024-05-07T11:12:44.047012+0000","last_became_peered":"2024-05-07T11:12:44.047012+0000","last_unstale":"2024-05-07T11:13:55.352797+0000","last_undegraded":"2024-05-07T11:13:55.352797+0000","last_fullsized":"2024-05-07T11:13:55.352797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:28:27.722414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352872+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:13:55.352872+0000","last_peered":"2024-05-07T11:13:55.352872+0000","last_clean":"2024-05-07T11:13:55.352872+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:13:55.352872+0000","last_undegraded":"2024-05-07T11:13:55.352872+0000","last_fullsized":"2024-05-07T11:13:55.352872+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229731+0000","last_change":"2024-05-07T11:12:44.053893+0000","last_active":"2024-05-07T11:13:56.229731+0000","last_peered":"2024-05-07T11:13:56.229731+0000","last_clean":"2024-05-07T11:13:56.229731+0000","last_became_active":"2024-05-07T11:12:44.053231+0000","last_became_peered":"2024-05-07T11:12:44.053231+0000","last_unstale":"2024-05-07T11:13:56.229731+0000","last_undegraded":"2024-05-07T11:13:56.229731+0000","last_fullsized":"2024-05-07T11:13:56.229731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.230656+0000","last_change":"2024-05-07T11:12:43.052869+0000","last_active":"2024-05-07T11:13:56.230656+0000","last_peered":"2024-05-07T11:13:56.230656+0000","last_clean":"2024-05-07T11:13:56.230656+0000","last_became_active":"2024-05-07T11:12:43.052407+0000","last_became_peered":"2024-05-07T11:12:43.052407+0000","last_unstale":"2024-05-07T11:13:56.230656+0000","last_undegraded":"2024-05-07T11:13:56.230656+0000","last_fullsized":"2024-05-07T11:13:56.230656+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:39.769908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229478+0000","last_change":"2024-05-07T11:12:44.055664+0000","last_active":"2024-05-07T11:13:56.229478+0000","last_peered":"2024-05-07T11:13:56.229478+0000","last_clean":"2024-05-07T11:13:56.229478+0000","last_became_active":"2024-05-07T11:12:44.054970+0000","last_became_peered":"2024-05-07T11:12:44.054970+0000","last_unstale":"2024-05-07T11:13:56.229478+0000","last_undegraded":"2024-05-07T11:13:56.229478+0000","last_fullsized":"2024-05-07T11:13:56.229478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":66,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353157+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:13:55.353157+0000","last_peered":"2024-05-07T11:13:55.353157+0000","last_clean":"2024-05-07T11:13:55.353157+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:13:55.353157+0000","last_undegraded":"2024-05-07T11:13:55.353157+0000","last_fullsized":"2024-05-07T11:13:55.353157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.352632+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:13:55.352632+0000","last_peered":"2024-05-07T11:13:55.352632+0000","last_clean":"2024-05-07T11:13:55.352632+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:13:55.352632+0000","last_undegraded":"2024-05-07T11:13:55.352632+0000","last_fullsized":"2024-05-07T11:13:55.352632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353080+0000","last_change":"2024-05-07T11:12:43.051442+0000","last_active":"2024-05-07T11:13:55.353080+0000","last_peered":"2024-05-07T11:13:55.353080+0000","last_clean":"2024-05-07T11:13:55.353080+0000","last_became_active":"2024-05-07T11:12:43.051065+0000","last_became_peered":"2024-05-07T11:12:43.051065+0000","last_unstale":"2024-05-07T11:13:55.353080+0000","last_undegraded":"2024-05-07T11:13:55.353080+0000","last_fullsized":"2024-05-07T11:13:55.353080+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:18.019267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:56.229438+0000","last_change":"2024-05-07T11:12:44.059895+0000","last_active":"2024-05-07T11:13:56.229438+0000","last_peered":"2024-05-07T11:13:56.229438+0000","last_clean":"2024-05-07T11:13:56.229438+0000","last_became_active":"2024-05-07T11:12:44.057924+0000","last_became_peered":"2024-05-07T11:12:44.057924+0000","last_unstale":"2024-05-07T11:13:56.229438+0000","last_undegraded":"2024-05-07T11:13:56.229438+0000","last_fullsized":"2024-05-07T11:13:56.229438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T11:13:55.353053+0000","last_change":"2024-05-07T11:12:43.051086+0000","last_active":"2024-05-07T11:13:55.353053+0000","last_peered":"2024-05-07T11:13:55.353053+0000","last_clean":"2024-05-07T11:13:55.353053+0000","last_became_active":"2024-05-07T11:12:43.050727+0000","last_became_peered":"2024-05-07T11:12:43.050727+0000","last_unstale":"2024-05-07T11:13:55.353053+0000","last_undegraded":"2024-05-07T11:13:55.353053+0000","last_fullsized":"2024-05-07T11:13:55.353053+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":421888,"data_stored":745866,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":421888,"data_stored":749520,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":153033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:14:01.073 INFO:tasks.thrashosds.thrasher:Setting 3.7 to [2, 1] 2024-05-07T11:14:01.073 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.7', '2', '1'] 2024-05-07T11:14:01.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.7 2 1 2024-05-07T11:14:01.075 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:01.075 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:01.085 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:01.161 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:01.160+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:01.189 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:01.189 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:01.198 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:01.209 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:01.246 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:01.261 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:01.261+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:01.305 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:01.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:01.306 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:01.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.306 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:01.306 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:01.306 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.357048067999997, 2024-05-07T11:14:01.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:14:01.306 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.306 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.306 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.309 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:01.309 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:14:01.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:14:01.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:14:01.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:14:01.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:01.315 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:01.316 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.032822181, 2024-05-07T11:14:01.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:14:01.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:14:01.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:14:01.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:14:01.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.872346781999994, 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:01.322 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:14:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:14:01.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:14:01.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:14:01.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.329 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.872260413999996, 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:14:01.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:14:01.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:14:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:14:01.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:14:01.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:14:01.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:14:01.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:14:01.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:14:01.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:14:01.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.643112981000002, 2024-05-07T11:14:01.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:14:01.337 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.337 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.337 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.337 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:01.337 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:14:01.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:14:01.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.342 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.643065515999993, 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.261153128000004, 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.348 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:14:01.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:14:01.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:14:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:14:01.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:14:01.353 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.258958043999996, 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:14:01.359 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.258729824, 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.258550693999993, 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:01.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:14:01.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:14:01.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:14:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:14:01.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.371 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.258490820000006, 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.258442647999999, 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:14:01.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:14:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:14:01.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:14:01.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.258414665999993, 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:14:01.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.258381655999997, 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.387 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:14:01.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:14:01.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:14:01.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:14:01.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.392 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.258287851999995, 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:01.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:14:01.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.25814441, 2024-05-07T11:14:01.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.257959505000002, 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:14:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:14:01.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:14:01.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:14:01.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.257800434999993, 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.409 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:14:01.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:14:01.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:14:01.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:14:01.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.257357025999994, 2024-05-07T11:14:01.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:01.419 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.257331762000007, 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:01.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:01.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:01.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:14:01.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:14:01.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.423 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:01.423 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:01.424 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:01.424+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:01.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:01.525 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:01.524+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:01.540 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:01.540 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:01.540 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:01.540 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:01.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:01.625 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:01.625+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:01.694 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:01.695 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:01.695 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:01.695 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:01.695 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:01.703 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:01.726 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:01.725+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:01.809 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:01.809 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:01.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:01.809 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:01.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.809 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.809 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.765006220000004, 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:14:01.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.764941500000006, 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.816 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:14:01.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:14:01.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:14:01.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:01.822 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.76484456, 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:01.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:14:01.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:14:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.764779222000001, 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:01.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:14:01.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:14:01.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:01.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:14:01.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:14:01.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:14:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.764752329999993, 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.840 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.764724752000006, 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:01.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.764689363000002, 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:14:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.764663756000004, 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.764634326000007, 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.762248352, 2024-05-07T11:14:01.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:14:01.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:14:01.861 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.757989812999995, 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.75734181, 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.866 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.756696491, 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.870 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:01.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:14:01.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:14:01.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.756422927000003, 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:14:01.874 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:14:01.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.878 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.755662923000003, 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:14:01.882 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.755078303999994, 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:01.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:14:01.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:14:01.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.751321494999999, 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.889 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 75.766305461000002, 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:01.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 52.763815016000002, 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:14:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:14:01.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:14:01.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:14:01.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.763079371000003, 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:01.900 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:14:01.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:01.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:01.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:14:01.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:01.905 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:01.906 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:01.906+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:01.907 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:02.007 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:02.007+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:02.026 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:02.026 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:02.026 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:14:02.026 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:02.035 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:02.108 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:02.107+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:02.141 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:14:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:14:02.141 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:02.150 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:02.235 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:02.235+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:02.298 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:02.298 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:14:02.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:14:02.298 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:14:02.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.298 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:14:02.298 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:02.298 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.531241734999995, 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:14:02.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:14:02.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.302 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.864686578999994, 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.306 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.635079486999999, 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.634404313000005, 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:02.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:14:02.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:14:02.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.633762492000002, 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:14:02.315 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:14:02.319 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.633294083999999, 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:14:02.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:14:02.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.630588563000003, 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.327 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.253272182000003, 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:14:02.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:02.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:14:02.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:14:02.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:02.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:14:02.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:14:02.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:02.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.253215406999999, 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.340 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.253186936000006, 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:02.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:14:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:14:02.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:14:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.253148142000001, 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.253104819000001, 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:02.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:14:02.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:14:02.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:14:02.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:14:02.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.253082268, 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:14:02.358 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:14:02.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:14:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:14:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.253058207999999, 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:14:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.253039247999993, 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.253012576000003, 2024-05-07T11:14:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:14:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.248508315999999, 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.246781788999996, 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:14:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.246629455000004, 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.246576482999998, 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:14:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:02.398 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:02.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T11:14:02.400 INFO:teuthology.orchestra.run.smithi062.stderr:set 3.7 pg_upmap mapping to [2,1] 2024-05-07T11:14:02.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:02.401 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:02.399+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:02.500 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:02.500+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:02.513 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:02.513 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:02.514 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:02.514 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:02.522 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:02.602 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:02.601+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:02.667 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:02.667 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:02.667 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:02.667 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:02.667 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:02.675 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:02.702 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:02.702+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:02.782 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 83.833920140999993, 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:14:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:14:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 83.509694253999996, 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 83.349218855000004, 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:14:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:14:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:14:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:14:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 83.349132487000006, 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:14:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:14:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:14:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:14:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:14:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:14:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:14:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:14:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:14:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:14:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:14:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 83.119985053999997, 2024-05-07T11:14:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:14:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:14:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:14:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:14:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:14:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:14:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:14:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:14:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:14:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:14:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:14:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:14:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:14:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:14:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:14:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:14:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:14:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:14:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:14:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:14:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:14:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:14:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:14:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 83.119937589000003, 2024-05-07T11:14:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:14:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:14:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:14:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:14:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:14:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:14:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:14:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:14:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:14:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:14:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:14:02.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:14:02.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:14:02.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:14:02.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:14:02.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:14:02.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:14:02.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:14:02.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:14:02.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:14:02.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:14:02.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:14:02.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:14:02.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:14:02.837 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.837 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.837 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.838 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.838 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:02.838 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.738025200999999, 2024-05-07T11:14:02.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:14:02.838 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.839 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.839 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.839 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:02.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:02.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:14:02.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:14:02.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:14:02.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:14:02.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:14:02.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:14:02.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:14:02.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:14:02.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:14:02.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:14:02.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:14:02.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:14:02.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:14:02.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:14:02.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:14:02.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:14:02.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:14:02.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:14:02.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:14:02.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:14:02.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:14:02.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:14:02.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:14:02.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:14:02.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:14:02.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:14:02.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:14:02.851 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.852 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.852 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.852 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.853 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:02.853 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.735830117000006, 2024-05-07T11:14:02.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:14:02.853 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.853 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.853 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.854 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:02.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:02.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:14:02.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:14:02.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:14:02.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:14:02.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:14:02.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:14:02.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:14:02.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:14:02.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:02.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:14:02.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:02.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:14:02.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:14:02.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:14:02.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:14:02.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:14:02.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:14:02.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:14:02.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:14:02.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.735601896999995, 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.865 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.735422767000003, 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.871 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:14:02.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:14:02.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:14:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:14:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:14:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.735362893000001, 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.735314720999995, 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:14:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.735286739000003, 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.735253728999993, 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.735159925000005, 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.735016482999995, 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:14:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:14:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.734831577999998, 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:14:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.734672508000003, 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.734229099000004, 2024-05-07T11:14:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:14:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:14:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.734203835000002, 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:02.928 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:02.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:02.930 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:02.929+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:03.031 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:03.031+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:03.044 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:03.044 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:03.044 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:03.045 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:03.054 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:03.131 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:03.131+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:03.159 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:03.159 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:03.159 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:03.159 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:03.159 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:03.168 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:03.232 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:03.232+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:03.263 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:03.274 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:03.274 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:03.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:03.274 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:03.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.274 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:03.274 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:03.274 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.229845599000001, 2024-05-07T11:14:03.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:14:03.274 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:14:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:14:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:14:03.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.229780879000003, 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:14:03.280 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:03.286 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.229683938999997, 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:03.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:14:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.229618600999999, 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:14:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:14:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:14:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:14:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.229591709000005, 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:14:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:14:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:14:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.229564131000004, 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:14:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:14:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:14:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:14:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.229528741999999, 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:14:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:14:03.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.229503135000002, 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:03.314 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:14:03.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:14:03.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:14:03.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.229473705000004, 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:03.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.227087730999997, 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:14:03.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:14:03.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.222829192000006, 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:14:03.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.222181188999997, 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.221535869999997, 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:14:03.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.221262306, 2024-05-07T11:14:03.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:14:03.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:14:03.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.343 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.220502302, 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.347 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.219917683000006, 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:03.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.351 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.216160873999996, 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.355 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.231144839999999, 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:14:03.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:03.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.228654395, 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:14:03.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:14:03.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:14:03.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.227918750000001, 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:03.366 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:03.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:03.371 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:03.373 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:03.374 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:03.372+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-05-07T11:14:03.409 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:03.409 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:03.428 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:03.428 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:03.461 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:03.461 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:03.474 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:03.473+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:03.492 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:03.492 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:03.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:03.585 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:03.585+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:03.648 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:03.648 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:03.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:03.697 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:03.697+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:03.777 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:03.776+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:03.802 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:03.802 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:03.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:03.877 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:03.877+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:03.923 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:03.924 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:03.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:03.979 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:03.978+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:04.036 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:04.036 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:04.044 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:04.080 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:04.080+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:04.149 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:04.149 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:04.157 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:04.181 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:04.181+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:04.269 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:04.270 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:04.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:04.282 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:04.282+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:04.382 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:04.382+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:04.383 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:04.383 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:04.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:04.484 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:04.483+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:04.496 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:04.496 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:04.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:04.585 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:04.584+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:04.616 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:04.617 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:04.625 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:04.709 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:04.709+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:04.771 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:04.771 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:04.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:04.821 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:04.821+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:04.887 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:04.887+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:04.927 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:04.927 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:04.935 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:04.994 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:04.994+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:05.043 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:05.044 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:05.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:05.096 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:05.095+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:05.156 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:05.156 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:05.165 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:05.197 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:05.196+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:05.299 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:05.299+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:05.311 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:05.311 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:05.319 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:05.402 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:05.402+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:05.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T11:14:05.438 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:05.438 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:05.447 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:05.476 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:05.503 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:05.503+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:05.592 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:05.592 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:05.601 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:05.606 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:05.606+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:05.632 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:05.632 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:05.650 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:05.651 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:05.668 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:05.668 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:05.707 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:05.707 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:05.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:05.707 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:05.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.707 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.663399240999993, 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:14:05.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:14:05.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:14:05.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.663334520999996, 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.714 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:05.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:14:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:14:05.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.663237581000004, 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.720 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:14:05.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:05.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:14:05.726 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.663172243000005, 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:14:05.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:14:05.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:14:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.663145350999997, 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:14:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:14:05.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:14:05.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.663117772999996, 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:14:05.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:14:05.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:14:05.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.663082384000006, 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:14:05.745 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.663056776999994, 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:14:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:14:05.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:05.754 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.663027346999996, 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.660641373000004, 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:05.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:05.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:14:05.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:14:05.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.656382833999999, 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.764 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.765 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:05.706+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:05.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:05.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.769 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.655734831000004, 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:14:05.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:14:05.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:14:05.773 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.655089512000004, 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.774 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.654815948000007, 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:14:05.778 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:14:05.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.782 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.654055944000007, 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:14:05.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.653471324999998, 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:14:05.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.790 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.649714516000003, 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:14:05.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:14:05.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.794 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 79.664698482000006, 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.662208036999999, 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.800 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:14:05.805 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.661472392, 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:05.806 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:14:05.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:14:05.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:05.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:14:05.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:14:05.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:05.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:14:05.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:14:05.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:05.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:05.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:05.813 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:05.814 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:05.815 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:05.815+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:05.916 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:05.916+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:05.921 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:14:05.921 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:05.931 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:06.018 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:06.018+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:06.038 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:06.038 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:14:06.038 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:14:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:06.047 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:06.119 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:06.119+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:06.196 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:14:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:14:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:14:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:14:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.429183072000001, 2024-05-07T11:14:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:14:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:14:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:14:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:14:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:14:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:14:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:14:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.762627916, 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:14:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:14:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.533020824000005, 2024-05-07T11:14:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:14:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:14:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:14:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.532345649999996, 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.531703828999994, 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:14:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.531235421000005, 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:14:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.528529899999995, 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.151213518999995, 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:14:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:14:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.151156744000005, 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:14:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.151128272999998, 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:14:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.151089479000007, 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.256 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.151046156000007, 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.262 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.151023605000006, 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.268 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.150999545000005, 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:06.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.274 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.150980584999999, 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:14:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:14:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:14:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.150953912999995, 2024-05-07T11:14:06.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:14:06.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:14:06.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.146449653000005, 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:06.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.144723126000002, 2024-05-07T11:14:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:14:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:14:06.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.292 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.144570791999996, 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.144517820000004, 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:06.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:14:06.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:14:06.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:14:06.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:06.301 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:06.303 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:06.303 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:06.302+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:06.396 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-05-07T11:14:06.402 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:06.402+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:06.415 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:06.415 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:06.415 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:06.415 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:06.424 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:06.504 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:06.503+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:06.529 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:06.529 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:06.529 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:06.529 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:06.529 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:06.538 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:06.605 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:06.605+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:06.687 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:06.687 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:06.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:06.688 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:06.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.688 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:06.688 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:06.688 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.738230477000002, 2024-05-07T11:14:06.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:14:06.689 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.689 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.689 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:06.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:06.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:06.690 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:14:06.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.690 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:06.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:06.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:06.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:14:06.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:14:06.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:14:06.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:14:06.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:14:06.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:14:06.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:14:06.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:14:06.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:14:06.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:14:06.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:14:06.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:14:06.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:14:06.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:14:06.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:14:06.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:14:06.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:14:06.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:14:06.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:14:06.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:14:06.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:14:06.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.700 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.701 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:06.701 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:06.701 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.414004590000005, 2024-05-07T11:14:06.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:14:06.701 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.702 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.702 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.702 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:06.702 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:06.702 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:06.702 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:14:06.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.703 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:06.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:06.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:06.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:14:06.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:14:06.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:14:06.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:14:06.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:14:06.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:14:06.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:14:06.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:14:06.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:14:06.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:14:06.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:14:06.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:14:06.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:14:06.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:14:06.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:14:06.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:14:06.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:14:06.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:14:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:14:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:14:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:14:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.253529190999998, 2024-05-07T11:14:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:14:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:06.716 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:14:06.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.716 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:06.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:06.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:06.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:14:06.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:14:06.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:14:06.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:14:06.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:14:06.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:14:06.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:14:06.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:14:06.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:14:06.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:14:06.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:14:06.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:14:06.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:14:06.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:14:06.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:14:06.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:14:06.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:14:06.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:14:06.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:14:06.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:14:06.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:14:06.726 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.727 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.727 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.727 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:06.727 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:06.728 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.253442823, 2024-05-07T11:14:06.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:14:06.728 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.728 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.728 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.729 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:06.729 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:06.729 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:06.729 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:14:06.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.729 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:06.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:06.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:14:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:14:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:14:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:14:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.024295390000006, 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.024247924999997, 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.642335536999994, 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:14:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:14:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:14:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:14:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.640140453000001, 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:14:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.639912233000004, 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:14:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:14:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:14:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:14:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:14:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.639733102999998, 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.639673228999996, 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:14:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:14:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:14:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:14:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.639625057000003, 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:14:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:14:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:14:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.639597074999998, 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.639564065000002, 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:14:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.639470261, 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.639326819000004, 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:14:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:14:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:14:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:14:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.639141914000007, 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.638982843999997, 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.638539434999998, 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:14:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:14:06.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:14:06.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.638514170999997, 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:14:06.819 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:06.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:06.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:14:06.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:14:06.823 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.823 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.823 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.823 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:06.823 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:06.823 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:06.824 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:06.825 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:06.824+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:06.926 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:06.925+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:06.941 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:06.942 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:06.942 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:06.942 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:06.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:07.034 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:07.034+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:07.097 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:07.097 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:07.097 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:07.097 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:07.097 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:07.106 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:07.127 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:07.127+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:07.229 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:07.228+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:07.253 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:07.253 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:07.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:07.253 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:07.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.253 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.253 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:07.253 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.208467322999994, 2024-05-07T11:14:07.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:14:07.254 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.254 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.254 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.254 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:07.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:14:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:14:07.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:14:07.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:14:07.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:14:07.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:07.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:14:07.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:14:07.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:14:07.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:14:07.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:07.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:14:07.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:14:07.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:14:07.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.208402602999996, 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.262 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.263 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.263 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.208305663000004, 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.270 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:07.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:14:07.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:14:07.276 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.276 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.276 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.276 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.276 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:07.276 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.208240325000006, 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:14:07.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:14:07.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:14:07.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:14:07.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:14:07.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:14:07.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:14:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:14:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:14:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:07.284 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.208213432999997, 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:14:07.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:14:07.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:14:07.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:07.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:14:07.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:14:07.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:14:07.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:07.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.208185854999996, 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.291 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:14:07.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:14:07.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.297 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.208150466000006, 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.208124858999994, 2024-05-07T11:14:07.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:14:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:14:07.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:14:07.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:14:07.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:14:07.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.306 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.208095428999997, 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.310 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.205709455000004, 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.201450915999999, 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:07.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:14:07.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:14:07.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.200802913000004, 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:14:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:07.322 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.200157594000004, 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:14:07.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:14:07.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.326 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.199884030000007, 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.199124026000007, 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:14:07.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:14:07.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.198539406999998, 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 83.194782598000003, 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:07.338 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:14:07.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.209766564000006, 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.207276118999999, 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.347 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:14:07.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:14:07.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:14:07.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:14:07.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.206540474000001, 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:14:07.352 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:07.357 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:07.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:07.359 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:07.358+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:07.406 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:14:07.406 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:14:07.406 INFO:tasks.thrashosds.thrasher:Reweighting osd 0 to 0.3977440452529267 2024-05-07T11:14:07.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 0.3977440452529267 2024-05-07T11:14:07.460 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:07.459+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:07.473 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:07.474 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:07.474 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:14:07.474 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:07.483 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:07.561 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:07.561+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:07.588 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:07.588 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:07.588 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:14:07.588 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:14:07.588 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:07.597 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:07.662 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:07.662+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:07.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:07.704 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:14:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:14:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:14:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:14:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.937569897000003, 2024-05-07T11:14:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:14:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:14:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:14:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:14:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:14:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:14:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:14:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:14:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:14:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:14:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:14:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:14:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:14:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:14:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:14:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:14:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:14:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:14:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.271014741000002, 2024-05-07T11:14:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:14:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:14:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:14:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:14:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:14:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:14:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:14:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:14:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.041407649000007, 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:14:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:14:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:14:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:14:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:14:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:14:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:14:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:14:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:14:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.040732474999999, 2024-05-07T11:14:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:14:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:14:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:14:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:14:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:14:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:14:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:14:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:14:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:14:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.040090653999997, 2024-05-07T11:14:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:14:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:14:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:14:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.039622245999993, 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:14:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.036916724999998, 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.659600343999998, 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:14:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:14:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:14:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.659543568999993, 2024-05-07T11:14:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:14:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.659515098, 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:14:07.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:14:07.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:14:07.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.761 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.659476303999995, 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:14:07.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:14:07.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.659432980999995, 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:14:07.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:07.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:14:07.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.773 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.659410429999994, 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:14:07.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:14:07.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:14:07.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:14:07.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.659386369999993, 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:14:07.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:14:07.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:07.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.785 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.659367410000002, 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:07.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:07.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.659340737999997, 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.792 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:14:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:14:07.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:14:07.797 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.797 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.797 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.797 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:07.797 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:07.797 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.654836477999993, 2024-05-07T11:14:07.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:14:07.797 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:14:07.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:14:07.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.653109951000005, 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.652957616999998, 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.810 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.652904645000007, 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:14:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:14:07.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:14:07.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:14:07.815 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.815 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.815 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.815 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:07.815 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:07.815 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:07.816 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:07.817 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:07.816+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:07.836 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:07.836 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:07.855 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:07.855 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:07.873 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:07.873 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:07.917 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:07.917+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:07.934 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:07.934 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:07.944 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:08.018 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:08.018+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:08.090 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:08.090 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:08.100 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:08.119 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:08.119+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:08.205 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:08.206 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:08.215 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:08.260 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:08.260+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:08.321 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:08.320+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:08.333 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:08.333 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:08.342 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:08.407 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.0 to 0.397744 (65d2) 2024-05-07T11:14:08.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T11:14:08.426 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:08.426+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:08.492 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:08.493 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:08.501 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:08.522 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:08.522+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:08.623 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:08.623+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:08.647 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:08.647 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:08.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:08.724 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:08.724+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:08.768 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:08.769 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:08.778 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:08.825 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:08.825+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:08.923 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:08.923 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:08.926 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:08.926+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:08.932 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:09.027 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:09.027+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:09.038 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:09.038 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:09.047 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:09.128 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:09.128+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:09.158 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:09.159 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:09.167 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:09.251 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:09.251+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:09.312 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:09.312 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:09.322 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:09.362 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:09.362+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:09.414 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-05-07T11:14:09.432 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:09.431+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:09.473 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:09.474 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:09.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:09.532 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:09.532+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:09.591 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:09.591 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:09.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:09.643 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:09.643+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:09.704 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:09.705 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:09.713 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:09.734 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:09.734+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:09.835 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:09.835+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:09.856 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:09.856 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:09.865 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:09.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:09.935 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:09.935+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:09.973 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:09.973 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:09.981 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:10.012 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:10.013 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:10.031 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:10.031 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:10.049 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:10.049 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:10.065 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:10.065+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:10.128 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:14:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:14:10.128 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:10.137 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:10.137 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:10.136+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:10.237 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:10.237+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:10.285 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:10.285 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:14:10.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:14:10.285 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:14:10.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.285 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.518431582999995, 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 90.851876426999993, 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 90.622269334999999, 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.294 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:14:10.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:14:10.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 90.621594161000004, 2024-05-07T11:14:10.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.302 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 90.620952340000002, 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:14:10.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:14:10.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:14:10.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 90.620483931999999, 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 90.617778411000003, 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:14:10.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:14:10.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.315 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.317 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:10.317 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.240462030000003, 2024-05-07T11:14:10.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:14:10.317 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.317 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.317 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.317 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:14:10.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:14:10.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:14:10.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:14:10.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.240405254999999, 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.328 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.240376784000006, 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:10.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:10.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:14:10.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.24033799, 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:14:10.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.240294667000001, 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.346 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.240272116, 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:10.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:14:10.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:14:10.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:14:10.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:10.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.240248055999999, 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:14:10.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:14:10.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:14:10.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.240229095999993, 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:14:10.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:14:10.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:14:10.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.240202424000003, 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.363 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.235698163999999, 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.233971636999996, 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:14:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:14:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:14:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.233819303000004, 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:14:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 86.233766330999998, 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:14:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:14:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:10.384 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:10.386 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:10.386 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:10.385+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:10.486 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:10.486+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:10.495 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:10.495 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:10.503 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:10.588 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:10.587+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:10.607 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:10.608 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:10.608 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:10.608 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:10.608 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:10.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:10.689 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:10.688+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:10.764 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:10.764 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:10.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:10.764 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:10.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.765 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:10.765 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:10.765 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.815099735999993, 2024-05-07T11:14:10.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:14:10.765 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.765 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.765 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.765 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:10.765 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:10.766 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:10.766 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:14:10.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.766 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:10.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:10.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:10.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:14:10.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:14:10.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:14:10.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:14:10.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:14:10.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:14:10.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:14:10.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:14:10.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:14:10.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:14:10.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:14:10.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:14:10.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:14:10.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:14:10.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:14:10.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:14:10.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:14:10.773 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.773 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.773 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.774 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:10.774 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:10.774 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.490873848999996, 2024-05-07T11:14:10.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:14:10.774 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.774 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.774 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.774 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:10.775 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:10.775 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:10.775 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:14:10.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.775 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:10.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:14:10.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:14:10.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:14:10.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:14:10.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:14:10.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:14:10.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:14:10.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:14:10.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:14:10.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:14:10.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:14:10.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:14:10.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.330398450000004, 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:14:10.782 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:14:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:14:10.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.330312082000006, 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.788 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:14:10.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:14:10.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:14:10.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:14:10.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:14:10.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:14:10.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:14:10.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:14:10.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.101164648999998, 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:14:10.795 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:10.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:14:10.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:14:10.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:14:10.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:14:10.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:14:10.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:14:10.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:14:10.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:14:10.803 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.804 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.804 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.804 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.101117184000003, 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:14:10.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:14:10.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:14:10.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:14:10.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:14:10.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:14:10.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:14:10.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:14:10.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:14:10.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:14:10.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.812 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.719204796, 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:14:10.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:14:10.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:14:10.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:14:10.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:14:10.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:14:10.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:14:10.819 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.819 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.819 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.717009712000007, 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:14:10.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.716781491999996, 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.831 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.716602362000003, 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:10.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:14:10.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:14:10.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:14:10.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:14:10.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.716542488000002, 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.837 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:14:10.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:14:10.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.716494315999995, 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:14:10.842 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.716466334000003, 2024-05-07T11:14:10.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:14:10.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:14:10.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:14:10.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:14:10.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:14:10.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:14:10.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:14:10.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:14:10.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.716433323999993, 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.853 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:14:10.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:14:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:14:10.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:14:10.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.716339520000005, 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:14:10.858 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.716196077999996, 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.864 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:14:10.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:14:10.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:14:10.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:14:10.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.869 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.716011172999998, 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.715852103000003, 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.875 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:14:10.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:14:10.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:14:10.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.715408694000004, 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:14:10.880 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:14:10.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:14:10.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:14:10.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.885 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.715383430000003, 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:10.889 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:10.891 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:10.892 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:10.890+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:10.991 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:10.991+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:11.008 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:11.009 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:11.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:11.092 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:11.092+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:11.124 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:11.124 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:11.124 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:11.124 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:11.124 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:11.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:11.193 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:11.193+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:11.240 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:11.240 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:11.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:11.240 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:11.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.240 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.196153754999997, 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.246 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.196089035, 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:11.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:14:11.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:14:11.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.195992094999994, 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:14:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.258 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.195926756999995, 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:11.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:14:11.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:14:11.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:14:11.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.195899865000001, 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:14:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:14:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:14:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:14:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.195872287, 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.270 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:14:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:14:11.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:14:11.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.195836897999996, 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:14:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.195811290999998, 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.195781861, 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:11.283 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:14:11.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:14:11.286 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.193395886999994, 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:14:11.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:14:11.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.189137348000003, 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:14:11.290 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:11.294 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.188489344999994, 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:11.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:14:11.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:14:11.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.187844025999993, 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.302 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.187570461999996, 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.186810457999997, 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.186225839000002, 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.182469029999993, 2024-05-07T11:14:11.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 85.197452995999996, 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:14:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:14:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:14:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:14:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.194962551000003, 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:14:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 57.194226905999997, 2024-05-07T11:14:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:11.333 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:11.335 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:11.335 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:11.334+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:11.433 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:14:11.435 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:11.435+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:11.452 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:14:11.453 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:11.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:11.535 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:11.535+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:11.568 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:11.568 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:11.568 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:14:11.568 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:14:11.568 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:11.577 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:11.636 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:11.636+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:11.684 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:11.684 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:14:11.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:14:11.684 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:14:11.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.917457184, 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:14:11.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:14:11.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.250902027999999, 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:14:11.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:14:11.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:14:11.693 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.021294936000004, 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.697 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.020619761999995, 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:14:11.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:14:11.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.019977940999993, 2024-05-07T11:14:11.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:14:11.706 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.019509533000004, 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:14:11.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.710 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.016804011999994, 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:14:11.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.639487630999994, 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:14:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:14:11.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.639430856000004, 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:14:11.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:14:11.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:14:11.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.639402384999997, 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.733 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.639363591000006, 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:14:11.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.639320268000006, 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:14:11.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:14:11.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:14:11.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.639297717000005, 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.751 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.753 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.639273657000004, 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:11.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.639254696999998, 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:14:11.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:14:11.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:14:11.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.639228024999994, 2024-05-07T11:14:11.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:14:11.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:14:11.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:14:11.768 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.634723765000004, 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:14:11.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:11.773 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.632997238000002, 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:11.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:14:11.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:14:11.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.632844903999995, 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:14:11.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:14:11.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:14:11.781 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.632791932000003, 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:11.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:11.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:14:11.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:14:11.786 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.786 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.786 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.786 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:11.786 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:11.786 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:11.788 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:11.788 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:11.787+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:11.888 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:11.888+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:11.898 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:11.898 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:11.899 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:11.899 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:11.907 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:11.989 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:11.989+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:12.012 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:12.012 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:12.012 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:12.012 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:12.012 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:12.021 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:12.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:12.090 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:12.089+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:12.128 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 93.180381088000004, 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:14:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:14:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 92.856155201000007, 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:14:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:14:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:14:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:14:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 92.695679802000001, 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:14:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:14:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 92.695593434000003, 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:14:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:14:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 92.466446000999994, 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:14:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:14:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:14:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:14:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:14:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:14:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:14:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:14:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:14:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 92.466398536, 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:14:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:14:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:14:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:14:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.084486147999996, 2024-05-07T11:14:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:14:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:14:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:14:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:14:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.082291064000003, 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:14:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:14:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:14:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:14:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:14:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:14:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.082062844000006, 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:14:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:14:12.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:14:12.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:14:12.184 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.184 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.184 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.184 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.081883714, 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:12.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:14:12.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:14:12.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:12.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:14:12.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.081823839999998, 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:12.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:12.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:14:12.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:14:12.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:14:12.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:14:12.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:14:12.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:14:12.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.081775668000006, 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:14:12.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:14:12.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:14:12.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:14:12.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:14:12.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:14:12.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.203 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.081747686, 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:14:12.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.081714676000004, 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.209 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:14:12.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:14:12.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.214 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.081620872000002, 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:12.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:14:12.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.220 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.081477430000007, 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:12.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.226 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.081292524999995, 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:12.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:14:12.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:14:12.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:14:12.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:14:12.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.081133455, 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:14:12.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.080690046000001, 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:12.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:14:12.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:14:12.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:14:12.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.080664781999999, 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:14:12.242 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:12.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:14:12.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:14:12.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:14:12.246 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.246 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.246 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.246 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:12.246 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:12.246 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:12.247 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:12.248 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:12.248 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:12.248 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:12.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:12.249 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:12.247+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:12.270 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:12.271 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:12.349 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:12.348+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:12.366 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:12.366 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:12.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:12.429 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:14:12.449 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:12.448+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:12.483 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:12.483 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:12.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:12.549 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:12.549+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:12.636 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:12.636 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:12.646 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:12.650 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:12.649+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:12.750 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:12.750+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:12.757 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:12.757 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:12.766 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:12.851 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:12.851+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:12.871 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:12.871 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:12.881 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:12.952 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:12.952+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:13.025 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:13.026 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:13.034 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:13.053 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:13.053+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:13.143 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:13.143 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:13.156 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:13.156+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:13.157 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:13.256 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:13.256+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:13.263 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:13.263 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:13.272 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:13.357 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:13.357+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:13.417 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:13.417 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:13.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:13.429 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:14:13.429 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:14:13.430 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-05-07T11:14:13.430 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-07T11:14:13.466 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:13.466+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:13.539 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:13.540 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:13.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:13.559 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:13.559+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:13.654 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:13.655 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:13.660 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:13.660+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:13.663 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:13.761 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:13.761+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:13.768 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:13.768 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:13.778 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:13.862 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:13.862+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:13.886 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:13.886 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:13.895 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:13.963 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:13.963+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:14:13.988 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:14:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 48, 2024-05-07T11:14:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "712a8431-2ac1-4386-a81f-c899bab82549", 2024-05-07T11:14:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-05-07T11:12:28.567931+0000", 2024-05-07T11:14:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-05-07T11:14:12.423031+0000", 2024-05-07T11:14:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-05-07T11:12:36.689723+0000", 2024-05-07T11:14:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-05-07T11:12:29.411691+0000", 2024-05-07T11:14:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-07T11:14:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5804032, 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "nodeep-scrub", 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 4, 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-05-07T11:14:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "luminous", 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:36.979175+0000", 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:14:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:14:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:14:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:14:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:14:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:14:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:14:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:14:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-05-07T11:14:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-05-07T11:14:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-05-07T11:14:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:14:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:14:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:14:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:14:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:14:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:14:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:14:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:14:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:14:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:14:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:14:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:14:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.9900000095367432, 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.9900000095367432, 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 2, 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 2, 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:14:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:37.110970+0000", 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:14:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:14:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:14:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:14:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:14:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:14:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-05-07T11:14:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-05-07T11:14:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-05-07T11:14:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-05-07T11:14:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:14:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:14:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:14:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:14:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:14:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:14:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:14:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:14:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:14:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-05-07T11:14:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.5, 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.5, 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:41.627365+0000", 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:14:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:14:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-05-07T11:14:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-05-07T11:14:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-05-07T11:14:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-05-07T11:14:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-05-07T11:14:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:14:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:14:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "14", 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:14:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:14:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:14:14.009 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:14:14.009 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:14:14.009 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:14:14.009 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:14:14.010 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:14:14.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.010 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:14:14.010 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:14:14.010 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:14:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:14:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:14:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:14:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:14:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:14:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:14:14.012 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:14:14.012 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:14:14.012 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:14:14.012 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.5900000333786011, 2024-05-07T11:14:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.5900000333786011, 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5900000333786011, 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5900000333786011, 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-05-07T11:12:42.384664+0000", 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-05-07T11:14:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-05-07T11:14:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-05-07T11:14:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-05-07T11:14:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-05-07T11:14:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-05-07T11:14:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-05-07T11:14:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-05-07T11:14:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-05-07T11:14:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-05-07T11:14:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-05-07T11:14:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-05-07T11:14:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-05-07T11:14:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-05-07T11:14:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-05-07T11:14:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T11:14:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T11:14:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T11:14:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-05-07T11:14:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.8300000429153442, 2024-05-07T11:14:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.8300000429153442, 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.8300000429153442, 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.8300000429153442, 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.9276275634765625, 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.93000000715255737, 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.93000000715255737 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cd7246e2-0069-4df7-a669-4abe038a28ad", 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:14:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 0.397735595703125, 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 24, 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6800", 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6801", 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6802", 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6803", 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6806", 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6807", 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6804", 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.027 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.88:6805", 2024-05-07T11:14:14.027 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1378788154 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.88:6801/1378788154", 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.88:6803/1378788154", 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.88:6807/1378788154", 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.88:6805/1378788154", 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "7df5bb74-60c0-4a46-a3d1-494f777a4f88", 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 46, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:14:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6800", 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6801", 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6802", 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6803", 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6806", 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6807", 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6804", 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.149:6805", 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3051775179 2024-05-07T11:14:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.149:6801/3051775179", 2024-05-07T11:14:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.149:6803/3051775179", 2024-05-07T11:14:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.149:6807/3051775179", 2024-05-07T11:14:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.149:6805/3051775179", 2024-05-07T11:14:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:14:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:14:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "ebed6b16-fba7-4b8a-a78e-1f84a500c31f", 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 0.7828826904296875, 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-05-07T11:14:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-05-07T11:14:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-05-07T11:14:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 46, 2024-05-07T11:14:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-05-07T11:14:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-05-07T11:14:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-05-07T11:14:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6800", 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6801", 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6802", 2024-05-07T11:14:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6803", 2024-05-07T11:14:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6806", 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6807", 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6804", 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.175:6805", 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2659225388 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.175:6801/2659225388", 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.175:6803/2659225388", 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.175:6807/2659225388", 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.175:6805/2659225388", 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.430581+0000", 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:14:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.433407+0000", 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540701547738038271, 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-05-07T11:12:34.440186+0000", 2024-05-07T11:14:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [ 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.7", 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: 2, 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: 1 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.0", 2024-05-07T11:14:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: 2, 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: 0 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-05-07T11:14:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-05-07T11:14:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-05-07T11:14:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-05-07T11:14:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-05-07T11:14:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-05-07T11:14:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-05-07T11:14:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-05-07T11:14:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-07T11:14:14.047 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:14:14.048 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:14.049 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:14.049 INFO:tasks.thrashosds.thrasher:j is {'epoch': 48, 'fsid': '712a8431-2ac1-4386-a81f-c899bab82549', 'created': '2024-05-07T11:12:28.567931+0000', 'modified': '2024-05-07T11:14:12.423031+0000', 'last_up_change': '2024-05-07T11:12:36.689723+0000', 'last_in_change': '2024-05-07T11:12:29.411691+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-07T11:12:41.627365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.590000033378601, 'score_stable': 1.590000033378601, 'optimal_score': 1, 'raw_score_acting': 1.590000033378601, 'raw_score_stable': 1.590000033378601, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-05-07T11:12:42.384664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8300000429153442, 'score_stable': 1.8300000429153442, 'optimal_score': 1, 'raw_score_acting': 1.8300000429153442, 'raw_score_stable': 1.8300000429153442, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}], 'osds': [{'osd': 0, 'uuid': 'cd7246e2-0069-4df7-a669-4abe038a28ad', 'up': 1, 'in': 1, 'weight': 0.397735595703125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6800', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6801', 'nonce': 1378788154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6802', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6803', 'nonce': 1378788154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6806', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6807', 'nonce': 1378788154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6804', 'nonce': 1378788154}, {'type': 'v1', 'addr': '172.21.15.88:6805', 'nonce': 1378788154}]}, 'public_addr': '172.21.15.88:6801/1378788154', 'cluster_addr': '172.21.15.88:6803/1378788154', 'heartbeat_back_addr': '172.21.15.88:6807/1378788154', 'heartbeat_front_addr': '172.21.15.88:6805/1378788154', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7df5bb74-60c0-4a46-a3d1-494f777a4f88', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 3051775179}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 3051775179}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 3051775179}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 3051775179}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 3051775179}]}, 'public_addr': '172.21.15.149:6801/3051775179', 'cluster_addr': '172.21.15.149:6803/3051775179', 'heartbeat_back_addr': '172.21.15.149:6807/3051775179', 'heartbeat_front_addr': '172.21.15.149:6805/3051775179', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'ebed6b16-fba7-4b8a-a78e-1f84a500c31f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7828826904296875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6800', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6801', 'nonce': 2659225388}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6802', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6803', 'nonce': 2659225388}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6806', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6807', 'nonce': 2659225388}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6804', 'nonce': 2659225388}, {'type': 'v1', 'addr': '172.21.15.175:6805', 'nonce': 2659225388}]}, 'public_addr': '172.21.15.175:6801/2659225388', 'cluster_addr': '172.21.15.175:6803/2659225388', 'heartbeat_back_addr': '172.21.15.175:6807/2659225388', 'heartbeat_front_addr': '172.21.15.175:6805/2659225388', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.430581+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.433407+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T11:12:34.440186+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.7', 'osds': [2, 1]}, {'pgid': '4.0', 'osds': [2, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-07T11:14:14.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:14:14.050 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:14.064 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:14.064+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:14.154 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:14.154 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:14.163 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:14.164 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:14.164+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:14.265 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:14.265+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:14.272 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:14.273 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:14.282 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:14.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:14.366 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:14.366+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:14.387 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:14.387 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:14.396 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:14.433 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:14:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:14:14.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T11:14:14.454 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-05-07T11:14:12.953981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90724,"kb_used_data":1336,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024796,"statfs":{"total":289910292480,"available":289817391104,"internally_reserved":0,"allocated":1368064,"data_stored":1745707,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000981"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":81,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.423903+0000","last_change":"2024-05-07T11:14:09.423903+0000","last_active":"2024-05-07T11:14:09.423903+0000","last_peered":"2024-05-07T11:14:09.423903+0000","last_clean":"2024-05-07T11:14:09.423903+0000","last_became_active":"2024-05-07T11:14:09.423551+0000","last_became_peered":"2024-05-07T11:14:09.423551+0000","last_unstale":"2024-05-07T11:14:09.423903+0000","last_undegraded":"2024-05-07T11:14:09.423903+0000","last_fullsized":"2024-05-07T11:14:09.423903+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:06.122173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.418862+0000","last_change":"2024-05-07T11:12:44.053490+0000","last_active":"2024-05-07T11:14:09.418862+0000","last_peered":"2024-05-07T11:14:09.418862+0000","last_clean":"2024-05-07T11:14:09.418862+0000","last_became_active":"2024-05-07T11:12:44.052560+0000","last_became_peered":"2024-05-07T11:12:44.052560+0000","last_unstale":"2024-05-07T11:14:09.418862+0000","last_undegraded":"2024-05-07T11:14:09.418862+0000","last_fullsized":"2024-05-07T11:14:09.418862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:47:06.843557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":74,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425603+0000","last_change":"2024-05-07T11:12:44.059244+0000","last_active":"2024-05-07T11:14:09.425603+0000","last_peered":"2024-05-07T11:14:09.425603+0000","last_clean":"2024-05-07T11:14:09.425603+0000","last_became_active":"2024-05-07T11:12:44.057950+0000","last_became_peered":"2024-05-07T11:12:44.057950+0000","last_unstale":"2024-05-07T11:14:09.425603+0000","last_undegraded":"2024-05-07T11:14:09.425603+0000","last_fullsized":"2024-05-07T11:14:09.425603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":74,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425265+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:14:09.425265+0000","last_peered":"2024-05-07T11:14:09.425265+0000","last_clean":"2024-05-07T11:14:09.425265+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:14:09.425265+0000","last_undegraded":"2024-05-07T11:14:09.425265+0000","last_fullsized":"2024-05-07T11:14:09.425265+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.418067+0000","last_change":"2024-05-07T11:12:44.048014+0000","last_active":"2024-05-07T11:14:09.418067+0000","last_peered":"2024-05-07T11:14:09.418067+0000","last_clean":"2024-05-07T11:14:09.418067+0000","last_became_active":"2024-05-07T11:12:44.047252+0000","last_became_peered":"2024-05-07T11:12:44.047252+0000","last_unstale":"2024-05-07T11:14:09.418067+0000","last_undegraded":"2024-05-07T11:14:09.418067+0000","last_fullsized":"2024-05-07T11:14:09.418067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.432221+0000","last_change":"2024-05-07T11:14:09.429143+0000","last_active":"2024-05-07T11:14:09.432221+0000","last_peered":"2024-05-07T11:14:09.432221+0000","last_clean":"2024-05-07T11:14:09.432221+0000","last_became_active":"2024-05-07T11:14:09.428836+0000","last_became_peered":"2024-05-07T11:14:09.428836+0000","last_unstale":"2024-05-07T11:14:09.432221+0000","last_undegraded":"2024-05-07T11:14:09.432221+0000","last_fullsized":"2024-05-07T11:14:09.432221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:57.680470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":55,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420029+0000","last_change":"2024-05-07T11:13:25.248071+0000","last_active":"2024-05-07T11:14:09.420029+0000","last_peered":"2024-05-07T11:14:09.420029+0000","last_clean":"2024-05-07T11:14:09.420029+0000","last_became_active":"2024-05-07T11:13:25.247861+0000","last_became_peered":"2024-05-07T11:13:25.247861+0000","last_unstale":"2024-05-07T11:14:09.420029+0000","last_undegraded":"2024-05-07T11:14:09.420029+0000","last_fullsized":"2024-05-07T11:14:09.420029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.057596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":79,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.435333+0000","last_change":"2024-05-07T11:14:09.435333+0000","last_active":"2024-05-07T11:14:09.435333+0000","last_peered":"2024-05-07T11:14:09.435333+0000","last_clean":"2024-05-07T11:14:09.435333+0000","last_became_active":"2024-05-07T11:14:09.434707+0000","last_became_peered":"2024-05-07T11:14:09.434707+0000","last_unstale":"2024-05-07T11:14:09.435333+0000","last_undegraded":"2024-05-07T11:14:09.435333+0000","last_fullsized":"2024-05-07T11:14:09.435333+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:33:00.458931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.429405+0000","last_change":"2024-05-07T11:14:09.423805+0000","last_active":"2024-05-07T11:14:09.429405+0000","last_peered":"2024-05-07T11:14:09.429405+0000","last_clean":"2024-05-07T11:14:09.429405+0000","last_became_active":"2024-05-07T11:14:09.423481+0000","last_became_peered":"2024-05-07T11:14:09.423481+0000","last_unstale":"2024-05-07T11:14:09.429405+0000","last_undegraded":"2024-05-07T11:14:09.429405+0000","last_fullsized":"2024-05-07T11:14:09.429405+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:09:16.230602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":81,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.428752+0000","last_change":"2024-05-07T11:14:09.428752+0000","last_active":"2024-05-07T11:14:09.428752+0000","last_peered":"2024-05-07T11:14:09.428752+0000","last_clean":"2024-05-07T11:14:09.428752+0000","last_became_active":"2024-05-07T11:14:09.428366+0000","last_became_peered":"2024-05-07T11:14:09.428366+0000","last_unstale":"2024-05-07T11:14:09.428752+0000","last_undegraded":"2024-05-07T11:14:09.428752+0000","last_fullsized":"2024-05-07T11:14:09.428752+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:22:14.270696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.433104+0000","last_change":"2024-05-07T11:14:09.430454+0000","last_active":"2024-05-07T11:14:09.433104+0000","last_peered":"2024-05-07T11:14:09.433104+0000","last_clean":"2024-05-07T11:14:09.433104+0000","last_became_active":"2024-05-07T11:14:09.430169+0000","last_became_peered":"2024-05-07T11:14:09.430169+0000","last_unstale":"2024-05-07T11:14:09.433104+0000","last_undegraded":"2024-05-07T11:14:09.433104+0000","last_fullsized":"2024-05-07T11:14:09.433104+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:35.908685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.419227+0000","last_change":"2024-05-07T11:12:44.055388+0000","last_active":"2024-05-07T11:14:09.419227+0000","last_peered":"2024-05-07T11:14:09.419227+0000","last_clean":"2024-05-07T11:14:09.419227+0000","last_became_active":"2024-05-07T11:12:44.055025+0000","last_became_peered":"2024-05-07T11:12:44.055025+0000","last_unstale":"2024-05-07T11:14:09.419227+0000","last_undegraded":"2024-05-07T11:14:09.419227+0000","last_fullsized":"2024-05-07T11:14:09.419227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:16.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":81,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.423825+0000","last_change":"2024-05-07T11:14:09.423825+0000","last_active":"2024-05-07T11:14:09.423825+0000","last_peered":"2024-05-07T11:14:09.423825+0000","last_clean":"2024-05-07T11:14:09.423825+0000","last_became_active":"2024-05-07T11:14:09.423449+0000","last_became_peered":"2024-05-07T11:14:09.423449+0000","last_unstale":"2024-05-07T11:14:09.423825+0000","last_undegraded":"2024-05-07T11:14:09.423825+0000","last_fullsized":"2024-05-07T11:14:09.423825+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:26.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":74,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425333+0000","last_change":"2024-05-07T11:12:44.058315+0000","last_active":"2024-05-07T11:14:09.425333+0000","last_peered":"2024-05-07T11:14:09.425333+0000","last_clean":"2024-05-07T11:14:09.425333+0000","last_became_active":"2024-05-07T11:12:44.056718+0000","last_became_peered":"2024-05-07T11:12:44.056718+0000","last_unstale":"2024-05-07T11:14:09.425333+0000","last_undegraded":"2024-05-07T11:14:09.425333+0000","last_fullsized":"2024-05-07T11:14:09.425333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:20.505178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":74,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425253+0000","last_change":"2024-05-07T11:12:44.057212+0000","last_active":"2024-05-07T11:14:09.425253+0000","last_peered":"2024-05-07T11:14:09.425253+0000","last_clean":"2024-05-07T11:14:09.425253+0000","last_became_active":"2024-05-07T11:12:44.055956+0000","last_became_peered":"2024-05-07T11:12:44.055956+0000","last_unstale":"2024-05-07T11:14:09.425253+0000","last_undegraded":"2024-05-07T11:14:09.425253+0000","last_fullsized":"2024-05-07T11:14:09.425253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.433322+0000","last_change":"2024-05-07T11:14:09.431960+0000","last_active":"2024-05-07T11:14:09.433322+0000","last_peered":"2024-05-07T11:14:09.433322+0000","last_clean":"2024-05-07T11:14:09.433322+0000","last_became_active":"2024-05-07T11:14:09.431499+0000","last_became_peered":"2024-05-07T11:14:09.431499+0000","last_unstale":"2024-05-07T11:14:09.433322+0000","last_undegraded":"2024-05-07T11:14:09.433322+0000","last_fullsized":"2024-05-07T11:14:09.433322+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:47:47.159358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.421417+0000","last_change":"2024-05-07T11:12:44.052592+0000","last_active":"2024-05-07T11:14:09.421417+0000","last_peered":"2024-05-07T11:14:09.421417+0000","last_clean":"2024-05-07T11:14:09.421417+0000","last_became_active":"2024-05-07T11:12:44.051220+0000","last_became_peered":"2024-05-07T11:12:44.051220+0000","last_unstale":"2024-05-07T11:14:09.421417+0000","last_undegraded":"2024-05-07T11:14:09.421417+0000","last_fullsized":"2024-05-07T11:14:09.421417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420036+0000","last_change":"2024-05-07T11:12:44.053032+0000","last_active":"2024-05-07T11:14:09.420036+0000","last_peered":"2024-05-07T11:14:09.420036+0000","last_clean":"2024-05-07T11:14:09.420036+0000","last_became_active":"2024-05-07T11:12:44.051396+0000","last_became_peered":"2024-05-07T11:12:44.051396+0000","last_unstale":"2024-05-07T11:14:09.420036+0000","last_undegraded":"2024-05-07T11:14:09.420036+0000","last_fullsized":"2024-05-07T11:14:09.420036+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.429702+0000","last_change":"2024-05-07T11:14:09.427503+0000","last_active":"2024-05-07T11:14:09.429702+0000","last_peered":"2024-05-07T11:14:09.429702+0000","last_clean":"2024-05-07T11:14:09.429702+0000","last_became_active":"2024-05-07T11:14:09.427160+0000","last_became_peered":"2024-05-07T11:14:09.427160+0000","last_unstale":"2024-05-07T11:14:09.429702+0000","last_undegraded":"2024-05-07T11:14:09.429702+0000","last_fullsized":"2024-05-07T11:14:09.429702+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:04:14.309796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":79,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.432443+0000","last_change":"2024-05-07T11:14:09.432443+0000","last_active":"2024-05-07T11:14:09.432443+0000","last_peered":"2024-05-07T11:14:09.432443+0000","last_clean":"2024-05-07T11:14:09.432443+0000","last_became_active":"2024-05-07T11:14:09.432149+0000","last_became_peered":"2024-05-07T11:14:09.432149+0000","last_unstale":"2024-05-07T11:14:09.432443+0000","last_undegraded":"2024-05-07T11:14:09.432443+0000","last_fullsized":"2024-05-07T11:14:09.432443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:12:57.059348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":74,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.426684+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:14:09.426684+0000","last_peered":"2024-05-07T11:14:09.426684+0000","last_clean":"2024-05-07T11:14:09.426684+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:14:09.426684+0000","last_undegraded":"2024-05-07T11:14:09.426684+0000","last_fullsized":"2024-05-07T11:14:09.426684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.417920+0000","last_change":"2024-05-07T11:12:44.053864+0000","last_active":"2024-05-07T11:14:09.417920+0000","last_peered":"2024-05-07T11:14:09.417920+0000","last_clean":"2024-05-07T11:14:09.417920+0000","last_became_active":"2024-05-07T11:12:44.053495+0000","last_became_peered":"2024-05-07T11:12:44.053495+0000","last_unstale":"2024-05-07T11:14:09.417920+0000","last_undegraded":"2024-05-07T11:14:09.417920+0000","last_fullsized":"2024-05-07T11:14:09.417920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:22.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.428889+0000","last_change":"2024-05-07T11:14:09.423948+0000","last_active":"2024-05-07T11:14:09.428889+0000","last_peered":"2024-05-07T11:14:09.428889+0000","last_clean":"2024-05-07T11:14:09.428889+0000","last_became_active":"2024-05-07T11:14:09.423293+0000","last_became_peered":"2024-05-07T11:14:09.423293+0000","last_unstale":"2024-05-07T11:14:09.428889+0000","last_undegraded":"2024-05-07T11:14:09.428889+0000","last_fullsized":"2024-05-07T11:14:09.428889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:34:06.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.417745+0000","last_change":"2024-05-07T11:12:44.047431+0000","last_active":"2024-05-07T11:14:09.417745+0000","last_peered":"2024-05-07T11:14:09.417745+0000","last_clean":"2024-05-07T11:14:09.417745+0000","last_became_active":"2024-05-07T11:12:44.045208+0000","last_became_peered":"2024-05-07T11:12:44.045208+0000","last_unstale":"2024-05-07T11:14:09.417745+0000","last_undegraded":"2024-05-07T11:14:09.417745+0000","last_fullsized":"2024-05-07T11:14:09.417745+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:54.509049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.418886+0000","last_change":"2024-05-07T11:12:44.053607+0000","last_active":"2024-05-07T11:14:09.418886+0000","last_peered":"2024-05-07T11:14:09.418886+0000","last_clean":"2024-05-07T11:14:09.418886+0000","last_became_active":"2024-05-07T11:12:44.053030+0000","last_became_peered":"2024-05-07T11:12:44.053030+0000","last_unstale":"2024-05-07T11:14:09.418886+0000","last_undegraded":"2024-05-07T11:14:09.418886+0000","last_fullsized":"2024-05-07T11:14:09.418886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420935+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:14:09.420935+0000","last_peered":"2024-05-07T11:14:09.420935+0000","last_clean":"2024-05-07T11:14:09.420935+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:14:09.420935+0000","last_undegraded":"2024-05-07T11:14:09.420935+0000","last_fullsized":"2024-05-07T11:14:09.420935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":55,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420258+0000","last_change":"2024-05-07T11:13:25.249860+0000","last_active":"2024-05-07T11:14:09.420258+0000","last_peered":"2024-05-07T11:14:09.420258+0000","last_clean":"2024-05-07T11:14:09.420258+0000","last_became_active":"2024-05-07T11:13:25.249519+0000","last_became_peered":"2024-05-07T11:13:25.249519+0000","last_unstale":"2024-05-07T11:14:09.420258+0000","last_undegraded":"2024-05-07T11:14:09.420258+0000","last_fullsized":"2024-05-07T11:14:09.420258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420069+0000","last_change":"2024-05-07T11:12:44.055354+0000","last_active":"2024-05-07T11:14:09.420069+0000","last_peered":"2024-05-07T11:14:09.420069+0000","last_clean":"2024-05-07T11:14:09.420069+0000","last_became_active":"2024-05-07T11:12:44.054711+0000","last_became_peered":"2024-05-07T11:12:44.054711+0000","last_unstale":"2024-05-07T11:14:09.420069+0000","last_undegraded":"2024-05-07T11:14:09.420069+0000","last_fullsized":"2024-05-07T11:14:09.420069+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:41.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.429297+0000","last_change":"2024-05-07T11:14:09.423664+0000","last_active":"2024-05-07T11:14:09.429297+0000","last_peered":"2024-05-07T11:14:09.429297+0000","last_clean":"2024-05-07T11:14:09.429297+0000","last_became_active":"2024-05-07T11:14:09.423314+0000","last_became_peered":"2024-05-07T11:14:09.423314+0000","last_unstale":"2024-05-07T11:14:09.429297+0000","last_undegraded":"2024-05-07T11:14:09.429297+0000","last_fullsized":"2024-05-07T11:14:09.429297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:23.676103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.418598+0000","last_change":"2024-05-07T11:12:44.050572+0000","last_active":"2024-05-07T11:14:09.418598+0000","last_peered":"2024-05-07T11:14:09.418598+0000","last_clean":"2024-05-07T11:14:09.418598+0000","last_became_active":"2024-05-07T11:12:44.050333+0000","last_became_peered":"2024-05-07T11:12:44.050333+0000","last_unstale":"2024-05-07T11:14:09.418598+0000","last_undegraded":"2024-05-07T11:14:09.418598+0000","last_fullsized":"2024-05-07T11:14:09.418598+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:52.012328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420135+0000","last_change":"2024-05-07T11:12:44.051622+0000","last_active":"2024-05-07T11:14:09.420135+0000","last_peered":"2024-05-07T11:14:09.420135+0000","last_clean":"2024-05-07T11:14:09.420135+0000","last_became_active":"2024-05-07T11:12:44.051108+0000","last_became_peered":"2024-05-07T11:12:44.051108+0000","last_unstale":"2024-05-07T11:14:09.420135+0000","last_undegraded":"2024-05-07T11:14:09.420135+0000","last_fullsized":"2024-05-07T11:14:09.420135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":79,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.434802+0000","last_change":"2024-05-07T11:14:09.434802+0000","last_active":"2024-05-07T11:14:09.434802+0000","last_peered":"2024-05-07T11:14:09.434802+0000","last_clean":"2024-05-07T11:14:09.434802+0000","last_became_active":"2024-05-07T11:14:09.434286+0000","last_became_peered":"2024-05-07T11:14:09.434286+0000","last_unstale":"2024-05-07T11:14:09.434802+0000","last_undegraded":"2024-05-07T11:14:09.434802+0000","last_fullsized":"2024-05-07T11:14:09.434802+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:44:32.961517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":81,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.431483+0000","last_change":"2024-05-07T11:14:09.431483+0000","last_active":"2024-05-07T11:14:09.431483+0000","last_peered":"2024-05-07T11:14:09.431483+0000","last_clean":"2024-05-07T11:14:09.431483+0000","last_became_active":"2024-05-07T11:14:09.431004+0000","last_became_peered":"2024-05-07T11:14:09.431004+0000","last_unstale":"2024-05-07T11:14:09.431483+0000","last_undegraded":"2024-05-07T11:14:09.431483+0000","last_fullsized":"2024-05-07T11:14:09.431483+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:46:11.792030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":78,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.427041+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:14:09.427041+0000","last_peered":"2024-05-07T11:14:09.427041+0000","last_clean":"2024-05-07T11:14:09.427041+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:14:09.427041+0000","last_undegraded":"2024-05-07T11:14:09.427041+0000","last_fullsized":"2024-05-07T11:14:09.427041+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.419612+0000","last_change":"2024-05-07T11:12:44.047437+0000","last_active":"2024-05-07T11:14:09.419612+0000","last_peered":"2024-05-07T11:14:09.419612+0000","last_clean":"2024-05-07T11:14:09.419612+0000","last_became_active":"2024-05-07T11:12:44.046652+0000","last_became_peered":"2024-05-07T11:12:44.046652+0000","last_unstale":"2024-05-07T11:14:09.419612+0000","last_undegraded":"2024-05-07T11:14:09.419612+0000","last_fullsized":"2024-05-07T11:14:09.419612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:13:42.261867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.435788+0000","last_change":"2024-05-07T11:14:09.432162+0000","last_active":"2024-05-07T11:14:09.435788+0000","last_peered":"2024-05-07T11:14:09.435788+0000","last_clean":"2024-05-07T11:14:09.435788+0000","last_became_active":"2024-05-07T11:14:09.431945+0000","last_became_peered":"2024-05-07T11:14:09.431945+0000","last_unstale":"2024-05-07T11:14:09.435788+0000","last_undegraded":"2024-05-07T11:14:09.435788+0000","last_fullsized":"2024-05-07T11:14:09.435788+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:23.733285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.429836+0000","last_change":"2024-05-07T11:14:09.428089+0000","last_active":"2024-05-07T11:14:09.429836+0000","last_peered":"2024-05-07T11:14:09.429836+0000","last_clean":"2024-05-07T11:14:09.429836+0000","last_became_active":"2024-05-07T11:14:09.427808+0000","last_became_peered":"2024-05-07T11:14:09.427808+0000","last_unstale":"2024-05-07T11:14:09.429836+0000","last_undegraded":"2024-05-07T11:14:09.429836+0000","last_fullsized":"2024-05-07T11:14:09.429836+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:50.899050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.417713+0000","last_change":"2024-05-07T11:12:43.051134+0000","last_active":"2024-05-07T11:14:09.417713+0000","last_peered":"2024-05-07T11:14:09.417713+0000","last_clean":"2024-05-07T11:14:09.417713+0000","last_became_active":"2024-05-07T11:12:43.050790+0000","last_became_peered":"2024-05-07T11:12:43.050790+0000","last_unstale":"2024-05-07T11:14:09.417713+0000","last_undegraded":"2024-05-07T11:14:09.417713+0000","last_fullsized":"2024-05-07T11:14:09.417713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:18:24.456668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.436023+0000","last_change":"2024-05-07T11:14:09.433876+0000","last_active":"2024-05-07T11:14:09.436023+0000","last_peered":"2024-05-07T11:14:09.436023+0000","last_clean":"2024-05-07T11:14:09.436023+0000","last_became_active":"2024-05-07T11:14:09.433493+0000","last_became_peered":"2024-05-07T11:14:09.433493+0000","last_unstale":"2024-05-07T11:14:09.436023+0000","last_undegraded":"2024-05-07T11:14:09.436023+0000","last_fullsized":"2024-05-07T11:14:09.436023+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:11:45.086420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":84,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.426924+0000","last_change":"2024-05-07T11:12:43.053918+0000","last_active":"2024-05-07T11:14:09.426924+0000","last_peered":"2024-05-07T11:14:09.426924+0000","last_clean":"2024-05-07T11:14:09.426924+0000","last_became_active":"2024-05-07T11:12:43.053598+0000","last_became_peered":"2024-05-07T11:12:43.053598+0000","last_unstale":"2024-05-07T11:14:09.426924+0000","last_undegraded":"2024-05-07T11:14:09.426924+0000","last_fullsized":"2024-05-07T11:14:09.426924+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:06.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":77,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.426755+0000","last_change":"2024-05-07T11:12:43.054033+0000","last_active":"2024-05-07T11:14:09.426755+0000","last_peered":"2024-05-07T11:14:09.426755+0000","last_clean":"2024-05-07T11:14:09.426755+0000","last_became_active":"2024-05-07T11:12:43.053668+0000","last_became_peered":"2024-05-07T11:12:43.053668+0000","last_unstale":"2024-05-07T11:14:09.426755+0000","last_undegraded":"2024-05-07T11:14:09.426755+0000","last_fullsized":"2024-05-07T11:14:09.426755+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.417854+0000","last_change":"2024-05-07T11:12:44.055293+0000","last_active":"2024-05-07T11:14:09.417854+0000","last_peered":"2024-05-07T11:14:09.417854+0000","last_clean":"2024-05-07T11:14:09.417854+0000","last_became_active":"2024-05-07T11:12:44.054935+0000","last_became_peered":"2024-05-07T11:12:44.054935+0000","last_unstale":"2024-05-07T11:14:09.417854+0000","last_undegraded":"2024-05-07T11:14:09.417854+0000","last_fullsized":"2024-05-07T11:14:09.417854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:02:14.088725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":80,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420144+0000","last_change":"2024-05-07T11:12:43.049030+0000","last_active":"2024-05-07T11:14:09.420144+0000","last_peered":"2024-05-07T11:14:09.420144+0000","last_clean":"2024-05-07T11:14:09.420144+0000","last_became_active":"2024-05-07T11:12:43.048675+0000","last_became_peered":"2024-05-07T11:12:43.048675+0000","last_unstale":"2024-05-07T11:14:09.420144+0000","last_undegraded":"2024-05-07T11:14:09.420144+0000","last_fullsized":"2024-05-07T11:14:09.420144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:34.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.417475+0000","last_change":"2024-05-07T11:12:44.046978+0000","last_active":"2024-05-07T11:14:09.417475+0000","last_peered":"2024-05-07T11:14:09.417475+0000","last_clean":"2024-05-07T11:14:09.417475+0000","last_became_active":"2024-05-07T11:12:44.046547+0000","last_became_peered":"2024-05-07T11:12:44.046547+0000","last_unstale":"2024-05-07T11:14:09.417475+0000","last_undegraded":"2024-05-07T11:14:09.417475+0000","last_fullsized":"2024-05-07T11:14:09.417475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:55.366669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":65,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.419432+0000","last_change":"2024-05-07T11:13:25.249690+0000","last_active":"2024-05-07T11:14:09.419432+0000","last_peered":"2024-05-07T11:14:09.419432+0000","last_clean":"2024-05-07T11:14:09.419432+0000","last_became_active":"2024-05-07T11:13:25.249304+0000","last_became_peered":"2024-05-07T11:13:25.249304+0000","last_unstale":"2024-05-07T11:14:09.419432+0000","last_undegraded":"2024-05-07T11:14:09.419432+0000","last_fullsized":"2024-05-07T11:14:09.419432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:30.051793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":79,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.433668+0000","last_change":"2024-05-07T11:14:09.433668+0000","last_active":"2024-05-07T11:14:09.433668+0000","last_peered":"2024-05-07T11:14:09.433668+0000","last_clean":"2024-05-07T11:14:09.433668+0000","last_became_active":"2024-05-07T11:14:09.433393+0000","last_became_peered":"2024-05-07T11:14:09.433393+0000","last_unstale":"2024-05-07T11:14:09.433668+0000","last_undegraded":"2024-05-07T11:14:09.433668+0000","last_fullsized":"2024-05-07T11:14:09.433668+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:34:20.598799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.429656+0000","last_change":"2024-05-07T11:14:09.423641+0000","last_active":"2024-05-07T11:14:09.429656+0000","last_peered":"2024-05-07T11:14:09.429656+0000","last_clean":"2024-05-07T11:14:09.429656+0000","last_became_active":"2024-05-07T11:14:09.423411+0000","last_became_peered":"2024-05-07T11:14:09.423411+0000","last_unstale":"2024-05-07T11:14:09.429656+0000","last_undegraded":"2024-05-07T11:14:09.429656+0000","last_fullsized":"2024-05-07T11:14:09.429656+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:46.784610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420435+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:14:09.420435+0000","last_peered":"2024-05-07T11:14:09.420435+0000","last_clean":"2024-05-07T11:14:09.420435+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:14:09.420435+0000","last_undegraded":"2024-05-07T11:14:09.420435+0000","last_fullsized":"2024-05-07T11:14:09.420435+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.445978+0000","last_change":"2024-05-07T11:14:09.444472+0000","last_active":"2024-05-07T11:14:09.445978+0000","last_peered":"2024-05-07T11:14:09.445978+0000","last_clean":"2024-05-07T11:14:09.445978+0000","last_became_active":"2024-05-07T11:14:09.435215+0000","last_became_peered":"2024-05-07T11:14:09.435215+0000","last_unstale":"2024-05-07T11:14:09.445978+0000","last_undegraded":"2024-05-07T11:14:09.445978+0000","last_fullsized":"2024-05-07T11:14:09.445978+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:06:30.686473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":79,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.434103+0000","last_change":"2024-05-07T11:14:09.434103+0000","last_active":"2024-05-07T11:14:09.434103+0000","last_peered":"2024-05-07T11:14:09.434103+0000","last_clean":"2024-05-07T11:14:09.434103+0000","last_became_active":"2024-05-07T11:14:09.433604+0000","last_became_peered":"2024-05-07T11:14:09.433604+0000","last_unstale":"2024-05-07T11:14:09.434103+0000","last_undegraded":"2024-05-07T11:14:09.434103+0000","last_fullsized":"2024-05-07T11:14:09.434103+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:52.829734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425429+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:14:09.425429+0000","last_peered":"2024-05-07T11:14:09.425429+0000","last_clean":"2024-05-07T11:14:09.425429+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:14:09.425429+0000","last_undegraded":"2024-05-07T11:14:09.425429+0000","last_fullsized":"2024-05-07T11:14:09.425429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":74,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425817+0000","last_change":"2024-05-07T11:12:44.059520+0000","last_active":"2024-05-07T11:14:09.425817+0000","last_peered":"2024-05-07T11:14:09.425817+0000","last_clean":"2024-05-07T11:14:09.425817+0000","last_became_active":"2024-05-07T11:12:44.058244+0000","last_became_peered":"2024-05-07T11:12:44.058244+0000","last_unstale":"2024-05-07T11:14:09.425817+0000","last_undegraded":"2024-05-07T11:14:09.425817+0000","last_fullsized":"2024-05-07T11:14:09.425817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:30.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":78,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.417804+0000","last_change":"2024-05-07T11:12:43.051139+0000","last_active":"2024-05-07T11:14:09.417804+0000","last_peered":"2024-05-07T11:14:09.417804+0000","last_clean":"2024-05-07T11:14:09.417804+0000","last_became_active":"2024-05-07T11:12:43.050794+0000","last_became_peered":"2024-05-07T11:12:43.050794+0000","last_unstale":"2024-05-07T11:14:09.417804+0000","last_undegraded":"2024-05-07T11:14:09.417804+0000","last_fullsized":"2024-05-07T11:14:09.417804+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:45.394069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":74,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425581+0000","last_change":"2024-05-07T11:12:44.057785+0000","last_active":"2024-05-07T11:14:09.425581+0000","last_peered":"2024-05-07T11:14:09.425581+0000","last_clean":"2024-05-07T11:14:09.425581+0000","last_became_active":"2024-05-07T11:12:44.056926+0000","last_became_peered":"2024-05-07T11:12:44.056926+0000","last_unstale":"2024-05-07T11:14:09.425581+0000","last_undegraded":"2024-05-07T11:14:09.425581+0000","last_fullsized":"2024-05-07T11:14:09.425581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:21:50.664747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":83,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.432213+0000","last_change":"2024-05-07T11:14:09.432213+0000","last_active":"2024-05-07T11:14:09.432213+0000","last_peered":"2024-05-07T11:14:09.432213+0000","last_clean":"2024-05-07T11:14:09.432213+0000","last_became_active":"2024-05-07T11:14:09.431654+0000","last_became_peered":"2024-05-07T11:14:09.431654+0000","last_unstale":"2024-05-07T11:14:09.432213+0000","last_undegraded":"2024-05-07T11:14:09.432213+0000","last_fullsized":"2024-05-07T11:14:09.432213+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:34:02.193642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.421121+0000","last_change":"2024-05-07T11:12:44.052952+0000","last_active":"2024-05-07T11:14:09.421121+0000","last_peered":"2024-05-07T11:14:09.421121+0000","last_clean":"2024-05-07T11:14:09.421121+0000","last_became_active":"2024-05-07T11:12:44.051915+0000","last_became_peered":"2024-05-07T11:12:44.051915+0000","last_unstale":"2024-05-07T11:14:09.421121+0000","last_undegraded":"2024-05-07T11:14:09.421121+0000","last_fullsized":"2024-05-07T11:14:09.421121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:15.019655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":278,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.427098+0000","last_change":"2024-05-07T11:12:38.713298+0000","last_active":"2024-05-07T11:14:09.427098+0000","last_peered":"2024-05-07T11:14:09.427098+0000","last_clean":"2024-05-07T11:14:09.427098+0000","last_became_active":"2024-05-07T11:12:38.712519+0000","last_became_peered":"2024-05-07T11:12:38.712519+0000","last_unstale":"2024-05-07T11:14:09.427098+0000","last_undegraded":"2024-05-07T11:14:09.427098+0000","last_fullsized":"2024-05-07T11:14:09.427098+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:45.130362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.434516+0000","last_change":"2024-05-07T11:14:09.434516+0000","last_active":"2024-05-07T11:14:09.434516+0000","last_peered":"2024-05-07T11:14:09.434516+0000","last_clean":"2024-05-07T11:14:09.434516+0000","last_became_active":"2024-05-07T11:14:09.433696+0000","last_became_peered":"2024-05-07T11:14:09.433696+0000","last_unstale":"2024-05-07T11:14:09.434516+0000","last_undegraded":"2024-05-07T11:14:09.434516+0000","last_fullsized":"2024-05-07T11:14:09.434516+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:26:12.465718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.429124+0000","last_change":"2024-05-07T11:14:09.424382+0000","last_active":"2024-05-07T11:14:09.429124+0000","last_peered":"2024-05-07T11:14:09.429124+0000","last_clean":"2024-05-07T11:14:09.429124+0000","last_became_active":"2024-05-07T11:14:09.424168+0000","last_became_peered":"2024-05-07T11:14:09.424168+0000","last_unstale":"2024-05-07T11:14:09.429124+0000","last_undegraded":"2024-05-07T11:14:09.429124+0000","last_fullsized":"2024-05-07T11:14:09.429124+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:22.179228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":55,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.419230+0000","last_change":"2024-05-07T11:13:25.249760+0000","last_active":"2024-05-07T11:14:09.419230+0000","last_peered":"2024-05-07T11:14:09.419230+0000","last_clean":"2024-05-07T11:14:09.419230+0000","last_became_active":"2024-05-07T11:13:25.249466+0000","last_became_peered":"2024-05-07T11:13:25.249466+0000","last_unstale":"2024-05-07T11:14:09.419230+0000","last_undegraded":"2024-05-07T11:14:09.419230+0000","last_fullsized":"2024-05-07T11:14:09.419230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:38.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.427036+0000","last_change":"2024-05-07T11:12:38.715921+0000","last_active":"2024-05-07T11:14:09.427036+0000","last_peered":"2024-05-07T11:14:09.427036+0000","last_clean":"2024-05-07T11:14:09.427036+0000","last_became_active":"2024-05-07T11:12:38.715581+0000","last_became_peered":"2024-05-07T11:12:38.715581+0000","last_unstale":"2024-05-07T11:14:09.427036+0000","last_undegraded":"2024-05-07T11:14:09.427036+0000","last_fullsized":"2024-05-07T11:14:09.427036+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:12.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":78,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420313+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:14:09.420313+0000","last_peered":"2024-05-07T11:14:09.420313+0000","last_clean":"2024-05-07T11:14:09.420313+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:14:09.420313+0000","last_undegraded":"2024-05-07T11:14:09.420313+0000","last_fullsized":"2024-05-07T11:14:09.420313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":81,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.430037+0000","last_change":"2024-05-07T11:14:09.430037+0000","last_active":"2024-05-07T11:14:09.430037+0000","last_peered":"2024-05-07T11:14:09.430037+0000","last_clean":"2024-05-07T11:14:09.430037+0000","last_became_active":"2024-05-07T11:14:09.429730+0000","last_became_peered":"2024-05-07T11:14:09.429730+0000","last_unstale":"2024-05-07T11:14:09.430037+0000","last_undegraded":"2024-05-07T11:14:09.430037+0000","last_fullsized":"2024-05-07T11:14:09.430037+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:52.829734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420439+0000","last_change":"2024-05-07T11:12:38.707934+0000","last_active":"2024-05-07T11:14:09.420439+0000","last_peered":"2024-05-07T11:14:09.420439+0000","last_clean":"2024-05-07T11:14:09.420439+0000","last_became_active":"2024-05-07T11:12:38.707652+0000","last_became_peered":"2024-05-07T11:12:38.707652+0000","last_unstale":"2024-05-07T11:14:09.420439+0000","last_undegraded":"2024-05-07T11:14:09.420439+0000","last_fullsized":"2024-05-07T11:14:09.420439+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:46.886917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":78,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.418419+0000","last_change":"2024-05-07T11:12:43.051148+0000","last_active":"2024-05-07T11:14:09.418419+0000","last_peered":"2024-05-07T11:14:09.418419+0000","last_clean":"2024-05-07T11:14:09.418419+0000","last_became_active":"2024-05-07T11:12:43.050784+0000","last_became_peered":"2024-05-07T11:12:43.050784+0000","last_unstale":"2024-05-07T11:14:09.418419+0000","last_undegraded":"2024-05-07T11:14:09.418419+0000","last_fullsized":"2024-05-07T11:14:09.418419+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:44:55.595184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.432146+0000","last_change":"2024-05-07T11:14:09.428981+0000","last_active":"2024-05-07T11:14:09.432146+0000","last_peered":"2024-05-07T11:14:09.432146+0000","last_clean":"2024-05-07T11:14:09.432146+0000","last_became_active":"2024-05-07T11:14:09.428432+0000","last_became_peered":"2024-05-07T11:14:09.428432+0000","last_unstale":"2024-05-07T11:14:09.432146+0000","last_undegraded":"2024-05-07T11:14:09.432146+0000","last_fullsized":"2024-05-07T11:14:09.432146+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:12:57.059348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":82,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425436+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:14:09.425436+0000","last_peered":"2024-05-07T11:14:09.425436+0000","last_clean":"2024-05-07T11:14:09.425436+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:14:09.425436+0000","last_undegraded":"2024-05-07T11:14:09.425436+0000","last_fullsized":"2024-05-07T11:14:09.425436+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":81,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.435359+0000","last_change":"2024-05-07T11:14:09.435359+0000","last_active":"2024-05-07T11:14:09.435359+0000","last_peered":"2024-05-07T11:14:09.435359+0000","last_clean":"2024-05-07T11:14:09.435359+0000","last_became_active":"2024-05-07T11:14:09.434515+0000","last_became_peered":"2024-05-07T11:14:09.434515+0000","last_unstale":"2024-05-07T11:14:09.435359+0000","last_undegraded":"2024-05-07T11:14:09.435359+0000","last_fullsized":"2024-05-07T11:14:09.435359+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:47:46.153554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.433041+0000","last_change":"2024-05-07T11:14:09.429808+0000","last_active":"2024-05-07T11:14:09.433041+0000","last_peered":"2024-05-07T11:14:09.433041+0000","last_clean":"2024-05-07T11:14:09.433041+0000","last_became_active":"2024-05-07T11:14:09.429320+0000","last_became_peered":"2024-05-07T11:14:09.429320+0000","last_unstale":"2024-05-07T11:14:09.433041+0000","last_undegraded":"2024-05-07T11:14:09.433041+0000","last_fullsized":"2024-05-07T11:14:09.433041+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:34:20.598799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.429171+0000","last_change":"2024-05-07T11:14:09.424037+0000","last_active":"2024-05-07T11:14:09.429171+0000","last_peered":"2024-05-07T11:14:09.429171+0000","last_clean":"2024-05-07T11:14:09.429171+0000","last_became_active":"2024-05-07T11:14:09.423720+0000","last_became_peered":"2024-05-07T11:14:09.423720+0000","last_unstale":"2024-05-07T11:14:09.429171+0000","last_undegraded":"2024-05-07T11:14:09.429171+0000","last_fullsized":"2024-05-07T11:14:09.429171+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:25.679257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.421209+0000","last_change":"2024-05-07T11:12:38.707834+0000","last_active":"2024-05-07T11:14:09.421209+0000","last_peered":"2024-05-07T11:14:09.421209+0000","last_clean":"2024-05-07T11:14:09.421209+0000","last_became_active":"2024-05-07T11:12:38.707618+0000","last_became_peered":"2024-05-07T11:12:38.707618+0000","last_unstale":"2024-05-07T11:14:09.421209+0000","last_undegraded":"2024-05-07T11:14:09.421209+0000","last_fullsized":"2024-05-07T11:14:09.421209+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:23:17.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.418624+0000","last_change":"2024-05-07T11:12:44.053066+0000","last_active":"2024-05-07T11:14:09.418624+0000","last_peered":"2024-05-07T11:14:09.418624+0000","last_clean":"2024-05-07T11:14:09.418624+0000","last_became_active":"2024-05-07T11:12:44.052669+0000","last_became_peered":"2024-05-07T11:12:44.052669+0000","last_unstale":"2024-05-07T11:14:09.418624+0000","last_undegraded":"2024-05-07T11:14:09.418624+0000","last_fullsized":"2024-05-07T11:14:09.418624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:31.398368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.433277+0000","last_change":"2024-05-07T11:14:09.431497+0000","last_active":"2024-05-07T11:14:09.433277+0000","last_peered":"2024-05-07T11:14:09.433277+0000","last_clean":"2024-05-07T11:14:09.433277+0000","last_became_active":"2024-05-07T11:14:09.431021+0000","last_became_peered":"2024-05-07T11:14:09.431021+0000","last_unstale":"2024-05-07T11:14:09.433277+0000","last_undegraded":"2024-05-07T11:14:09.433277+0000","last_fullsized":"2024-05-07T11:14:09.433277+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:23.635051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.434472+0000","last_change":"2024-05-07T11:14:09.434472+0000","last_active":"2024-05-07T11:14:09.434472+0000","last_peered":"2024-05-07T11:14:09.434472+0000","last_clean":"2024-05-07T11:14:09.434472+0000","last_became_active":"2024-05-07T11:14:09.434165+0000","last_became_peered":"2024-05-07T11:14:09.434165+0000","last_unstale":"2024-05-07T11:14:09.434472+0000","last_undegraded":"2024-05-07T11:14:09.434472+0000","last_fullsized":"2024-05-07T11:14:09.434472+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:35.396339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.417950+0000","last_change":"2024-05-07T11:12:44.053343+0000","last_active":"2024-05-07T11:14:09.417950+0000","last_peered":"2024-05-07T11:14:09.417950+0000","last_clean":"2024-05-07T11:14:09.417950+0000","last_became_active":"2024-05-07T11:12:44.052988+0000","last_became_peered":"2024-05-07T11:12:44.052988+0000","last_unstale":"2024-05-07T11:14:09.417950+0000","last_undegraded":"2024-05-07T11:14:09.417950+0000","last_fullsized":"2024-05-07T11:14:09.417950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:49:58.737357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425857+0000","last_change":"2024-05-07T11:14:03.407754+0000","last_active":"2024-05-07T11:14:09.425857+0000","last_peered":"2024-05-07T11:14:09.425857+0000","last_clean":"2024-05-07T11:14:09.425857+0000","last_became_active":"2024-05-07T11:14:03.404163+0000","last_became_peered":"2024-05-07T11:14:03.404163+0000","last_unstale":"2024-05-07T11:14:09.425857+0000","last_undegraded":"2024-05-07T11:14:09.425857+0000","last_fullsized":"2024-05-07T11:14:09.425857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:34:05.943693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.435720+0000","last_change":"2024-05-07T11:14:09.434627+0000","last_active":"2024-05-07T11:14:09.435720+0000","last_peered":"2024-05-07T11:14:09.435720+0000","last_clean":"2024-05-07T11:14:09.435720+0000","last_became_active":"2024-05-07T11:14:09.434278+0000","last_became_peered":"2024-05-07T11:14:09.434278+0000","last_unstale":"2024-05-07T11:14:09.435720+0000","last_undegraded":"2024-05-07T11:14:09.435720+0000","last_fullsized":"2024-05-07T11:14:09.435720+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:06:26.352574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":67,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420559+0000","last_change":"2024-05-07T11:13:25.248884+0000","last_active":"2024-05-07T11:14:09.420559+0000","last_peered":"2024-05-07T11:14:09.420559+0000","last_clean":"2024-05-07T11:14:09.420559+0000","last_became_active":"2024-05-07T11:13:25.248619+0000","last_became_peered":"2024-05-07T11:13:25.248619+0000","last_unstale":"2024-05-07T11:14:09.420559+0000","last_undegraded":"2024-05-07T11:14:09.420559+0000","last_fullsized":"2024-05-07T11:14:09.420559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":40,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.439276+0000","last_change":"2024-05-07T11:14:09.438608+0000","last_active":"2024-05-07T11:14:09.439276+0000","last_peered":"2024-05-07T11:14:09.439276+0000","last_clean":"2024-05-07T11:14:09.439276+0000","last_became_active":"2024-05-07T11:14:09.433883+0000","last_became_peered":"2024-05-07T11:14:09.433883+0000","last_unstale":"2024-05-07T11:14:09.439276+0000","last_undegraded":"2024-05-07T11:14:09.439276+0000","last_fullsized":"2024-05-07T11:14:09.439276+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:59:24.586464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.426858+0000","last_change":"2024-05-07T11:12:38.715817+0000","last_active":"2024-05-07T11:14:09.426858+0000","last_peered":"2024-05-07T11:14:09.426858+0000","last_clean":"2024-05-07T11:14:09.426858+0000","last_became_active":"2024-05-07T11:12:38.715550+0000","last_became_peered":"2024-05-07T11:12:38.715550+0000","last_unstale":"2024-05-07T11:14:09.426858+0000","last_undegraded":"2024-05-07T11:14:09.426858+0000","last_fullsized":"2024-05-07T11:14:09.426858+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:32.952152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.417591+0000","last_change":"2024-05-07T11:12:44.050074+0000","last_active":"2024-05-07T11:14:09.417591+0000","last_peered":"2024-05-07T11:14:09.417591+0000","last_clean":"2024-05-07T11:14:09.417591+0000","last_became_active":"2024-05-07T11:12:44.049870+0000","last_became_peered":"2024-05-07T11:12:44.049870+0000","last_unstale":"2024-05-07T11:14:09.417591+0000","last_undegraded":"2024-05-07T11:14:09.417591+0000","last_fullsized":"2024-05-07T11:14:09.417591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:00:35.965027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":74,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425506+0000","last_change":"2024-05-07T11:12:44.057776+0000","last_active":"2024-05-07T11:14:09.425506+0000","last_peered":"2024-05-07T11:14:09.425506+0000","last_clean":"2024-05-07T11:14:09.425506+0000","last_became_active":"2024-05-07T11:12:44.056586+0000","last_became_peered":"2024-05-07T11:12:44.056586+0000","last_unstale":"2024-05-07T11:14:09.425506+0000","last_undegraded":"2024-05-07T11:14:09.425506+0000","last_fullsized":"2024-05-07T11:14:09.425506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:40:25.476554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'10","reported_seq":86,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.425491+0000","last_change":"2024-05-07T11:12:43.053801+0000","last_active":"2024-05-07T11:14:09.425491+0000","last_peered":"2024-05-07T11:14:09.425491+0000","last_clean":"2024-05-07T11:14:09.425491+0000","last_became_active":"2024-05-07T11:12:43.053504+0000","last_became_peered":"2024-05-07T11:12:43.053504+0000","last_unstale":"2024-05-07T11:14:09.425491+0000","last_undegraded":"2024-05-07T11:14:09.425491+0000","last_fullsized":"2024-05-07T11:14:09.425491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:38:42.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.429076+0000","last_change":"2024-05-07T11:14:09.424174+0000","last_active":"2024-05-07T11:14:09.429076+0000","last_peered":"2024-05-07T11:14:09.429076+0000","last_clean":"2024-05-07T11:14:09.429076+0000","last_became_active":"2024-05-07T11:14:09.423893+0000","last_became_peered":"2024-05-07T11:14:09.423893+0000","last_unstale":"2024-05-07T11:14:09.429076+0000","last_undegraded":"2024-05-07T11:14:09.429076+0000","last_fullsized":"2024-05-07T11:14:09.429076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:17:45.353372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":81,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420150+0000","last_change":"2024-05-07T11:12:43.049224+0000","last_active":"2024-05-07T11:14:09.420150+0000","last_peered":"2024-05-07T11:14:09.420150+0000","last_clean":"2024-05-07T11:14:09.420150+0000","last_became_active":"2024-05-07T11:12:43.048893+0000","last_became_peered":"2024-05-07T11:12:43.048893+0000","last_unstale":"2024-05-07T11:14:09.420150+0000","last_undegraded":"2024-05-07T11:14:09.420150+0000","last_fullsized":"2024-05-07T11:14:09.420150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:09.613559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.429785+0000","last_change":"2024-05-07T11:14:09.428030+0000","last_active":"2024-05-07T11:14:09.429785+0000","last_peered":"2024-05-07T11:14:09.429785+0000","last_clean":"2024-05-07T11:14:09.429785+0000","last_became_active":"2024-05-07T11:14:09.427742+0000","last_became_peered":"2024-05-07T11:14:09.427742+0000","last_unstale":"2024-05-07T11:14:09.429785+0000","last_undegraded":"2024-05-07T11:14:09.429785+0000","last_fullsized":"2024-05-07T11:14:09.429785+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:23.733285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.435801+0000","last_change":"2024-05-07T11:14:09.432329+0000","last_active":"2024-05-07T11:14:09.435801+0000","last_peered":"2024-05-07T11:14:09.435801+0000","last_clean":"2024-05-07T11:14:09.435801+0000","last_became_active":"2024-05-07T11:14:09.431924+0000","last_became_peered":"2024-05-07T11:14:09.431924+0000","last_unstale":"2024-05-07T11:14:09.435801+0000","last_undegraded":"2024-05-07T11:14:09.435801+0000","last_fullsized":"2024-05-07T11:14:09.435801+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:22:14.270696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.436069+0000","last_change":"2024-05-07T11:14:09.434260+0000","last_active":"2024-05-07T11:14:09.436069+0000","last_peered":"2024-05-07T11:14:09.436069+0000","last_clean":"2024-05-07T11:14:09.436069+0000","last_became_active":"2024-05-07T11:14:09.433979+0000","last_became_peered":"2024-05-07T11:14:09.433979+0000","last_unstale":"2024-05-07T11:14:09.436069+0000","last_undegraded":"2024-05-07T11:14:09.436069+0000","last_fullsized":"2024-05-07T11:14:09.436069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:34.902882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.433415+0000","last_change":"2024-05-07T11:14:09.432197+0000","last_active":"2024-05-07T11:14:09.433415+0000","last_peered":"2024-05-07T11:14:09.433415+0000","last_clean":"2024-05-07T11:14:09.433415+0000","last_became_active":"2024-05-07T11:14:09.431848+0000","last_became_peered":"2024-05-07T11:14:09.431848+0000","last_unstale":"2024-05-07T11:14:09.433415+0000","last_undegraded":"2024-05-07T11:14:09.433415+0000","last_fullsized":"2024-05-07T11:14:09.433415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:59:25.592268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.419071+0000","last_change":"2024-05-07T11:12:44.053997+0000","last_active":"2024-05-07T11:14:09.419071+0000","last_peered":"2024-05-07T11:14:09.419071+0000","last_clean":"2024-05-07T11:14:09.419071+0000","last_became_active":"2024-05-07T11:12:44.053614+0000","last_became_peered":"2024-05-07T11:12:44.053614+0000","last_unstale":"2024-05-07T11:14:09.419071+0000","last_undegraded":"2024-05-07T11:14:09.419071+0000","last_fullsized":"2024-05-07T11:14:09.419071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.433287+0000","last_change":"2024-05-07T11:14:09.431807+0000","last_active":"2024-05-07T11:14:09.433287+0000","last_peered":"2024-05-07T11:14:09.433287+0000","last_clean":"2024-05-07T11:14:09.433287+0000","last_became_active":"2024-05-07T11:14:09.431144+0000","last_became_peered":"2024-05-07T11:14:09.431144+0000","last_unstale":"2024-05-07T11:14:09.433287+0000","last_undegraded":"2024-05-07T11:14:09.433287+0000","last_fullsized":"2024-05-07T11:14:09.433287+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:32:59.453128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.433182+0000","last_change":"2024-05-07T11:14:09.431011+0000","last_active":"2024-05-07T11:14:09.433182+0000","last_peered":"2024-05-07T11:14:09.433182+0000","last_clean":"2024-05-07T11:14:09.433182+0000","last_became_active":"2024-05-07T11:14:09.430775+0000","last_became_peered":"2024-05-07T11:14:09.430775+0000","last_unstale":"2024-05-07T11:14:09.433182+0000","last_undegraded":"2024-05-07T11:14:09.433182+0000","last_fullsized":"2024-05-07T11:14:09.433182+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:26:17.805421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.435890+0000","last_change":"2024-05-07T11:14:09.432753+0000","last_active":"2024-05-07T11:14:09.435890+0000","last_peered":"2024-05-07T11:14:09.435890+0000","last_clean":"2024-05-07T11:14:09.435890+0000","last_became_active":"2024-05-07T11:14:09.432475+0000","last_became_peered":"2024-05-07T11:14:09.432475+0000","last_unstale":"2024-05-07T11:14:09.435890+0000","last_undegraded":"2024-05-07T11:14:09.435890+0000","last_fullsized":"2024-05-07T11:14:09.435890+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:56.674667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.419594+0000","last_change":"2024-05-07T11:12:44.053925+0000","last_active":"2024-05-07T11:14:09.419594+0000","last_peered":"2024-05-07T11:14:09.419594+0000","last_clean":"2024-05-07T11:14:09.419594+0000","last_became_active":"2024-05-07T11:12:44.052965+0000","last_became_peered":"2024-05-07T11:12:44.052965+0000","last_unstale":"2024-05-07T11:14:09.419594+0000","last_undegraded":"2024-05-07T11:14:09.419594+0000","last_fullsized":"2024-05-07T11:14:09.419594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:56.499743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":84,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.431514+0000","last_change":"2024-05-07T11:14:09.431514+0000","last_active":"2024-05-07T11:14:09.431514+0000","last_peered":"2024-05-07T11:14:09.431514+0000","last_clean":"2024-05-07T11:14:09.431514+0000","last_became_active":"2024-05-07T11:14:09.431005+0000","last_became_peered":"2024-05-07T11:14:09.431005+0000","last_unstale":"2024-05-07T11:14:09.431514+0000","last_undegraded":"2024-05-07T11:14:09.431514+0000","last_fullsized":"2024-05-07T11:14:09.431514+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:44:31.955714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":81,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.429803+0000","last_change":"2024-05-07T11:14:09.429803+0000","last_active":"2024-05-07T11:14:09.429803+0000","last_peered":"2024-05-07T11:14:09.429803+0000","last_clean":"2024-05-07T11:14:09.429803+0000","last_became_active":"2024-05-07T11:14:09.429291+0000","last_became_peered":"2024-05-07T11:14:09.429291+0000","last_unstale":"2024-05-07T11:14:09.429803+0000","last_undegraded":"2024-05-07T11:14:09.429803+0000","last_fullsized":"2024-05-07T11:14:09.429803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:11:45.086420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":79,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.418168+0000","last_change":"2024-05-07T11:12:43.049120+0000","last_active":"2024-05-07T11:14:09.418168+0000","last_peered":"2024-05-07T11:14:09.418168+0000","last_clean":"2024-05-07T11:14:09.418168+0000","last_became_active":"2024-05-07T11:12:43.048753+0000","last_became_peered":"2024-05-07T11:12:43.048753+0000","last_unstale":"2024-05-07T11:14:09.418168+0000","last_undegraded":"2024-05-07T11:14:09.418168+0000","last_fullsized":"2024-05-07T11:14:09.418168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:06.518867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":79,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.434821+0000","last_change":"2024-05-07T11:14:09.434821+0000","last_active":"2024-05-07T11:14:09.434821+0000","last_peered":"2024-05-07T11:14:09.434821+0000","last_clean":"2024-05-07T11:14:09.434821+0000","last_became_active":"2024-05-07T11:14:09.434107+0000","last_became_peered":"2024-05-07T11:14:09.434107+0000","last_unstale":"2024-05-07T11:14:09.434821+0000","last_undegraded":"2024-05-07T11:14:09.434821+0000","last_fullsized":"2024-05-07T11:14:09.434821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:24.640854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":87,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.439951+0000","last_change":"2024-05-07T11:14:09.439951+0000","last_active":"2024-05-07T11:14:09.439951+0000","last_peered":"2024-05-07T11:14:09.439951+0000","last_clean":"2024-05-07T11:14:09.439951+0000","last_became_active":"2024-05-07T11:14:09.433593+0000","last_became_peered":"2024-05-07T11:14:09.433593+0000","last_unstale":"2024-05-07T11:14:09.439951+0000","last_undegraded":"2024-05-07T11:14:09.439951+0000","last_fullsized":"2024-05-07T11:14:09.439951+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:34:02.193642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":79,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.432297+0000","last_change":"2024-05-07T11:14:09.432297+0000","last_active":"2024-05-07T11:14:09.432297+0000","last_peered":"2024-05-07T11:14:09.432297+0000","last_clean":"2024-05-07T11:14:09.432297+0000","last_became_active":"2024-05-07T11:14:09.432005+0000","last_became_peered":"2024-05-07T11:14:09.432005+0000","last_unstale":"2024-05-07T11:14:09.432297+0000","last_undegraded":"2024-05-07T11:14:09.432297+0000","last_fullsized":"2024-05-07T11:14:09.432297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:50.899050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":80,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.420034+0000","last_change":"2024-05-07T11:12:43.050989+0000","last_active":"2024-05-07T11:14:09.420034+0000","last_peered":"2024-05-07T11:14:09.420034+0000","last_clean":"2024-05-07T11:14:09.420034+0000","last_became_active":"2024-05-07T11:12:43.050552+0000","last_became_peered":"2024-05-07T11:12:43.050552+0000","last_unstale":"2024-05-07T11:14:09.420034+0000","last_undegraded":"2024-05-07T11:14:09.420034+0000","last_fullsized":"2024-05-07T11:14:09.420034+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:36.055760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.417929+0000","last_change":"2024-05-07T11:12:44.046717+0000","last_active":"2024-05-07T11:14:09.417929+0000","last_peered":"2024-05-07T11:14:09.417929+0000","last_clean":"2024-05-07T11:14:09.417929+0000","last_became_active":"2024-05-07T11:12:44.046282+0000","last_became_peered":"2024-05-07T11:12:44.046282+0000","last_unstale":"2024-05-07T11:14:09.417929+0000","last_undegraded":"2024-05-07T11:14:09.417929+0000","last_fullsized":"2024-05-07T11:14:09.417929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:12.735090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.435763+0000","last_change":"2024-05-07T11:14:09.434646+0000","last_active":"2024-05-07T11:14:09.435763+0000","last_peered":"2024-05-07T11:14:09.435763+0000","last_clean":"2024-05-07T11:14:09.435763+0000","last_became_active":"2024-05-07T11:14:09.434281+0000","last_became_peered":"2024-05-07T11:14:09.434281+0000","last_unstale":"2024-05-07T11:14:09.435763+0000","last_undegraded":"2024-05-07T11:14:09.435763+0000","last_fullsized":"2024-05-07T11:14:09.435763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:43:43.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":79,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.434562+0000","last_change":"2024-05-07T11:14:09.434562+0000","last_active":"2024-05-07T11:14:09.434562+0000","last_peered":"2024-05-07T11:14:09.434562+0000","last_clean":"2024-05-07T11:14:09.434562+0000","last_became_active":"2024-05-07T11:14:09.433869+0000","last_became_peered":"2024-05-07T11:14:09.433869+0000","last_unstale":"2024-05-07T11:14:09.434562+0000","last_undegraded":"2024-05-07T11:14:09.434562+0000","last_fullsized":"2024-05-07T11:14:09.434562+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:46:11.792030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-07T11:14:09.444467+0000","last_change":"2024-05-07T11:14:09.442804+0000","last_active":"2024-05-07T11:14:09.444467+0000","last_peered":"2024-05-07T11:14:09.444467+0000","last_clean":"2024-05-07T11:14:09.444467+0000","last_became_active":"2024-05-07T11:14:09.434213+0000","last_became_peered":"2024-05-07T11:14:09.434213+0000","last_unstale":"2024-05-07T11:14:09.444467+0000","last_undegraded":"2024-05-07T11:14:09.444467+0000","last_fullsized":"2024-05-07T11:14:09.444467+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:56:39.730239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738390,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":487424,"data_stored":781142,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738390,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":483328,"data_stored":781108,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738390,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":183457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:14:14.459 INFO:tasks.thrashosds.thrasher:Setting 4.8 to [2, 1] 2024-05-07T11:14:14.459 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.8', '2', '1'] 2024-05-07T11:14:14.459 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.8 2 1 2024-05-07T11:14:14.467 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:14.467+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:14.488 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:14.510 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:14.523 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:14.523 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:14.556 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:14.568 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:14.567+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:14.621 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:14.621 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:14.621 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:14.621 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:14.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:14.669 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:14.668+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:14.769 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:14.769+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:14.775 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:14.776 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:14.776 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:14.776 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:14.776 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:14.785 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:14.871 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:14.871+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.846883520999995, 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.891 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.846818800999998, 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.897 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:14:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:14:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:14:14.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:14:14.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.846721861000006, 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.908 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.846656523000007, 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:14.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:14.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.914 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.846629630999999, 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:14.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:14:14.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:14.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.846602052999998, 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:14:14.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:14:14.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:14:14.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:14:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.846566663999994, 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.846541056999996, 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:14.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:14.934 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.846511626999998, 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:14:14.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:14:14.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.844125653000006, 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:14:14.938 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.941 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.839867114, 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:14:14.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:14:14.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.839219111000006, 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:14:14.946 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.950 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.838573792000005, 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.954 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.838300227999994, 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:14:14.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:14:14.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:14:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.837540223999994, 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:14:14.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.836955605, 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.833198796000005, 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:14:14.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:14:14.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 88.848182761999993, 2024-05-07T11:14:14.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:14:14.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:14:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:14:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.845692317000001, 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.844956672000002, 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:14:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:14:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:14.987 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:14.987 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:14.988 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:14.989 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:14.987+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:15.089 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:15.089+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:15.098 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:15.098 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:15.098 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:14:15.099 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:15.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:15.190 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:15.190+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:15.212 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:15.212 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:15.212 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:14:15.212 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:14:15.212 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:15.221 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:15.291 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:15.290+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:15.368 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:15.368 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.601751614999998, 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 95.935196458999997, 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.373 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:15.377 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 95.705589367000002, 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:15.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:14:15.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:14:15.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 95.704914192999993, 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:14:15.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 95.704272372000005, 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:15.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:14:15.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 95.703803964000002, 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.390 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 95.701098443000006, 2024-05-07T11:14:15.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:14:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.323782062000006, 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:14:15.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:14:15.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:14:15.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.323725287000002, 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:14:15.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:14:15.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:14:15.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.323696815999995, 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.416 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.323658022000004, 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.422 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.323614699000004, 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:14:15.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:14:15.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:14:15.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:14:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.323592148000003, 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:14:15.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:14:15.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.323568088000002, 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:14:15.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:14:15.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.440 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.323549127999996, 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:14:15.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:14:15.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:14:15.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:14:15.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:14:15.447 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.323522456000006, 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.452 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.319018196000002, 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.456 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.317291668999999, 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:14:15.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:14:15.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.317139334999993, 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.462 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:15.466 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.317086363000001, 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:15.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:15.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:15.471 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:15.471 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:15.472 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-05-07T11:14:15.472 INFO:teuthology.orchestra.run.smithi062.stderr:set 4.8 pg_upmap mapping to [2,1] 2024-05-07T11:14:15.473 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:15.474 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:15.472+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:15.572 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:15.572+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:15.589 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:15.589 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:15.589 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:15.589 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:15.598 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:15.673 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:15.673+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:15.743 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:15.743 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:15.743 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:15.743 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:15.744 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:15.753 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:15.774 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:15.774+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:15.862 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:15.862 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:15.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:15.862 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:15.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.863 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:15.863 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:15.863 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.912135655, 2024-05-07T11:14:15.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:14:15.863 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.863 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.863 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.864 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:15.864 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:15.864 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:15.864 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:14:15.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.864 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:15.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:15.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:15.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:14:15.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:14:15.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:14:15.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:14:15.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:14:15.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:14:15.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:14:15.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:14:15.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:14:15.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:14:15.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:14:15.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:14:15.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:14:15.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:14:15.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:14:15.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:14:15.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:14:15.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:14:15.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:14:15.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:14:15.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:14:15.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.875 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.876 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:15.876 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:15.876 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.587909768000003, 2024-05-07T11:14:15.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:14:15.876 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.877 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.877 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.877 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:15.877 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:15.877 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:15.877 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:14:15.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.878 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:15.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:15.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:15.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:14:15.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:14:15.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:14:15.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:14:15.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:14:15.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:14:15.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:14:15.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:14:15.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:14:15.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:14:15.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:14:15.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:14:15.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:14:15.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:14:15.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:14:15.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:14:15.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:14:15.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:14:15.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:14:15.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:14:15.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:14:15.888 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.888 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.888 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.889 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:15.889 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:15.889 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.427434368999997, 2024-05-07T11:14:15.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:14:15.889 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.890 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.890 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.890 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:15.890 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:15.890 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:15.890 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:14:15.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.891 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:15.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:15.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:15.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:14:15.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:14:15.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:14:15.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:14:15.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:14:15.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:14:15.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:14:15.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:14:15.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:14:15.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:14:15.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:14:15.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:14:15.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:14:15.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:14:15.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:14:15.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:14:15.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:14:15.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:14:15.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:14:15.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:14:15.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:14:15.900 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.900 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.900 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.901 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:15.901 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:15.901 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.427348000999999, 2024-05-07T11:14:15.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:14:15.901 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.901 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.901 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:15.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:14:15.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:14:15.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:14:15.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:14:15.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:14:15.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:14:15.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:14:15.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:14:15.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:14:15.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.198200568000004, 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.198153102999996, 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.914 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:14:15.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:14:15.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:14:15.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:14:15.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:14:15.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:14:15.919 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.816240715000006, 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:14:15.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:14:15.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:14:15.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.814045630999999, 2024-05-07T11:14:15.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:14:15.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:14:15.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:14:15.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:14:15.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:14:15.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:14:15.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:14:15.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:15.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:14:15.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:14:15.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:14:15.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:14:15.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:14:15.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:14:15.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:14:15.934 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.934 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.934 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.934 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.935 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:15.935 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.813817411000002, 2024-05-07T11:14:15.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:14:15.935 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.935 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.935 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.935 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:15.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:15.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:14:15.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:14:15.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:14:15.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:14:15.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:14:15.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:14:15.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:14:15.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:14:15.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:14:15.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:14:15.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:15.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:14:15.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:15.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:14:15.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:14:15.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:14:15.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:14:15.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:14:15.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:14:15.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:14:15.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:14:15.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:14:15.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:14:15.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:14:15.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:14:15.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:14:15.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:14:15.944 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.944 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.944 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.944 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.944 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:15.944 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.813638280999996, 2024-05-07T11:14:15.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:14:15.945 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.945 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.945 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.945 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:15.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:15.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:15.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:14:15.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:14:15.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.951 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.813578406999994, 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:14:15.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:14:15.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:14:15.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:14:15.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.813530235000002, 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.813502252999996, 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.962 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:14:15.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:14:15.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:14:15.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:14:15.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:14:15.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:14:15.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:14:15.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:14:15.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:14:15.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:14:15.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:14:15.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:14:15.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:14:15.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:14:15.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:14:15.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:14:15.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:14:15.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:14:15.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:14:15.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:14:15.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:14:15.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:14:15.971 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.971 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.971 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.972 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.972 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:15.972 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.813469243, 2024-05-07T11:14:15.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:14:15.972 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.973 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.973 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.973 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:15.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:15.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:14:15.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:14:15.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:14:15.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:14:15.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:14:15.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:14:15.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:14:15.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:14:15.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:14:15.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:14:15.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:14:15.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:14:15.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:14:15.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:14:15.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:14:15.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:14:15.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:14:15.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:14:15.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:14:15.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:15.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:14:15.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:14:15.983 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.983 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.983 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.984 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.984 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:15.984 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.813375438999998, 2024-05-07T11:14:15.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:14:15.984 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.985 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.985 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.985 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:15.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:15.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:15.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:15.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:15.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:14:15.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:14:15.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:15.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:15.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:14:15.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:15.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:14:15.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:14:15.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:15.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:14:15.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:14:15.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:14:15.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:14:15.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:15.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:14:15.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:14:15.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:15.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:14:15.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:14:15.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:15.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:14:15.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:14:15.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:15.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:14:15.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:14:15.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:15.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:14:15.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:14:15.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:15.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:14:15.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:14:15.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:15.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:14:15.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:14:15.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:15.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:14:15.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:14:15.997 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.997 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:15.997 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:15.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:15.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.998 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:15.998 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:15.998 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.813231997000003, 2024-05-07T11:14:15.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:14:15.998 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:15.998 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:15.999 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:15.999 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:15.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:15.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:15.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:15.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:16.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:16.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:16.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:16.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:16.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:14:16.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:14:16.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:16.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:14:16.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:14:16.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:16.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:14:16.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:14:16.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:14:16.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:14:16.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:16.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:14:16.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:14:16.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:16.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:14:16.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:16.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:16.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:16.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.813047092000005, 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:16.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.812888021999996, 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:14:16.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:14:16.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.812444612999997, 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:16.018 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:14:16.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.812419348999995, 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:16.023 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:14:16.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:14:16.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:14:16.026 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.027 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:16.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:16.027 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:16.027 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:16.028 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:16.029 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:16.028+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:16.130 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:16.129+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:16.146 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:16.146 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:16.147 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:16.147 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:16.155 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:16.231 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:16.231+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:16.262 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:16.262 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:16.262 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:16.262 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:16.262 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:16.268 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:16.331 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:16.331+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:16.376 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:16.376 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:16.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:16.376 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:16.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.376 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.332136965000004, 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:14:16.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.382 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.383 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:16.383 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.332072245000006, 2024-05-07T11:14:16.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:14:16.383 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.383 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.383 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.383 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:14:16.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:16.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.331975305, 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.389 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:14:16.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:14:16.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.395 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.331909967000001, 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:16.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:16.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:16.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:16.401 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.331883074999993, 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:16.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:16.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:16.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:16.407 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.331855497000006, 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:16.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:14:16.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.412 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.331820108000002, 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:16.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:14:16.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.331794501000005, 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:14:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.421 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.331765071000007, 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:16.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.329379097, 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:14:16.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:14:16.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:16.429 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.325120557999995, 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.433 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.324472555, 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:16.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:14:16.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:14:16.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.323827236, 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:14:16.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:16.442 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.323553672000003, 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:16.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.446 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.322793668000003, 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.322209048999994, 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:14:16.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:14:16.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:16.454 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 92.318452239999999, 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:16.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:14:16.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 90.333436206000002, 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:14:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:14:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 67.330945760999995, 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.330210116000003, 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:14:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:14:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:14:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:14:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:14:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:16.477 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:16.479 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:16.478+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:16.479 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:16.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:16.578 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:16.579+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:16.596 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:16.596 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:16.596 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:14:16.596 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:16.607 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:16.679 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:16.679+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:16.714 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:16.714 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:16.714 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:14:16.715 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:14:16.715 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:16.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:16.776 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:16.780 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:16.780+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:16.809 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:16.809 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:16.842 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:16.869 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:16.869 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:16.880 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:16.881 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:16.881+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:16.982 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:16.982+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:16.994 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:16.995 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:17.004 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:17.083 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:17.082+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:17.108 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:17.108 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:17.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:17.201 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:17.201+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:17.263 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:17.264 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:17.272 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:17.285 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:17.284+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:17.383 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:17.383 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:17.385 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:17.385+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:17.392 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:17.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T11:14:17.486 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:17.486+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:17.496 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:17.496 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:17.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:17.587 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:17.586+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:17.610 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:17.610 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:17.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:17.689 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:17.687+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:17.726 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:17.726 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:17.735 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:17.789 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:17.788+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:17.841 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:17.841 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:17.849 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:17.894 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:17.894+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:17.955 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:17.955 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:17.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:17.990 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:17.989+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:18.072 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:18.072 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:18.081 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:18.091 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:18.090+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:18.185 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:18.185 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:18.192 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:18.191+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:18.194 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:18.293 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:18.292+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:18.298 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:18.298 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:18.309 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:18.393 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:18.394+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:18.425 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:18.426 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:18.434 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:18.465 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-05-07T11:14:18.494 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:18.494+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:18.541 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:18.541 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:18.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:18.595 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:18.595+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:18.656 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:18.656 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:18.665 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:18.705 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:18.705+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:18.772 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:18.772 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:18.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:18.798 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:18.798+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:18.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:18.888 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:18.888 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:18.898 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:18.899 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:18.898+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:18.998 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:18.998+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:19.003 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:19.003 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:19.006 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:19.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:19.041 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:19.041 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:19.060 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:19.060 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:19.099 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:19.099+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:19.127 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:19.127 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:19.128 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:19.128 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:19.136 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:19.200 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:19.200+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:19.241 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:19.241 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:19.242 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:19.242 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:19.242 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:19.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:19.302 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:19.301+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:19.358 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:19.358 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:19.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:19.358 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:19.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.358 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:19.358 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.409569945, 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:19.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:19.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:14:19.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.085344058, 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.365 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:14:19.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:14:19.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:14:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:14:19.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:14:19.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:14:19.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:14:19.371 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.924868658999998, 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.372 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:19.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:19.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:14:19.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:14:19.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:14:19.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:14:19.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:14:19.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:14:19.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:14:19.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:14:19.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:14:19.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:14:19.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:14:19.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:14:19.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:14:19.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:14:19.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:14:19.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:14:19.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:14:19.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:14:19.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:14:19.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.924782291, 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.383 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:19.384 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:19.384 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:19.384 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:14:19.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.384 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:19.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:19.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:14:19.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.695634858000005, 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:14:19.390 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:14:19.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:14:19.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:14:19.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:14:19.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:14:19.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:14:19.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:14:19.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:14:19.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:14:19.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:14:19.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:14:19.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:14:19.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:14:19.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:14:19.398 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.398 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.398 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.398 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:19.398 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:19.398 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.695587392999997, 2024-05-07T11:14:19.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:14:19.399 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.399 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.399 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.399 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:19.399 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:19.399 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:19.399 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:14:19.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:14:19.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:14:19.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:14:19.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:14:19.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:14:19.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:14:19.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.406 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.406 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:19.406 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.313675004999993, 2024-05-07T11:14:19.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:14:19.406 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.406 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.406 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.406 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:14:19.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:14:19.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:14:19.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:14:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:14:19.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:14:19.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:14:19.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:14:19.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:19.413 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.311479921, 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:19.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:14:19.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:14:19.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.419 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.420 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.420 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.420 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:19.420 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.311251701000003, 2024-05-07T11:14:19.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:14:19.420 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.420 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:14:19.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:14:19.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.311072570999997, 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:19.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:14:19.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:19.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:14:19.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:14:19.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:14:19.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.311012696999995, 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:14:19.433 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:19.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:14:19.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:14:19.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:14:19.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:14:19.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.310964525000003, 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.439 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:14:19.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:14:19.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:14:19.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:14:19.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:14:19.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:14:19.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:14:19.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:14:19.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:14:19.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:14:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:14:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:14:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:14:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.310936542999997, 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:14:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:14:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:14:19.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.310903533000001, 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:19.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:19.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:14:19.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:14:19.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:14:19.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:14:19.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:14:19.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.310809728999999, 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:14:19.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:14:19.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:14:19.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:14:19.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.310666287000004, 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:14:19.464 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.465 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.465 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.465 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:19.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:14:19.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:14:19.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.310481382000006, 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:14:19.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:14:19.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:14:19.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:14:19.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:14:19.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:19.477 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.310322311999997, 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:19.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:14:19.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:14:19.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.309878902999998, 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:14:19.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:14:19.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:14:19.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:14:19.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.488 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.309853638999996, 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:19.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.492 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:19.493 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:19.493 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:19.494 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:19.494+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:19.495 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:19.595 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:19.594+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:19.609 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:19.609 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:19.609 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:19.609 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:19.617 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:19.696 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:19.696+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:19.722 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:19.722 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:19.722 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:19.722 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:19.722 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:19.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:19.797 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:19.797+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:19.837 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:19.837 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:19.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:19.838 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:19.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.838 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.838 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:19.838 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.792569904000004, 2024-05-07T11:14:19.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:14:19.839 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.839 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.839 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.839 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:19.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:19.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:14:19.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:14:19.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:14:19.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:14:19.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:14:19.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:14:19.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:14:19.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:14:19.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:14:19.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:14:19.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:19.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:14:19.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:14:19.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:14:19.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:14:19.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:14:19.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:14:19.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:19.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:14:19.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:14:19.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:19.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:14:19.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:14:19.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:14:19.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:14:19.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:14:19.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.849 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.792505184000007, 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:14:19.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:19.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:14:19.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:14:19.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:14:19.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:14:19.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:14:19.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:14:19.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:14:19.856 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.792408244000001, 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:14:19.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:14:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:14:19.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:14:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.863 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.792342906000002, 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:14:19.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:14:19.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:14:19.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:14:19.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:19.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.792316013999994, 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.870 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:14:19.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:14:19.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:14:19.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:14:19.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:14:19.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:14:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:14:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:14:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:14:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.792288436000007, 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:14:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.792253047000003, 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:14:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:14:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:14:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:14:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:14:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.792227440000005, 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:14:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:14:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:14:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:14:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:14:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:14:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.792198010000007, 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:14:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:14:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:14:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:14:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:14:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:14:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.789812036000001, 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:19.900 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.785553496999995, 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.904 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.784905494, 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:14:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:14:19.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:14:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.784260175, 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.909 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:19.913 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.783986611000003, 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:14:19.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:14:19.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:19.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:14:19.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e14/12 ondisk, result = 0)", 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.783226607000003, 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000518371, 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:19.918 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052209+0000", 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052210+0000", 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:14:19.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052215+0000", 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.48e-06 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052225+0000", 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8959999999999998e-06 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052233+0000", 2024-05-07T11:14:19.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3089999999999998e-06 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052584+0000", 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035122099999999998 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052593+0000", 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3219999999999999e-06 2024-05-07T11:14:19.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052728+0000", 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443999999999999 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.782641987999995, 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00047113400000000001, 2024-05-07T11:14:19.922 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052794+0000", 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6699999999999999e-07 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052797+0000", 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.016e-06 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052805+0000", 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1899999999999995e-06 2024-05-07T11:14:19.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052814+0000", 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053133+0000", 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031888000000000001 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053265+0000", 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000131917 2024-05-07T11:14:19.925 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.926 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.926 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.926 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-05-07T11:14:19.926 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:19.926 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 95.778885179, 2024-05-07T11:14:19.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00028630300000000001, 2024-05-07T11:14:19.927 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.927 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.927 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:19.927 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:19.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056551+0000", 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:19.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7079999999999996e-06 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056565+0000", 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4530000000000002e-06 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056582+0000", 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7575999999999999e-05 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056733+0000", 2024-05-07T11:14:19.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000150452 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056739+0000", 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2589999999999997e-06 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056837+0000", 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8005999999999996e-05 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 93.793869145000002, 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:14:19.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:14:19.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:14:19.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:14:19.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 70.791378699999996, 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:19.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:19.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:14:19.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:14:19.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:14:19.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:14:19.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:14:19.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:14:19.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:14:19.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:14:19.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:14:19.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:14:19.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:14:19.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:14:19.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:19.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:14:19.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:14:19.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:19.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:14:19.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:14:19.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:14:19.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:14:19.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:14:19.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:14:19.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:14:19.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:14:19.948 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.949 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.949 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.949 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:14:19.949 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:19.949 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.790643055000004, 2024-05-07T11:14:19.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:14:19.950 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:19.950 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:19.950 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:19.950 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:19.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:19.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:19.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:19.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:19.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:19.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:19.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:14:19.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:14:19.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:19.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:14:19.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:14:19.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:19.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:14:19.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:14:19.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:19.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:14:19.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:14:19.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:19.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:14:19.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:14:19.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:19.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:14:19.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:14:19.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:19.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:14:19.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:14:19.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:19.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:14:19.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:14:19.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:19.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:14:19.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:14:19.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:14:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:14:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:19.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:14:19.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:14:19.960 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.960 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.960 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.960 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:19.961 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:19.961 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:19.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:14:19.965 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:19.962+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:20.027 INFO:tasks.workunit.client.0.smithi062.stderr:Updating files: 92% (11576/12534) Updating files: 93% (11657/12534) Updating files: 94% (11782/12534) Updating files: 95% (11908/12534) Updating files: 96% (12033/12534) Updating files: 97% (12158/12534) Updating files: 98% (12284/12534) Updating files: 99% (12409/12534) Updating files: 100% (12534/12534) Updating files: 100% (12534/12534), done. 2024-05-07T11:14:20.063 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:20.063+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:20.077 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:20.077 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:20.077 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:14:20.077 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:20.086 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T11:14:20.165 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:20.165+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:20.192 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:20.192 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:14:20.192 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-05-07T11:14:20.192 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-05-07T11:14:20.192 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:20.201 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T11:14:20.257 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '510b35d4b766757579df5fd9efd2f892309f09e1'. 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-05-07T11:14:20.258 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:20.259 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-07T11:14:20.259 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:20.259 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 510b35d4b76 Merge pull request #56947 from adk3798/wip-65539-squid 2024-05-07T11:14:20.262 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-07T11:14:20.266 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:14:20.266+0000 7f63259dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29448) UID: 0 2024-05-07T11:14:20.294 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-07T11:14:20.296 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-07T11:14:20.296 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-07T11:14:20.308 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:37 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'14)", 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 101.542100559, 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063301920000000001, 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765599+0000", 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765600+0000", 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765608+0000", 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8769999999999993e-06 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765625+0000", 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6595999999999998e-05 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.765635+0000", 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.008e-05 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766353+0000", 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071826799999999999 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.766373+0000", 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0193000000000001e-05 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771880+0000", 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055069589999999996 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:38.771929+0000", 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9276000000000001e-05 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.875545403, 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059794150000000001, 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432154+0000", 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432155+0000", 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6599999999999996e-07 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432213+0000", 2024-05-07T11:14:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7933000000000003e-05 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432221+0000", 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0630000000000006e-06 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432227+0000", 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3339999999999998e-06 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432258+0000", 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0676999999999998e-05 2024-05-07T11:14:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.432270+0000", 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2145e-05 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438110+0000", 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058397900000000001 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.438134+0000", 2024-05-07T11:14:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3907e-05 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.64593831099999, 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0060242789999999996, 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661761+0000", 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661762+0000", 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999998e-07 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661791+0000", 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8745999999999999e-05 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661801+0000", 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8279999999999998e-06 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661805+0000", 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7620000000000003e-06 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661854+0000", 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8541999999999997e-05 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.661864+0000", 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0312999999999999e-05 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667761+0000", 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058965099999999998 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667786+0000", 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4936999999999999e-05 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.645263137, 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080997240000000009, 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662437+0000", 2024-05-07T11:14:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9100000000000004e-07 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662441+0000", 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1189999999999999e-06 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662452+0000", 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0284e-05 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.662458+0000", 2024-05-07T11:14:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8800000000000002e-06 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664612+0000", 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021539100000000002 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664626+0000", 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3871e-05 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670503+0000", 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058765029999999999 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670536+0000", 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3565999999999997e-05 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'146)", 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.644621316, 2024-05-07T11:14:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007478462, 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663078+0000", 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663079+0000", 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9800000000000003e-07 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663085+0000", 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8540000000000002e-06 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663095+0000", 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9559999999999992e-06 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663099+0000", 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664835+0000", 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017350359999999999 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.664845+0000", 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.077e-05 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670538+0000", 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056929830000000004 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.670557+0000", 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8610999999999999e-05 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.330 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'146)", 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.644152908, 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098773899999999998, 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663547+0000", 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9500000000000002e-07 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663566+0000", 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929000000000001e-05 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663576+0000", 2024-05-07T11:14:20.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7280000000000007e-06 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.663581+0000", 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665058+0000", 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001476984 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.665071+0000", 2024-05-07T11:14:20.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3647e-05 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673390+0000", 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0083188189999999999 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673424+0000", 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4187000000000003e-05 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4141.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'146)", 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.641447387, 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071923530000000003, 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666252+0000", 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666253+0000", 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9299999999999998e-07 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666257+0000", 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4120000000000003e-06 2024-05-07T11:14:20.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666268+0000", 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0179e-05 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.666272+0000", 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6380000000000003e-06 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667565+0000", 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001292449 2024-05-07T11:14:20.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.667577+0000", 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2768e-05 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673426+0000", 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058490510000000001 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:39.673445+0000", 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8263000000000001e-05 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.264131006, 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015029127999999999, 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043569+0000", 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043572+0000", 2024-05-07T11:14:20.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043585+0000", 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3443e-05 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043595+0000", 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6029999999999994e-06 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043603+0000", 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5189999999999992e-06 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3287000000000006e-05 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043674+0000", 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9779999999999999e-06 2024-05-07T11:14:20.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047799+0000", 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041253790000000002 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048439+0000", 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00064006499999999999 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048573+0000", 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134132 2024-05-07T11:14:20.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055080+0000", 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006507367 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058521+0000", 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034409169999999999 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058562+0000", 2024-05-07T11:14:20.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0293999999999997e-05 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058598+0000", 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6188e-05 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.264074230999995, 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015953559999999999, 2024-05-07T11:14:20.345 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043625+0000", 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043626+0000", 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1699999999999998e-07 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043630+0000", 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9489999999999998e-06 2024-05-07T11:14:20.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043638+0000", 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8110000000000003e-06 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043644+0000", 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043742+0000", 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8167999999999999e-05 2024-05-07T11:14:20.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043747+0000", 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049129+0000", 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053825849999999996 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049220+0000", 2024-05-07T11:14:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0169999999999999e-05 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049372+0000", 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015216700000000001 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056074+0000", 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067021479999999998 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059504+0000", 2024-05-07T11:14:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034303089999999999 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059550+0000", 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5976999999999997e-05 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059579+0000", 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8804000000000001e-05 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.264045760000002, 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014943432, 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043654+0000", 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2300000000000001e-07 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043667+0000", 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2320000000000001e-05 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043676+0000", 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0909999999999999e-06 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043684+0000", 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6170000000000001e-06 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043734+0000", 2024-05-07T11:14:20.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0207000000000002e-05 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043739+0000", 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2850000000000002e-06 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046463+0000", 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027243800000000002 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046588+0000", 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012487899999999999 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046697+0000", 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010832600000000001 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054277+0000", 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0075804790000000002 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058502+0000", 2024-05-07T11:14:20.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042251190000000003 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058553+0000", 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1245999999999997e-05 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058597+0000", 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3959999999999999e-05 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.264006965999997, 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015051933999999999, 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043693+0000", 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043696+0000", 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043704+0000", 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5079999999999999e-06 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043710+0000", 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9030000000000001e-06 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043760+0000", 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0179999999999997e-05 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043765+0000", 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047069+0000", 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033046199999999999 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047318+0000", 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024850499999999999 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:20.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047597+0000", 2024-05-07T11:14:20.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027959700000000003 2024-05-07T11:14:20.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:20.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054590+0000", 2024-05-07T11:14:20.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069922969999999997 2024-05-07T11:14:20.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058648+0000", 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040583800000000003 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058702+0000", 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4284999999999999e-05 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058745+0000", 2024-05-07T11:14:20.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2336999999999998e-05 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.263963642999997, 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010673258, 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043736+0000", 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1600000000000002e-07 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043740+0000", 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0570000000000001e-06 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043745+0000", 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1529999999999996e-06 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043748+0000", 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4369999999999999e-06 2024-05-07T11:14:20.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7521999999999998e-05 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043789+0000", 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6940000000000001e-06 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045833+0000", 2024-05-07T11:14:20.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020436170000000002 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046178+0000", 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000345321 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046484+0000", 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030598499999999999 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:20.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.049401+0000", 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029168969999999999 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054293+0000", 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048921859999999998 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054367+0000", 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4082e-05 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054409+0000", 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1891000000000003e-05 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.263941091999996, 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014778581000000001, 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.373 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043759+0000", 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-05-07T11:14:20.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043761+0000", 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0660000000000002e-06 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043766+0000", 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8199999999999996e-06 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043769+0000", 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0249999999999998e-06 2024-05-07T11:14:20.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043813+0000", 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3934999999999999e-05 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043818+0000", 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.045e-06 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046853+0000", 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030356010000000002 2024-05-07T11:14:20.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.046956+0000", 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102561 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.047270+0000", 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000314104 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054431+0000", 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071610299999999997 2024-05-07T11:14:20.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058449+0000", 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040178159999999996 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058497+0000", 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7817e-05 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.058537+0000", 2024-05-07T11:14:20.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0488000000000003e-05 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.263917031999995, 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016207464000000001, 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043783+0000", 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8000000000000002e-07 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043786+0000", 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043790+0000", 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000004e-06 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043794+0000", 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5899999999999999e-06 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3877000000000001e-05 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043831+0000", 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5140000000000002e-06 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050527+0000", 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066960370000000002 2024-05-07T11:14:20.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050623+0000", 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5771000000000002e-05 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050710+0000", 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7474999999999999e-05 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056287+0000", 2024-05-07T11:14:20.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055768800000000002 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059893+0000", 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003605628 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059939+0000", 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5871999999999997e-05 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.059990+0000", 2024-05-07T11:14:20.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359000000000001e-05 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.263898072000003, 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011177776, 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043802+0000", 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.53e-07 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043804+0000", 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680000000000001e-06 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043810+0000", 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043815+0000", 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3260000000000003e-06 2024-05-07T11:14:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043854+0000", 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8711000000000003e-05 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043857+0000", 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3809999999999999e-06 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045064+0000", 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00120638 2024-05-07T11:14:20.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045186+0000", 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012190599999999999 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.054979+0000", 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097937089999999994 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.263871399999999, 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077275069999999998, 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043828+0000", 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043829+0000", 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043832+0000", 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.903e-06 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043839+0000", 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2790000000000001e-06 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043844+0000", 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3369999999999999e-06 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043890+0000", 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5948000000000001e-05 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.043896+0000", 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2820000000000004e-06 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001041342 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.045075+0000", 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013773999999999999 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.051556+0000", 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064811979999999996 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.259367139999995, 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069208129999999996, 2024-05-07T11:14:20.394 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048333+0000", 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048348+0000", 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4423999999999999e-05 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048364+0000", 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6396999999999999e-05 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048372+0000", 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7340000000000008e-06 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048498+0000", 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012633699999999999 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.048525+0000", 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7144e-05 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055218+0000", 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006692389 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.055253+0000", 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5719000000000001e-05 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:6 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:20.398 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.257640613000007, 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061105200000000004, 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050059+0000", 2024-05-07T11:14:20.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050060+0000", 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050072+0000", 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2551000000000001e-05 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050083+0000", 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0419e-05 2024-05-07T11:14:20.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050089+0000", 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050137+0000", 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8056999999999997e-05 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050168+0000", 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0629000000000001e-05 2024-05-07T11:14:20.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056129+0000", 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059610510000000002 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056170+0000", 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0892000000000001e-05 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:18 3.14 e14/12 3:2f55791f:::606.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.257488279, 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059760969999999997, 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050211+0000", 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050212+0000", 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050230+0000", 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7762999999999999e-05 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050240+0000", 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0771000000000001e-05 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050248+0000", 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1300000000000003e-06 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050299+0000", 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1578e-05 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050324+0000", 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5202999999999999e-05 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056157+0000", 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005832889 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056188+0000", 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0324999999999998e-05 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.406 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(mds.0.3:7 3.10 e14/12 3:0d82a743:::600.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.257435306999994, 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059801630000000001, 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050264+0000", 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050265+0000", 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9900000000000001e-07 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050270+0000", 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050277+0000", 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1409999999999999e-06 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050282+0000", 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8329999999999999e-06 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050338+0000", 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5099000000000002e-05 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.050357+0000", 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9167000000000001e-05 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056200+0000", 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428819999999998 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-05-07T11:12:44.056245+0000", 2024-05-07T11:14:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4932999999999998e-05 2024-05-07T11:14:20.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.411 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-07T11:14:20.411 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-05-07T11:14:20.411 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:14:20.412 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:20.413 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:20.412+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:20.476 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-05-07T11:14:20.476 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:14:20.476 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-05-07T11:14:20.476 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi149.front.sepia.ceph.com 2024-05-07T11:14:20.476 INFO:teuthology.orchestra.console.smithi149:Power off 2024-05-07T11:14:20.476 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-07T11:14:20.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T11:14:20.501 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2024-05-07T11:14:20.501 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:14:20.514 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:20.513+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:20.524 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-05-07T11:14:20.529 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:20.529 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:20.539 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:20.615 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:20.615+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:20.645 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:20.645 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:20.645 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:20.645 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:20.645 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:20.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:20.717 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:20.716+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:20.764 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:20.764 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:20.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:20.765 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:20.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.765 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:20.765 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:20.765 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 101.812320954, 2024-05-07T11:14:20.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012127054999999999, 2024-05-07T11:14:20.766 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.766 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.766 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.767 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:20.767 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:20.767 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:20.767 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 117 2024-05-07T11:14:20.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.768 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:20.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:20.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946859+0000", 2024-05-07T11:14:20.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7800000000000002e-07 2024-05-07T11:14:20.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946864+0000", 2024-05-07T11:14:20.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5630000000000002e-06 2024-05-07T11:14:20.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946870+0000", 2024-05-07T11:14:20.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-05-07T11:14:20.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.946875+0000", 2024-05-07T11:14:20.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.408e-06 2024-05-07T11:14:20.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953726+0000", 2024-05-07T11:14:20.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068519189999999997 2024-05-07T11:14:20.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953804+0000", 2024-05-07T11:14:20.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7307999999999999e-05 2024-05-07T11:14:20.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.953969+0000", 2024-05-07T11:14:20.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165642 2024-05-07T11:14:20.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.954557+0000", 2024-05-07T11:14:20.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058812100000000004 2024-05-07T11:14:20.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958908+0000", 2024-05-07T11:14:20.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043508519999999997 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958952+0000", 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3863000000000003e-05 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:38.958986+0000", 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3581999999999998e-05 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.778 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 101.488095067, 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.779 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:20.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:14:20.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:20.784 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 101.327619668, 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 101.3275333, 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.790 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:20.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:14:20.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:14:20.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 101.098385867, 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:14:20.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:14:20.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 101.098338402, 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.802 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:14:20.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:14:20.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.807 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.716426014000007, 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:14:20.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:14:20.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:14:20.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:14:20.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:14:20.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:14:20.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:14:20.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:14:20.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:14:20.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:14:20.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:14:20.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.714230929999999, 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.815 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:14:20.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:14:20.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.714002710000003, 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.821 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:14:20.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.713823579999996, 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:14:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:14:20.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:14:20.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:14:20.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.713763705999995, 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:14:20.833 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.713715534000002, 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:14:20.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:14:20.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.713687551999996, 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.844 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:14:20.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:14:20.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:14:20.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:20.849 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.713654542, 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:20.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.713560737999998, 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012318176, 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.855 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045619+0000", 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045620+0000", 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8599999999999998e-07 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045638+0000", 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3514e-05 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045645+0000", 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2150000000000004e-06 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045737+0000", 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2202999999999998e-05 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045741+0000", 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0609999999999997e-06 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050028+0000", 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042862309999999997 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050177+0000", 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148997 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050362+0000", 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000185763 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057816+0000", 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007453342 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057844+0000", 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8208000000000002e-05 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057896+0000", 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2261e-05 2024-05-07T11:14:20.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.057937+0000", 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0915999999999999e-05 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.713417296000003, 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:14:20.861 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:14:20.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:20.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:14:20.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.867 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.713232391000005, 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:14:20.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:14:20.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.713073320999996, 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.873 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:14:20.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:14:20.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.712629911999997, 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:20.879 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 96.712604647999996, 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012293056, 2024-05-07T11:14:20.884 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046575+0000", 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8700000000000001e-07 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046578+0000", 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3920000000000001e-06 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046585+0000", 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8170000000000001e-06 2024-05-07T11:14:20.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046589+0000", 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7299999999999996e-06 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052768+0000", 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061784830000000002 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052972+0000", 2024-05-07T11:14:20.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020372200000000001 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058868+0000", 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058965249999999997 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:20.888 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:20.890 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:20.889+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:20.890 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:20.913 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-07T11:14:20.976 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-07T11:14:20.990 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:20.990+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:21.006 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:21.006 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:21.007 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:21.007 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:21.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:21.016 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-07T11:14:21.018 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-07T11:14:21.018 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-07T11:14:21.059 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-07T11:14:21.062 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:14:21.062 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-07T11:14:21.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:21.080 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-05-07T11:14:21.081 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-05-07T11:14:21.081 DEBUG:teuthology.orchestra.run.smithi062:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=510b35d4b766757579df5fd9efd2f892309f09e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-05-07T11:14:21.091 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:21.091+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:21.121 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:21.121 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:21.121 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:21.121 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:21.121 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:21.130 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:21.144 INFO:tasks.workunit.client.0.smithi062.stderr:+ set -e 2024-05-07T11:14:21.144 INFO:tasks.workunit.client.0.smithi062.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-05-07T11:14:21.147 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into 'xfstests-dev'... 2024-05-07T11:14:21.192 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:21.192+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:21.214 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:21.214 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:21.233 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:21.233 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:21.236 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:21.236 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:21.246 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:21.261 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:21.261 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:21.293 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:21.292+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:21.352 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:21.352 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:21.361 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:21.401 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:21.401+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-05-07T11:14:21.495 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:21.494+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:21.506 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:21.506 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:21.515 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:21.596 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:21.596+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:21.660 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:21.661 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:21.669 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:21.713 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:21.713+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:21.775 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:21.775 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:21.783 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:21.797 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:21.797+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:21.897 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:21.898+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:21.928 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:21.928 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:21.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:21.998 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:21.998+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:22.043 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:22.043 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:22.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:22.100 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:22.100+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:22.158 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:22.159 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:22.167 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:22.201 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:22.201+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:22.272 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:22.272 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:22.281 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:22.325 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:22.325+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:22.387 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:22.387 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:22.396 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:22.439 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:22.439+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:22.504 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:22.504 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:22.504 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:22.504+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:22.513 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:22.605 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:22.605+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:22.658 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:22.658 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:22.667 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:22.706 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:22.706+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:22.772 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:22.772 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:22.781 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:22.824 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:22.824+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:22.889 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:22.889 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:22.898 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:22.908 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:22.908+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:23.009 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:23.009+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:23.043 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:23.043 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:23.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:23.137 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:23.137+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:23.197 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:23.198 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:23.206 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:23.251 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:23.251+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:23.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:23.312 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:23.312+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:23.316 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:23.316 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:23.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:23.414 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:23.414+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:23.443 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:23.464 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-05-07T11:14:23.464 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T11:14:23.471 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:23.471 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:23.471 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:23.471 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:23.471 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:23.480 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:23.485 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:23.496 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:14:23.523 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:23.523+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:23.586 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:23.587 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:23.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:23.587 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:23.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.587 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:23.587 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:23.587 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.542334530000005, 2024-05-07T11:14:23.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:14:23.587 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.587 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:14:23.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.542269809999993, 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.593 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:14:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:14:23.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.542172870000002, 2024-05-07T11:14:23.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:14:23.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:23.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:23.605 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.542107532000003, 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:23.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:14:23.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:14:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:14:23.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.611 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.612 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.612 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:23.612 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:23.612 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.542080639999995, 2024-05-07T11:14:23.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:14:23.612 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:23.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:23.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:14:23.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:14:23.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:14:23.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:23.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:14:23.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:14:23.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:23.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.542053061999994, 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:14:23.620 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:14:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:14:23.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:14:23.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.625 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.542017673000004, 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:23.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:14:23.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:14:23.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:14:23.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:14:23.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.541992066000006, 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:14:23.630 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:14:23.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:14:23.634 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.541962635999994, 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:14:23.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:14:23.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:14:23.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 0 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.539576662000002, 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038643729999999999, 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "reached pg", 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045624+0000", 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2200000000000004e-07 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045634+0000", 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045651+0000", 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6290000000000002e-05 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045675+0000", 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4494999999999998e-05 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045999+0000", 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032402400000000001 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049488+0000", 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003489055 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.642 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.535318122999996, 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:14:23.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:14:23.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.534670120000001, 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038380950000000001, 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050530+0000", 2024-05-07T11:14:23.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050531+0000", 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5600000000000005e-07 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050538+0000", 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9530000000000002e-06 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050547+0000", 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1419999999999999e-06 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050566+0000", 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8465e-05 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050742+0000", 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017687700000000001 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050759+0000", 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6393e-05 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054322+0000", 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035632789999999999 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054368+0000", 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6230000000000003e-05 2024-05-07T11:14:23.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.534024801000001, 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003487483, 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051176+0000", 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:23.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051181+0000", 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809999999999998e-06 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051191+0000", 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.747e-06 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051198+0000", 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7929999999999998e-06 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051247+0000", 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8782000000000002e-05 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051271+0000", 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3883000000000002e-05 2024-05-07T11:14:23.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054623+0000", 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033520799999999999 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054663+0000", 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9978000000000002e-05 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 99.533751237000004, 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003510923, 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051449+0000", 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051450+0000", 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051458+0000", 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6210000000000004e-06 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051467+0000", 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2839999999999995e-06 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8310000000000007e-06 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051535+0000", 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9134e-05 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051606+0000", 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1662999999999995e-05 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054581+0000", 2024-05-07T11:14:23.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029745940000000001 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054960+0000", 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037905600000000001 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 97.543633771000003, 2024-05-07T11:14:23.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0019610180000000001, 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041567+0000", 2024-05-07T11:14:23.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041569+0000", 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4499999999999998e-06 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041585+0000", 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5529e-05 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041615+0000", 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0750000000000002e-05 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041630+0000", 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5038999999999999e-05 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041782+0000", 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015165600000000001 2024-05-07T11:14:23.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041885+0000", 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010328900000000001 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.041978+0000", 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2275999999999995e-05 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.042622+0000", 2024-05-07T11:14:23.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00064441599999999998 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043463+0000", 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00084112399999999995 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043496+0000", 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2804e-05 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:46.043528+0000", 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1684999999999999e-05 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 74.541143325999997, 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0016281900000000001, 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044057+0000", 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044061+0000", 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0400000000000003e-06 2024-05-07T11:14:23.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044076+0000", 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4440000000000001e-05 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044107+0000", 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1052e-05 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044128+0000", 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1586999999999998e-05 2024-05-07T11:14:23.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044285+0000", 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000157059 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044354+0000", 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8739999999999996e-05 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:23.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.044447+0000", 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2823000000000002e-05 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045006+0000", 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055880199999999995 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045618+0000", 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00061195900000000003 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045654+0000", 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6424000000000002e-05 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:09.045685+0000", 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1263999999999997e-05 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:23.672 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 69.540407681000005, 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014759910000000001, 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044793+0000", 2024-05-07T11:14:23.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044796+0000", 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0400000000000001e-06 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044810+0000", 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044841+0000", 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1538999999999997e-05 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.044862+0000", 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1053e-05 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045001+0000", 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013833399999999999 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045076+0000", 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5399000000000001e-05 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045175+0000", 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9017000000000004e-05 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.045813+0000", 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00063744099999999998 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046207+0000", 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00039441999999999998 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046238+0000", 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1179000000000001e-05 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:13:14.046269+0000", 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0436000000000001e-05 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.677 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:8 4.26 4:658f2455:::100000001ff.00000000:head [write 0~2312] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:21.168226+0000", 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 2.4169746760000002, 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00118895, 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:23.678 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 8 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.168226+0000", 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.168226+0000", 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.168227+0000", 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.108e-06 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.168232+0000", 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.168239+0000", 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.661e-06 2024-05-07T11:14:23.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.168246+0000", 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6919999999999996e-06 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.168291+0000", 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5358000000000002e-05 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.168383+0000", 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2107000000000004e-05 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.168473+0000", 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9648000000000006e-05 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.169051+0000", 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000577872 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.169359+0000", 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000308244 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.169387+0000", 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7764999999999999e-05 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.169415+0000", 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7674e-05 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.683 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~1378] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:21.177424+0000", 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 2.4077762109999998, 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022559559999999999, 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:23.684 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 15 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.177424+0000", 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.177424+0000", 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.177425+0000", 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.031e-06 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.177431+0000", 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8130000000000001e-06 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.177443+0000", 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1654999999999999e-05 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.177450+0000", 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.844e-06 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.177495+0000", 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5871000000000002e-05 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.177574+0000", 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8994999999999998e-05 2024-05-07T11:14:23.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.177647+0000", 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.2306999999999997e-05 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.178139+0000", 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049257499999999998 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.179625+0000", 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0014858569999999999 2024-05-07T11:14:23.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.179654+0000", 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.921e-05 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.179680+0000", 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5797999999999999e-05 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:21 4.b 4:d3eda40d:::1000000020f.00000000:head [write 0~36] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:21.191941+0000", 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 2.3932594370000002, 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011434940000000001, 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 21 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:23.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.191941+0000", 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.191941+0000", 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.191942+0000", 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0109999999999999e-06 2024-05-07T11:14:23.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.191947+0000", 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8910000000000003e-06 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.191959+0000", 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2524000000000001e-05 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.191967+0000", 2024-05-07T11:14:23.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.17e-06 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.192054+0000", 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7398000000000006e-05 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.192134+0000", 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0494000000000006e-05 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:23.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.192211+0000", 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6956e-05 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.192813+0000", 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00060194999999999997 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.193021+0000", 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020713700000000001 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.193057+0000", 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6779999999999997e-05 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:21.193084+0000", 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7183e-05 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:23.695 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:23.697 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:23.696+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:23.697 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:23.798 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:23.797+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:23.805 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:23.805 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:23.805 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:23.806 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:23.815 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:23.899 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:23.899+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:23.964 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:23.964 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:23.965 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:23.965 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:23.965 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:23.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:24.015 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:24.015+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:24.101 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:24.101+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:24.131 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.858908228, 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012707418999999999, 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.132 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 165 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271085+0000", 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3500000000000002e-07 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271090+0000", 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7929999999999997e-06 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271095+0000", 2024-05-07T11:14:24.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0989999999999998e-06 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.271098+0000", 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9679999999999998e-06 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278312+0000", 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072145350000000002 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278362+0000", 2024-05-07T11:14:24.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9728000000000002e-05 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278450+0000", 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7886000000000005e-05 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.278905+0000", 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045473099999999999 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283614+0000", 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047088870000000001 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283754+0000", 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140056 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.283792+0000", 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8300999999999998e-05 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.698432829, 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012329747, 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.138 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 188 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431560+0000", 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.29e-07 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431630+0000", 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9369999999999995e-05 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431636+0000", 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6039999999999998e-06 2024-05-07T11:14:24.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431640+0000", 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3249999999999999e-06 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437519+0000", 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058797559999999999 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437563+0000", 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3359999999999998e-05 2024-05-07T11:14:24.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437632+0000", 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9103999999999994e-05 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440534+0000", 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029019369999999998 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443834+0000", 2024-05-07T11:14:24.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032998020000000001 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443865+0000", 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1189000000000002e-05 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443890+0000", 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5071000000000001e-05 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.698346461, 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012331095, 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 189 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431646+0000", 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431647+0000", 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1600000000000002e-07 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431649+0000", 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.199e-06 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431652+0000", 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4000000000000001e-06 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.431655+0000", 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437946+0000", 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006291128 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.437999+0000", 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3383e-05 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.438079+0000", 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9868000000000002e-05 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.440537+0000", 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024575529999999999 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443924+0000", 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033872820000000001 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443955+0000", 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0803999999999998e-05 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.443977+0000", 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2643e-05 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:206 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.46919902800001, 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013021674, 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 206 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660794+0000", 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.15e-07 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660827+0000", 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3028000000000003e-05 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660833+0000", 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7849999999999997e-06 2024-05-07T11:14:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660836+0000", 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1609999999999999e-06 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663267+0000", 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024311049999999998 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663310+0000", 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2941000000000001e-05 2024-05-07T11:14:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.663380+0000", 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0198999999999997e-05 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.671346+0000", 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007965359 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673734+0000", 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023887130000000002 2024-05-07T11:14:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673791+0000", 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7022999999999999e-05 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673815+0000", 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4045000000000001e-05 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4141.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.469151563, 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013731625000000001, 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4141", 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.62:0/3213771254", 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 207 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660841+0000", 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660842+0000", 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5800000000000001e-07 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660844+0000", 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.058e-06 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660847+0000", 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.264e-06 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.660849+0000", 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.525e-06 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.665996+0000", 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051462959999999999 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666063+0000", 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7049000000000001e-05 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.666136+0000", 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2998999999999997e-05 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.673847+0000", 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077108109999999997 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674517+0000", 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067002200000000004 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674549+0000", 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2191999999999999e-05 2024-05-07T11:14:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:39.674573+0000", 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4151e-05 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.08723917499999, 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016152344999999999, 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042754+0000", 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042755+0000", 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5269999999999999e-06 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042763+0000", 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2479999999999996e-06 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042775+0000", 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1884e-05 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.042788+0000", 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045146+0000", 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002358387 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045154+0000", 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8140000000000001e-06 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048731+0000", 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035762910000000001 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.048876+0000", 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014565199999999999 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049040+0000", 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000163809 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.055517+0000", 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064768300000000003 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058807+0000", 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003290116 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058865+0000", 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8352e-05 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058906+0000", 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0738999999999997e-05 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.085044091, 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014156304999999999, 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044949+0000", 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044950+0000", 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.111e-06 2024-05-07T11:14:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044956+0000", 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0619999999999997e-06 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.044994+0000", 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8111999999999997e-05 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045010+0000", 2024-05-07T11:14:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6045999999999998e-05 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034685800000000002 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045362+0000", 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049651+0000", 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042888520000000001 2024-05-07T11:14:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049753+0000", 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102166 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.049894+0000", 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014099800000000001 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056556+0000", 2024-05-07T11:14:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066626960000000001 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058993+0000", 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002436995 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059055+0000", 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1834000000000005e-05 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059105+0000", 2024-05-07T11:14:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9787999999999998e-05 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.084815871, 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014112186000000001, 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045177+0000", 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045178+0000", 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7000000000000003e-07 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045256+0000", 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7772e-05 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045268+0000", 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1824999999999999e-05 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045275+0000", 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3320000000000003e-06 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045403+0000", 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012843500000000001 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045410+0000", 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4919999999999998e-06 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050222+0000", 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048117749999999999 2024-05-07T11:14:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050589+0000", 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036728299999999999 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050924+0000", 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033541499999999999 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058713+0000", 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077888289999999997 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059207+0000", 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049369699999999997 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059249+0000", 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1949000000000001e-05 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059289+0000", 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0411999999999999e-05 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.084636741, 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014088384000000001, 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045356+0000", 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045357+0000", 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1999999999999998e-07 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045363+0000", 2024-05-07T11:14:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045376+0000", 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.295e-05 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045388+0000", 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2177999999999999e-05 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045458+0000", 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0256e-05 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045462+0000", 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7570000000000002e-06 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051392+0000", 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059297300000000002 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051476+0000", 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4400999999999994e-05 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051734+0000", 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025747500000000001 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058921+0000", 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071875120000000001 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059340+0000", 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041828699999999999 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059401+0000", 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1366999999999997e-05 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059444+0000", 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3541999999999997e-05 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.084576867, 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014321212999999999, 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045416+0000", 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2e-07 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045431+0000", 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4531e-05 2024-05-07T11:14:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045440+0000", 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9279999999999999e-06 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045446+0000", 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052149+0000", 2024-05-07T11:14:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067026569999999999 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052282+0000", 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013316700000000001 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052404+0000", 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121814 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058928+0000", 2024-05-07T11:14:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065235800000000002 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059488+0000", 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000560361 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059536+0000", 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7830000000000001e-05 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059737+0000", 2024-05-07T11:14:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020132 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.084528695, 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014439426999999999, 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045464+0000", 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045465+0000", 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8400000000000004e-07 2024-05-07T11:14:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045468+0000", 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6959999999999998e-06 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045475+0000", 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7909999999999999e-06 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045481+0000", 2024-05-07T11:14:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.818e-06 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052843+0000", 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073623869999999998 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052921+0000", 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7298000000000004e-05 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053097+0000", 2024-05-07T11:14:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017652299999999999 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058934+0000", 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058365480000000004 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059773+0000", 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083927199999999996 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059867+0000", 2024-05-07T11:14:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3583000000000002e-05 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059904+0000", 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6927000000000001e-05 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.084500713, 2024-05-07T11:14:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01454037, 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045492+0000", 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045493+0000", 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7999999999999996e-07 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045501+0000", 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8979999999999996e-06 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045509+0000", 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6619999999999994e-06 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045515+0000", 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8590000000000001e-06 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053418+0000", 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079028780000000003 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053566+0000", 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014820799999999999 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.053717+0000", 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015054900000000001 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059303+0000", 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055863670000000001 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059951+0000", 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064758399999999999 2024-05-07T11:14:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059996+0000", 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.498e-05 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060033+0000", 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6905e-05 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.084467703, 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016544255000000001, 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045525+0000", 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045526+0000", 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0400000000000005e-07 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045529+0000", 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.123e-06 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045546+0000", 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6469000000000001e-05 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045552+0000", 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4579999999999998e-06 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060093+0000", 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014540740999999999 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060170+0000", 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7509999999999995e-05 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060297+0000", 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012644800000000001 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.060902+0000", 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060519100000000004 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062002+0000", 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001100169 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062036+0000", 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.062069+0000", 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3732000000000002e-05 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.084230457, 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012356546, 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045762+0000", 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045764+0000", 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2699999999999999e-06 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045770+0000", 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:14:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045782+0000", 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1810999999999999e-05 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045789+0000", 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1709999999999996e-06 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045824+0000", 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4431000000000003e-05 2024-05-07T11:14:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045827+0000", 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051011+0000", 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051838910000000004 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051178+0000", 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016647999999999999 2024-05-07T11:14:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051366+0000", 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000188567 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.056472+0000", 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051057409999999996 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058003+0000", 2024-05-07T11:14:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015312749999999999 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058069+0000", 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5959999999999999e-05 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058119+0000", 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9731000000000002e-05 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.08404555200001, 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012369679, 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045947+0000", 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045948+0000", 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0979999999999999e-06 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045955+0000", 2024-05-07T11:14:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6420000000000001e-06 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045966+0000", 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0698e-05 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.045974+0000", 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.841e-06 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051194+0000", 2024-05-07T11:14:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052199259999999997 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051305+0000", 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011199199999999999 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051436+0000", 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013088999999999999 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058129+0000", 2024-05-07T11:14:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066922220000000003 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058226+0000", 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7168000000000002e-05 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058277+0000", 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0896999999999997e-05 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058317+0000", 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0305000000000001e-05 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.083886482, 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012573888, 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046106+0000", 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046107+0000", 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8000000000000005e-07 2024-05-07T11:14:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046133+0000", 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5834999999999999e-05 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046142+0000", 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2229999999999996e-06 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046149+0000", 2024-05-07T11:14:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1069999999999999e-06 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.051914+0000", 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649939999999998 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052087+0000", 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000173034 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.052252+0000", 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164971 2024-05-07T11:14:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058137+0000", 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058842570000000004 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058364+0000", 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000227548 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058454+0000", 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9635999999999994e-05 2024-05-07T11:14:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.058680+0000", 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000226503 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.083443073, 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012832379999999999, 2024-05-07T11:14:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046550+0000", 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6499999999999999e-07 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046555+0000", 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2910000000000001e-06 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046561+0000", 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7449999999999998e-06 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.046567+0000", 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4620000000000004e-06 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050470+0000", 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039033370000000002 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050598+0000", 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012800299999999999 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.050733+0000", 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013497499999999999 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059133+0000", 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083995110000000001 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059297+0000", 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016481800000000001 2024-05-07T11:14:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059343+0000", 2024-05-07T11:14:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5339000000000001e-05 2024-05-07T11:14:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:12:44.059382+0000", 2024-05-07T11:14:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9434000000000002e-05 2024-05-07T11:14:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:30 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3621284] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:23.655474+0000", 2024-05-07T11:14:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.47451876999999998, 2024-05-07T11:14:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019598880999999999, 2024-05-07T11:14:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 30 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.655474+0000", 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.655474+0000", 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.655476+0000", 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.12e-06 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.660004+0000", 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045275380000000002 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.660022+0000", 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7867e-05 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.660030+0000", 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0660000000000004e-06 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.660107+0000", 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7605e-05 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.660227+0000", 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120146 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.660331+0000", 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010346899999999999 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.672008+0000", 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01167729 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.674996+0000", 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029876770000000002 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.675032+0000", 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6006000000000001e-05 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.675073+0000", 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1097000000000003e-05 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:31 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:23.660058+0000", 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.469934878, 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023867551000000001, 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 31 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.660058+0000", 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.660058+0000", 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.660059+0000", 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8199999999999999e-07 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.664574+0000", 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045152059999999999 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.664593+0000", 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9018999999999999e-05 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.664607+0000", 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3929e-05 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.664676+0000", 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9399000000000004e-05 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.664828+0000", 2024-05-07T11:14:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015159900000000001 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.664967+0000", 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013910600000000001 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.673777+0000", 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088100729999999999 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.683773+0000", 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0099960629999999995 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.683869+0000", 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6249000000000006e-05 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:23.683926+0000", 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6226e-05 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:220 4.c 4:321f1923:::100000002f2.00000000:head [write 0~6269] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.079900+0000", 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.050092530000000003, 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013426366, 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 220 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.079900+0000", 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.079900+0000", 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.079901+0000", 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7599999999999997e-07 2024-05-07T11:14:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.079907+0000", 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2740000000000004e-06 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.079915+0000", 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7370000000000006e-06 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.079919+0000", 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5419999999999999e-06 2024-05-07T11:14:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.079964+0000", 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4155e-05 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.080075+0000", 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000111851 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.080197+0000", 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121581 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.087443+0000", 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072455870000000004 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.093275+0000", 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058321919999999999 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.093303+0000", 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8541999999999999e-05 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.093327+0000", 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3329e-05 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.246 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:24.247 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:24.247+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:24.248 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:24.348 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:24.348+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:537 4.0 4:01c877d1:::10000000434.00000000:head [write 0~43 in=43b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.357973+0000", 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.00022029999999999999, 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000236753, 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "waiting for sub ops", 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:24.358 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 537 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.357973+0000", 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.357973+0000", 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.357973+0000", 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1800000000000005e-07 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.357977+0000", 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6909999999999999e-06 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.357987+0000", 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8060000000000006e-06 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.357992+0000", 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7639999999999996e-06 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.358067+0000", 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4936000000000002e-05 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.358135+0000", 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8808999999999998e-05 2024-05-07T11:14:24.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.358207+0000", 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1791000000000004e-05 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 1 2024-05-07T11:14:24.362 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:24.367 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:24.449 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:24.449+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:24.475 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:24.475 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:24.475 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:24.475 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:24.476 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:24.485 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:14:24.525 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:14:24.550 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:24.550+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:24.636 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-05-07T11:14:24.643 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:24.643 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:24.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 100.59890125, 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013450966999999999, 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042866+0000", 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042869+0000", 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.179e-06 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042876+0000", 2024-05-07T11:14:24.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3869999999999997e-06 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042895+0000", 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8675e-05 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042908+0000", 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2979999999999999e-05 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044615+0000", 2024-05-07T11:14:24.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017064560000000001 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044626+0000", 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1094000000000001e-05 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046416+0000", 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001790774 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046722+0000", 2024-05-07T11:14:24.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00030542699999999999 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047018+0000", 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029591900000000001 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050348+0000", 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033299969999999999 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056214+0000", 2024-05-07T11:14:24.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005866586 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056269+0000", 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4484000000000002e-05 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056317+0000", 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8009000000000001e-05 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 100.59883653, 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013538969, 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042931+0000", 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5000000000000002e-07 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.042936+0000", 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043002+0000", 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5717999999999997e-05 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043010+0000", 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1820000000000006e-06 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044735+0000", 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0017247129999999999 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044760+0000", 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5599e-05 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047555+0000", 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002794773 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047631+0000", 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5885999999999998e-05 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047762+0000", 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013108400000000001 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.051739+0000", 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.003977286 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056372+0000", 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046328660000000002 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056426+0000", 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4067999999999998e-05 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056470+0000", 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3302e-05 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 100.59873958999999, 2024-05-07T11:14:24.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013671964, 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043028+0000", 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4900000000000005e-07 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043055+0000", 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7033e-05 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043071+0000", 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5449000000000001e-05 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043081+0000", 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7589999999999992e-06 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044889+0000", 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001808135 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044897+0000", 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046544+0000", 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001646808 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046664+0000", 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012005100000000001 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047067+0000", 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000402953 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050549+0000", 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034822899999999999 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056607+0000", 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060582650000000002 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056657+0000", 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9638000000000001e-05 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056700+0000", 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2574000000000003e-05 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 100.598674252, 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013736731, 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.661 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043093+0000", 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2200000000000004e-07 2024-05-07T11:14:24.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043097+0000", 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9550000000000002e-06 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043104+0000", 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0140000000000001e-06 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043110+0000", 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4060000000000004e-06 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044928+0000", 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001817899 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044937+0000", 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9109999999999999e-06 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047811+0000", 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028745210000000001 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048639+0000", 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000827727 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048785+0000", 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014584099999999999 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052835+0000", 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040505840000000003 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056744+0000", 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039084460000000003 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056791+0000", 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7537000000000002e-05 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056830+0000", 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8268e-05 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 100.59864736, 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014200719000000001, 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043120+0000", 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4600000000000005e-07 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043125+0000", 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6550000000000003e-06 2024-05-07T11:14:24.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043132+0000", 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4030000000000001e-06 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043139+0000", 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.81e-06 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044969+0000", 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018301960000000001 2024-05-07T11:14:24.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044973+0000", 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2329999999999998e-06 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048433+0000", 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034608809999999999 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.048787+0000", 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000353457 2024-05-07T11:14:24.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049053+0000", 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026573699999999999 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052842+0000", 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037890189999999998 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057257+0000", 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044157040000000003 2024-05-07T11:14:24.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057293+0000", 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.5669e-05 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057320+0000", 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7409000000000001e-05 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.672 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 100.598619782, 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0095723010000000001, 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043147+0000", 2024-05-07T11:14:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043148+0000", 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7300000000000001e-07 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043151+0000", 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9730000000000002e-06 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043156+0000", 2024-05-07T11:14:24.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5709999999999997e-06 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043162+0000", 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4040000000000003e-06 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043628+0000", 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00046591999999999998 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043904+0000", 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027596199999999998 2024-05-07T11:14:24.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044074+0000", 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016998 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.046115+0000", 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0020410990000000002 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052599+0000", 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0064840669999999996 2024-05-07T11:14:24.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052666+0000", 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7108999999999997e-05 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.052720+0000", 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3742999999999997e-05 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.677 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 100.598584393, 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.010066438, 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043183+0000", 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6100000000000001e-07 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043186+0000", 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.039e-06 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043195+0000", 2024-05-07T11:14:24.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8489999999999995e-06 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043201+0000", 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4299999999999997e-06 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044374+0000", 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0011733869999999999 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.044593+0000", 2024-05-07T11:14:24.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021859900000000001 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.053249+0000", 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0086565730000000007 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 100.598558786, 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014238134, 2024-05-07T11:14:24.681 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043208+0000", 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043209+0000", 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6399999999999998e-07 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043211+0000", 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.951e-06 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043221+0000", 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.023e-05 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043226+0000", 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4650000000000002e-06 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045086+0000", 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0018591980000000001 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.045091+0000", 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0050000000000004e-06 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049752+0000", 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0046616579999999999 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049871+0000", 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119175 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.057446+0000", 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0075750879999999998 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 100.598529356, 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01351482, 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043238+0000", 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.1099999999999996e-07 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043251+0000", 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3049e-05 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043259+0000", 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.221e-06 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.043266+0000", 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0729999999999999e-06 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047206+0000", 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039404849999999996 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.047374+0000", 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00016817500000000001 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.056753+0000", 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0093783059999999994 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:24.689 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 100.591884843, 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042393930000000002, 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049882+0000", 2024-05-07T11:14:24.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049883+0000", 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049925+0000", 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1749000000000003e-05 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049935+0000", 2024-05-07T11:14:24.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0319000000000001e-05 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.049949+0000", 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3882e-05 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050013+0000", 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3887999999999995e-05 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.050045+0000", 2024-05-07T11:14:24.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.2518999999999998e-05 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054010+0000", 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0039651299999999999 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:12:44.054122+0000", 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011119400000000001 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:55 4.26 4:65e03fee:::10000000240.00000000:head [write 0~2711] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:23.932147+0000", 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.70961966700000001, 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0045171919999999997, 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 55 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.932147+0000", 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.932147+0000", 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.932148+0000", 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4799999999999997e-07 2024-05-07T11:14:24.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.932153+0000", 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4490000000000001e-06 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.932163+0000", 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0465999999999999e-05 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.932168+0000", 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9640000000000002e-06 2024-05-07T11:14:24.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.932234+0000", 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6047e-05 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.932314+0000", 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9794000000000002e-05 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.932393+0000", 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9023999999999994e-05 2024-05-07T11:14:24.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.933701+0000", 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013084629999999999 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.936604+0000", 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029021170000000001 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.936638+0000", 2024-05-07T11:14:24.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.4221000000000003e-05 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.936665+0000", 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6899000000000001e-05 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:91 4.f 4:f23e0db6:::10000000268.00000000:head [write 0~1856] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:23.964422+0000", 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.67734504500000003, 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0061869849999999999, 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.699 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 91 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.964422+0000", 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.964422+0000", 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.964423+0000", 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4300000000000002e-07 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.964429+0000", 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6509999999999998e-06 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.964438+0000", 2024-05-07T11:14:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5699999999999999e-06 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.964446+0000", 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2260000000000005e-06 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.964487+0000", 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0982000000000002e-05 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.964559+0000", 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.2117000000000001e-05 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.964635+0000", 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5369000000000003e-05 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.965162+0000", 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00052742000000000002 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.970558+0000", 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0053959289999999998 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.970584+0000", 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6267000000000001e-05 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:23.970609+0000", 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4610999999999999e-05 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:133 4.21 4:87a106c7:::10000000296.00000000:head [write 0~308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.001638+0000", 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.64012885799999997, 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042874419999999998, 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 133 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.001638+0000", 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.001638+0000", 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.001640+0000", 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.823e-06 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.001651+0000", 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1266e-05 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.001678+0000", 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7027000000000001e-05 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.001691+0000", 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3036e-05 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.001826+0000", 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013482699999999999 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.001925+0000", 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8536999999999995e-05 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.001995+0000", 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9949000000000004e-05 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.002681+0000", 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00068619799999999995 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.005874+0000", 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031927449999999999 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.005903+0000", 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.9051999999999999e-05 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.005926+0000", 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2982000000000001e-05 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:153 4.39 4:9c6081e3:::100000002ab.00000000:head [write 0~4158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.018165+0000", 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.62360238199999996, 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051864299999999997, 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.710 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 153 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.018165+0000", 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.018165+0000", 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.018166+0000", 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.54e-07 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.018172+0000", 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3559999999999998e-06 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.018183+0000", 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0821e-05 2024-05-07T11:14:24.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.018188+0000", 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.327e-06 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.018227+0000", 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9368e-05 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.018296+0000", 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8633999999999994e-05 2024-05-07T11:14:24.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.018362+0000", 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5697999999999993e-05 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.018842+0000", 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048032199999999999 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.023300+0000", 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044577230000000002 2024-05-07T11:14:24.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.023327+0000", 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6922000000000001e-05 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.023351+0000", 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4505e-05 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.715 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:192 4.39 4:9dd81e12:::100000002d6.00000000:head [write 0~2311] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.055850+0000", 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.58591722800000001, 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052545140000000001, 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 192 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.055850+0000", 2024-05-07T11:14:24.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.055850+0000", 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.055852+0000", 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.933e-06 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.055877+0000", 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.4802000000000001e-05 2024-05-07T11:14:24.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.055905+0000", 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7994e-05 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.055918+0000", 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3303e-05 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.055981+0000", 2024-05-07T11:14:24.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.2918999999999998e-05 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.056055+0000", 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4048999999999995e-05 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.056130+0000", 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4944999999999995e-05 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.056659+0000", 2024-05-07T11:14:24.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00052901000000000001 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.061047+0000", 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0043877880000000001 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.061079+0000", 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1942e-05 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.061104+0000", 2024-05-07T11:14:24.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5829e-05 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:222 4.21 4:8753d822:::100000002f4.00000000:head [write 0~7666] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.081550+0000", 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.56021677199999997, 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0092684949999999999, 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 222 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.081550+0000", 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.081550+0000", 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.081552+0000", 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9099999999999999e-06 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.081572+0000", 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9660000000000002e-05 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.081599+0000", 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7336000000000001e-05 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.081613+0000", 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3293e-05 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.081719+0000", 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106845 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.081933+0000", 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00021372200000000001 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.082021+0000", 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7616999999999998e-05 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.082625+0000", 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00060396600000000005 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.090729+0000", 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0081038580000000002 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.090778+0000", 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9264000000000001e-05 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.090819+0000", 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1023999999999999e-05 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:224 4.b 4:d0d39490:::100000002f6.00000000:head [write 0~2005] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.083106+0000", 2024-05-07T11:14:24.726 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.55866109399999997, 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048296880000000004, 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 224 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.083106+0000", 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.083106+0000", 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.083107+0000", 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.083111+0000", 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.33e-06 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.083122+0000", 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0892e-05 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.083127+0000", 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.0599999999999998e-06 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.083166+0000", 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8952000000000002e-05 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.083242+0000", 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5964999999999995e-05 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.083313+0000", 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1200999999999998e-05 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.083769+0000", 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045556699999999998 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.087882+0000", 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0041131040000000002 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.087913+0000", 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0691999999999997e-05 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.087936+0000", 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3155000000000001e-05 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.731 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_repop(client.4549.0:338 4.19 e52/13 4:9a32f33e:::1000000036a.00000000:head v 52'7, mlcod=52'5)", 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.177785+0000", 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.46398208299999999, 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00533389, 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.177785+0000", 2024-05-07T11:14:24.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.177785+0000", 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.177786+0000", 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7400000000000003e-07 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.177794+0000", 2024-05-07T11:14:24.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3420000000000008e-06 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.177803+0000", 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2380000000000003e-06 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.177810+0000", 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.4350000000000002e-06 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.177848+0000", 2024-05-07T11:14:24.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.8209e-05 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.177858+0000", 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0579e-05 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.183082+0000", 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052237469999999999 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.183119+0000", 2024-05-07T11:14:24.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6766e-05 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:343 4.0 4:0040f47f:::1000000036f.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.181390+0000", 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.46037677700000001, 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047568849999999998, 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:24.736 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 343 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.181390+0000", 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.181390+0000", 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.181392+0000", 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8560000000000001e-06 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.181402+0000", 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9599999999999995e-06 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.181430+0000", 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7546999999999999e-05 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.181444+0000", 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4613000000000001e-05 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.181536+0000", 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1372000000000005e-05 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.181717+0000", 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000180996 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.181787+0000", 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0402999999999997e-05 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.182470+0000", 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00068308799999999999 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.186068+0000", 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035975899999999999 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.186112+0000", 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4629999999999998e-05 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.186147+0000", 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.4829999999999997e-05 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:447 4.b 4:d27bd8aa:::100000003da.00000000:head [write 0~126] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:24.741 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.278420+0000", 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 0.363346685, 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0044617499999999996, 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 447 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:24.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.278420+0000", 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.278420+0000", 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.278421+0000", 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5099999999999999e-07 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.278425+0000", 2024-05-07T11:14:24.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6430000000000001e-06 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.278433+0000", 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9370000000000004e-06 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.278437+0000", 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4089999999999996e-06 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.278471+0000", 2024-05-07T11:14:24.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3745000000000003e-05 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.278540+0000", 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.8819000000000006e-05 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.278609+0000", 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9492000000000005e-05 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.279272+0000", 2024-05-07T11:14:24.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00066272399999999995 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.282825+0000", 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0035529009999999998 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.282855+0000", 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0735000000000003e-05 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:24.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.282882+0000", 2024-05-07T11:14:24.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6693999999999999e-05 2024-05-07T11:14:24.747 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.747 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.747 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.747 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:24.747 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:24.747 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:24.748 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:24.749 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:24.748+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:24.849 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:24.849+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:24.870 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:24.870 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:24.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.870 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4.c51d809d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.870 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:24.870 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34754574500000002, 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.347566826, 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:24.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:24.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:732 4.3d 4.b6af1e7d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.874 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.533165+0000", 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.32043599299999997, 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.32049751700000001, 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 732 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533165+0000", 2024-05-07T11:14:24.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533165+0000", 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533167+0000", 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.823e-06 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533177+0000", 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.013e-05 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533199+0000", 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1742e-05 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533212+0000", 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3854e-05 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533325+0000", 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011300500000000001 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533331+0000", 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3940000000000004e-06 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:806 4.12 4.aa31a352 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.878 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.597165+0000", 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.25643572799999997, 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.25652991600000002, 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 806 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.879 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.597165+0000", 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.597165+0000", 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.597166+0000", 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9299999999999997e-07 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.597170+0000", 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2370000000000003e-06 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.597179+0000", 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.054e-06 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.597184+0000", 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9339999999999997e-06 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.597222+0000", 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8411000000000002e-05 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.597228+0000", 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5910000000000003e-06 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.882 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:838 4.23 4.9813a5a3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.625246+0000", 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.22835486999999999, 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.22848079600000001, 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 838 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.625246+0000", 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.625246+0000", 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.625247+0000", 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3300000000000001e-07 2024-05-07T11:14:24.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.625251+0000", 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2749999999999997e-06 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.625262+0000", 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0658e-05 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.625266+0000", 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7870000000000001e-06 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.625317+0000", 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0333000000000001e-05 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.625322+0000", 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0499999999999999e-06 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.886 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:875 4.3 4.e0c4ea03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.658229+0000", 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.19537200499999999, 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.195530498, 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 875 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.658229+0000", 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.658229+0000", 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.658229+0000", 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7000000000000004e-07 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.658233+0000", 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.732e-06 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.658243+0000", 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9240000000000002e-06 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.658248+0000", 2024-05-07T11:14:24.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7670000000000003e-06 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.658299+0000", 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1474999999999998e-05 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.658303+0000", 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7969999999999998e-06 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:912 4.17 4.2e730f57 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.690176+0000", 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.163425177, 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.16361456399999999, 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.891 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 912 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.690176+0000", 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.690176+0000", 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.690178+0000", 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8670000000000001e-06 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.690188+0000", 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.013e-05 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.690215+0000", 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7012000000000002e-05 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.690228+0000", 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3740000000000001e-05 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.690335+0000", 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010635499999999999 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.690348+0000", 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2826999999999999e-05 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.894 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:947 4.e 4.93cc240e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.721245+0000", 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.132355373, 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.13257571900000001, 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 947 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.895 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.721245+0000", 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.721245+0000", 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.721246+0000", 2024-05-07T11:14:24.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7999999999999995e-07 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.721250+0000", 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5489999999999998e-06 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.721260+0000", 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0124e-05 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.721264+0000", 2024-05-07T11:14:24.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6140000000000002e-06 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.721321+0000", 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6546999999999999e-05 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.721327+0000", 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5940000000000001e-06 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.898 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4.e4eec756 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34751245400000003, 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34776519299999997, 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.899 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:24.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:733 4.1d 4.99bec29d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.533980+0000", 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.31962129900000003, 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.319905471, 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 733 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533980+0000", 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533980+0000", 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533980+0000", 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1999999999999999e-07 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533984+0000", 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.783e-06 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533991+0000", 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1470000000000004e-06 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.533996+0000", 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6689999999999997e-06 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.534033+0000", 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6918999999999997e-05 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.534038+0000", 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8640000000000004e-06 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:768 4.25 4.69a8aa5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.906 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.564094+0000", 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.289506445, 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.289822148, 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 768 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564094+0000", 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564094+0000", 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564095+0000", 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8999999999999996e-07 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564099+0000", 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0600000000000001e-06 2024-05-07T11:14:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564108+0000", 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8980000000000002e-06 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564113+0000", 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8849999999999998e-06 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564152+0000", 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8603999999999998e-05 2024-05-07T11:14:24.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564157+0000", 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7219999999999996e-06 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:807 4.30 4.d60a26f0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.598058+0000", 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.25554241999999999, 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.25588961500000001, 2024-05-07T11:14:24.910 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 807 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598058+0000", 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598058+0000", 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598059+0000", 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.99e-07 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598063+0000", 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7529999999999999e-06 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598073+0000", 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0437e-05 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598078+0000", 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2100000000000001e-06 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598126+0000", 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7506000000000002e-05 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598135+0000", 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5439999999999999e-06 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:913 4.3 4.31e16a03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.691065+0000", 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.16253578499999999, 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.16291428399999999, 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.914 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 913 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.691065+0000", 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.691065+0000", 2024-05-07T11:14:24.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.691066+0000", 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.691080+0000", 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3984e-05 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.691090+0000", 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0104e-05 2024-05-07T11:14:24.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.691095+0000", 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7350000000000004e-06 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.691159+0000", 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4943000000000005e-05 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.691168+0000", 2024-05-07T11:14:24.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:948 4.37 4.1a784db7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.722180+0000", 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.131420436, 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.131829636, 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.918 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 948 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.722180+0000", 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.722180+0000", 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.722182+0000", 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.894e-06 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.722193+0000", 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0366e-05 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.722220+0000", 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7693000000000001e-05 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.722234+0000", 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3720000000000001e-05 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.722367+0000", 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013322099999999999 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.722380+0000", 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3047000000000001e-05 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.921 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4.82970914 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34705568599999997, 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34752874, 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:24.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:24.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:734 4.12 4.e5d81ed2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.534933+0000", 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.31866830699999998, 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.31917839999999997, 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 734 2024-05-07T11:14:24.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.534933+0000", 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.534933+0000", 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.534933+0000", 2024-05-07T11:14:24.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2500000000000005e-07 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.534938+0000", 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3540000000000002e-06 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.534948+0000", 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0494e-05 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.534953+0000", 2024-05-07T11:14:24.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9799999999999998e-06 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.534989+0000", 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5670000000000002e-05 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.534997+0000", 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3080000000000008e-06 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:808 4.7 4.782e16c7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.598961+0000", 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.25464017100000003, 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.25518256099999997, 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 808 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598961+0000", 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598961+0000", 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598961+0000", 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1999999999999999e-07 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598965+0000", 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1139999999999999e-06 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598976+0000", 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0576e-05 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.598981+0000", 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1250000000000001e-06 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.599014+0000", 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2388999999999998e-05 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.599019+0000", 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2750000000000003e-06 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:840 4.1c 4.a146da1c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.933 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.626971+0000", 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.226629517, 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.22720426899999999, 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 840 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.626971+0000", 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.626971+0000", 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.626972+0000", 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4600000000000004e-07 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.626977+0000", 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5560000000000001e-06 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.626985+0000", 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.969e-06 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.626991+0000", 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2089999999999996e-06 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.627032+0000", 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1152999999999997e-05 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.627037+0000", 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9470000000000002e-06 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:877 4.20 4.dde40420 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.937 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.659973+0000", 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.19362749900000001, 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.19423454100000001, 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 877 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.659973+0000", 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.659973+0000", 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.659974+0000", 2024-05-07T11:14:24.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0299999999999998e-07 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.659979+0000", 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4920000000000004e-06 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.659987+0000", 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0229999999999992e-06 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.659991+0000", 2024-05-07T11:14:24.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9559999999999996e-06 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.660033+0000", 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1100000000000003e-05 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.660038+0000", 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7590000000000003e-06 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:915 4.6 4.b4c6f306 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.692719+0000", 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.16088154399999999, 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.16152112299999999, 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 915 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.942 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.692719+0000", 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.692719+0000", 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.692720+0000", 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2399999999999997e-07 2024-05-07T11:14:24.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.692731+0000", 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1294999999999999e-05 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.692741+0000", 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0137e-05 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.692746+0000", 2024-05-07T11:14:24.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6589999999999998e-06 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.692804+0000", 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7698000000000002e-05 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.692809+0000", 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9259999999999999e-06 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:949 4.6 4.67516206 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.723010+0000", 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.130590332, 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.13126183899999999, 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 949 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723010+0000", 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723010+0000", 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723011+0000", 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.75e-07 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723016+0000", 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1549999999999998e-06 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723026+0000", 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0151e-05 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723031+0000", 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6290000000000001e-06 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723094+0000", 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2778000000000001e-05 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723099+0000", 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5419999999999996e-06 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4.5b952a85 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34702066799999998, 2024-05-07T11:14:24.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.347725385, 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:24.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:769 4.37 4.d68bbdf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.564953+0000", 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.28864827700000001, 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.28940095999999998, 2024-05-07T11:14:24.953 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 769 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564953+0000", 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564953+0000", 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564953+0000", 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4900000000000005e-07 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564957+0000", 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8619999999999996e-06 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564967+0000", 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5170000000000005e-06 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.564973+0000", 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0759999999999999e-06 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.565009+0000", 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6455000000000002e-05 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.565014+0000", 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2730000000000002e-06 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:809 4.20 4.5f1b0a60 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.599760+0000", 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.25384126400000001, 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.25462448500000001, 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.957 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 809 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.599760+0000", 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.599760+0000", 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.599761+0000", 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-06 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.599766+0000", 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6370000000000004e-06 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.599795+0000", 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9011000000000001e-05 2024-05-07T11:14:24.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.599799+0000", 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7170000000000002e-06 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.599852+0000", 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3052e-05 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.599859+0000", 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0369999999999997e-06 2024-05-07T11:14:24.960 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:842 4.12 4.f050b312 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.628757+0000", 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.22484359200000001, 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.225656998, 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.961 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 842 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.628757+0000", 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.628757+0000", 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.628758+0000", 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3200000000000004e-07 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.628762+0000", 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0620000000000002e-06 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.628773+0000", 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0631e-05 2024-05-07T11:14:24.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.628778+0000", 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9169999999999997e-06 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.628811+0000", 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3479000000000003e-05 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.628816+0000", 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1410000000000004e-06 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:878 4.35 4.135915b5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.660915+0000", 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.192685941, 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.19352962200000001, 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.965 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 878 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.660915+0000", 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.660915+0000", 2024-05-07T11:14:24.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.660916+0000", 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000001e-07 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.660920+0000", 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0230000000000003e-06 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.660930+0000", 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0616e-05 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.660935+0000", 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9570000000000001e-06 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.660976+0000", 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0742999999999999e-05 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.660982+0000", 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7880000000000003e-06 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:916 4.1f 4.2c4b8adf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.693530+0000", 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.160071148, 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.160945221, 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.969 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 916 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.693530+0000", 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.693530+0000", 2024-05-07T11:14:24.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.693532+0000", 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.883e-06 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.693542+0000", 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0246e-05 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.693569+0000", 2024-05-07T11:14:24.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7246999999999998e-05 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.693582+0000", 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3295999999999999e-05 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.693687+0000", 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104768 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.693702+0000", 2024-05-07T11:14:24.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4557e-05 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:950 4.16 4.eac41c16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.723964+0000", 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.129636425, 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.130540621, 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.973 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 950 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723964+0000", 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723964+0000", 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723966+0000", 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8870000000000001e-06 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.723985+0000", 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9199999999999999e-05 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.724013+0000", 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7648999999999999e-05 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.724026+0000", 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3273e-05 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.724144+0000", 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011756600000000001 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.724157+0000", 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2703e-05 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4.a01ec3 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34699728099999999, 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.347931877, 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.977 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:24.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.980 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:737 4.d 4.15b72f8d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.537568+0000", 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.31603257299999998, 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.31700265799999999, 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 737 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.981 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.537568+0000", 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.537568+0000", 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.537569+0000", 2024-05-07T11:14:24.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.537573+0000", 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1500000000000001e-06 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.537584+0000", 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0781000000000001e-05 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.537590+0000", 2024-05-07T11:14:24.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5180000000000001e-06 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.537626+0000", 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5493000000000001e-05 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.537632+0000", 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7060000000000001e-06 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:770 4.37 4.4ad66977 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.565914+0000", 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.28768714299999998, 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.28868750399999998, 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 770 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.565914+0000", 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.565914+0000", 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.565916+0000", 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.565926+0000", 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0023e-05 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.565953+0000", 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.72e-05 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.565966+0000", 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3267e-05 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.566103+0000", 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000137348 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.566108+0000", 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9729999999999997e-06 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:810 4.4 4.27ed6b04 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.988 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.600759+0000", 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.25284204199999999, 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.25387272, 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 810 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.600759+0000", 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.600759+0000", 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.600761+0000", 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8929999999999999e-06 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.600776+0000", 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5603e-05 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.600804+0000", 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.73e-05 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.600817+0000", 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3277e-05 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.600939+0000", 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012191100000000001 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.600945+0000", 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8359999999999997e-06 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:843 4.31 4.656c1531 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.629694+0000", 2024-05-07T11:14:24.992 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.223907147, 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.22496802900000001, 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 843 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.629694+0000", 2024-05-07T11:14:24.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.629694+0000", 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.629695+0000", 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.804e-06 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.629708+0000", 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2955999999999999e-05 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.629736+0000", 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7453e-05 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.629749+0000", 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.342e-05 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.629843+0000", 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3728999999999997e-05 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.629852+0000", 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8859999999999993e-06 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:879 4.30 4.de1c1230 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.661725+0000", 2024-05-07T11:14:24.996 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.19187554900000001, 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.19296892800000001, 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 879 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.661725+0000", 2024-05-07T11:14:24.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.661725+0000", 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.661726+0000", 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.68e-07 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.661730+0000", 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.596e-06 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.661739+0000", 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9450000000000005e-06 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.661744+0000", 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.746e-06 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:24.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.661791+0000", 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6507e-05 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.661794+0000", 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6069999999999999e-06 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.000 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:918 4.38 4.2dea86b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.695347+0000", 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.15825405100000001, 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15937894899999999, 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 918 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.695347+0000", 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.695347+0000", 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.695347+0000", 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9299999999999997e-07 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.695352+0000", 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0570000000000003e-06 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.695362+0000", 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.041e-05 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.695367+0000", 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8629999999999999e-06 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.695406+0000", 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8751999999999998e-05 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.695410+0000", 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8319999999999996e-06 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.004 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:952 4.5 4.29602785 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.725632+0000", 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.127968952, 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.129124726, 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 952 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.005 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.725632+0000", 2024-05-07T11:14:25.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.725632+0000", 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.725634+0000", 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8139999999999999e-06 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.725648+0000", 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4732000000000001e-05 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.725676+0000", 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7817000000000002e-05 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.725690+0000", 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3543000000000001e-05 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.725803+0000", 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011326499999999999 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.725818+0000", 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5339999999999999e-05 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:771 4.1d 4.15fdb7dd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.566659+0000", 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.28694191000000002, 2024-05-07T11:14:25.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.28812952400000003, 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 771 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.566659+0000", 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.566659+0000", 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.566660+0000", 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.153e-06 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.566666+0000", 2024-05-07T11:14:25.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1600000000000003e-06 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.566682+0000", 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6019999999999999e-05 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.566692+0000", 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5829999999999996e-06 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.566827+0000", 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013523800000000001 2024-05-07T11:14:25.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.566842+0000", 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4783000000000001e-05 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:811 4.2 4.1ebe4f02 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.601654+0000", 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.25194655199999999, 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.253164581, 2024-05-07T11:14:25.013 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 811 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.601654+0000", 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.601654+0000", 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.601656+0000", 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8139999999999999e-06 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.601666+0000", 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5889999999999992e-06 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.601698+0000", 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2466999999999999e-05 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.601712+0000", 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3560000000000001e-05 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.601852+0000", 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014005800000000001 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.601867+0000", 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5235999999999999e-05 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:844 4.32 4.8176f0b2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.630574+0000", 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.22302693600000001, 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.22427704400000001, 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.017 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 844 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.630574+0000", 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.630574+0000", 2024-05-07T11:14:25.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.630576+0000", 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8929999999999999e-06 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.630586+0000", 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025e-05 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.630613+0000", 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7233000000000002e-05 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.630627+0000", 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.346e-05 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.630736+0000", 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000109302 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.630751+0000", 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5409000000000001e-05 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:880 4.38 4.c1e51af8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.662672+0000", 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.19092895800000001, 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.19220989899999999, 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.021 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 880 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.662672+0000", 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.662672+0000", 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.662673+0000", 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1399999999999996e-07 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.662677+0000", 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9720000000000003e-06 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.662687+0000", 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0066e-05 2024-05-07T11:14:25.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.662691+0000", 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7779999999999998e-06 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.662751+0000", 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9728000000000001e-05 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.662757+0000", 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6250000000000004e-06 2024-05-07T11:14:25.024 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:919 4.1d 4.d0c78e5d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.696214+0000", 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.15738692000000001, 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15869962800000001, 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.025 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 919 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.696214+0000", 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.696214+0000", 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.696216+0000", 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.81e-06 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.696225+0000", 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2399999999999996e-06 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.696252+0000", 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7180000000000001e-05 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.696265+0000", 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3226e-05 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.696385+0000", 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000119935 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.696399+0000", 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3475999999999999e-05 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4.fe9c3cdd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34620208400000002, 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34754656099999998, 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:25.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:739 4.3 4.383218c3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.539350+0000", 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.31425095600000003, 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.315625928, 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 739 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.539350+0000", 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.539350+0000", 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.539351+0000", 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.539354+0000", 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7950000000000001e-06 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.539380+0000", 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6112e-05 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.539385+0000", 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7539999999999997e-06 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.539456+0000", 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0394000000000004e-05 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.539461+0000", 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2000000000000002e-06 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:772 4.3d 4.c6dc2afd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.036 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.567620+0000", 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.28598041400000002, 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.28738866000000002, 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 772 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.567620+0000", 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.567620+0000", 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.567622+0000", 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.86e-06 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.567632+0000", 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8900000000000002e-06 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.567668+0000", 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5633999999999998e-05 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.567673+0000", 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.775e-06 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.567743+0000", 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0189000000000002e-05 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.567749+0000", 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0290000000000002e-06 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:813 4.2d 4.fa3132ad (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.603401+0000", 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.25019960000000002, 2024-05-07T11:14:25.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.25163869, 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 813 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.603401+0000", 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.603401+0000", 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.603403+0000", 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.897e-06 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.603412+0000", 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2830000000000007e-06 2024-05-07T11:14:25.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.603440+0000", 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7463000000000001e-05 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.603453+0000", 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3287e-05 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.603606+0000", 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015305900000000001 2024-05-07T11:14:25.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.603611+0000", 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7820000000000001e-06 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:845 4.14 4.e2235854 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.631387+0000", 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.222214101, 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.22368801399999999, 2024-05-07T11:14:25.046 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 845 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.631387+0000", 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.631387+0000", 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.631389+0000", 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8729999999999999e-06 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.631398+0000", 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7769999999999997e-06 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.631426+0000", 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7512999999999999e-05 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.631439+0000", 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.345e-05 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.631548+0000", 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000108618 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.631560+0000", 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2510000000000001e-05 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:881 4.3f 4.1f2ea7ff (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.663502+0000", 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.19009880800000001, 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.19160339200000001, 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.050 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 881 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.663502+0000", 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.663502+0000", 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.663504+0000", 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.793e-06 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.663513+0000", 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2969999999999992e-06 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.663540+0000", 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6869e-05 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.663553+0000", 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3183000000000001e-05 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.663665+0000", 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000111803 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.663681+0000", 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5559000000000001e-05 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:920 4.13 4.5531db13 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.697146+0000", 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.156454857, 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15799099, 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.054 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 920 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.697146+0000", 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.697146+0000", 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.697148+0000", 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.857e-06 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.697158+0000", 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.697185+0000", 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6835999999999999e-05 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.697198+0000", 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3115999999999999e-05 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.697305+0000", 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010736200000000001 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.697327+0000", 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2120000000000002e-05 2024-05-07T11:14:25.057 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:955 4.13 4.17642793 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.728073+0000", 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.125528212, 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.12709592, 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.058 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 955 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728073+0000", 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728073+0000", 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728073+0000", 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9999999999999996e-07 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728078+0000", 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.121e-06 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728088+0000", 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0844e-05 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728094+0000", 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.66e-06 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728143+0000", 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9129999999999999e-05 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728152+0000", 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.653e-06 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.061 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:740 4.16 4.5dcdfed6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.540180+0000", 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.31342051799999998, 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.31501862000000003, 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 740 2024-05-07T11:14:25.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.540180+0000", 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.540180+0000", 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.540182+0000", 2024-05-07T11:14:25.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.854e-06 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.540192+0000", 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0273e-05 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.540220+0000", 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7840000000000001e-05 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.540234+0000", 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3529999999999999e-05 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.540394+0000", 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015975700000000001 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.540422+0000", 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8796e-05 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:775 4.22 4.3693e8e2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.570126+0000", 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.28347493800000001, 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.28512379300000001, 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 775 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.066 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570126+0000", 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570126+0000", 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570127+0000", 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6599999999999996e-07 2024-05-07T11:14:25.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570130+0000", 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8349999999999997e-06 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570140+0000", 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9650000000000003e-06 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570145+0000", 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6330000000000004e-06 2024-05-07T11:14:25.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570220+0000", 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4684000000000005e-05 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570225+0000", 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9200000000000003e-06 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:846 4.20 4.db950360 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.632243+0000", 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.22135822799999999, 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.22303946499999999, 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 846 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.632243+0000", 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.632243+0000", 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.632243+0000", 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1500000000000004e-07 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.632247+0000", 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0260000000000001e-06 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.632275+0000", 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7855999999999999e-05 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.632280+0000", 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1410000000000004e-06 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.632327+0000", 2024-05-07T11:14:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6239999999999998e-05 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.632335+0000", 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6589999999999996e-06 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:882 4.33 4.687c9273 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.664396+0000", 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.18920431800000001, 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.19091934199999999, 2024-05-07T11:14:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 882 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.664396+0000", 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.664396+0000", 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.664398+0000", 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.857e-06 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.664409+0000", 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0149999999999999e-05 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.664435+0000", 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6801999999999999e-05 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.664440+0000", 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.707e-06 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.664509+0000", 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8707999999999993e-05 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.664515+0000", 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0889999999999996e-06 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:921 4.33 4.865d6e73 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.698096+0000", 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.15550455399999999, 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15726711900000001, 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 921 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698096+0000", 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698096+0000", 2024-05-07T11:14:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698098+0000", 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.917e-06 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698108+0000", 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0173000000000001e-05 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698136+0000", 2024-05-07T11:14:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7282999999999999e-05 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698149+0000", 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.348e-05 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698251+0000", 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102205 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698269+0000", 2024-05-07T11:14:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.751e-05 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:956 4.18 4.e1cfd958 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.728970+0000", 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.12463066, 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.12642487099999999, 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 956 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728970+0000", 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728970+0000", 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728971+0000", 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4199999999999995e-07 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728978+0000", 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9929999999999998e-06 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728989+0000", 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0665999999999999e-05 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.728994+0000", 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9960000000000001e-06 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.729037+0000", 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3297999999999998e-05 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.729044+0000", 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1590000000000004e-06 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4.48545bf1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34525954599999997, 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34708563399999998, 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:741 4.22 4.55907462 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.541037+0000", 2024-05-07T11:14:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.31256395399999998, 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.31442083500000001, 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 741 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541037+0000", 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541037+0000", 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541038+0000", 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6599999999999996e-07 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541041+0000", 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6990000000000001e-06 2024-05-07T11:14:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541056+0000", 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4548e-05 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541078+0000", 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2350000000000001e-05 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541120+0000", 2024-05-07T11:14:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1693000000000002e-05 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541125+0000", 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1340000000000003e-06 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:776 4.37 4.e5d704b7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.570990+0000", 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.28261069999999999, 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.284545245, 2024-05-07T11:14:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 776 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570990+0000", 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570990+0000", 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570991+0000", 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8899999999999999e-07 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.570995+0000", 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0149999999999997e-06 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.571005+0000", 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.995e-06 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.571009+0000", 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310000000000002e-06 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.571082+0000", 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2275999999999997e-05 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.571087+0000", 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8640000000000004e-06 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:815 4.d 4.1b5f230d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.604994+0000", 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.248607088, 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.25057232000000002, 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 815 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.604994+0000", 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.604994+0000", 2024-05-07T11:14:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.604994+0000", 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3099999999999997e-07 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.604998+0000", 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7280000000000001e-06 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605009+0000", 2024-05-07T11:14:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0389e-05 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605014+0000", 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2290000000000002e-06 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605048+0000", 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3800999999999997e-05 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605059+0000", 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.098e-05 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:922 4.d 4.a1722f4d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.698992+0000", 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.15460927999999999, 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15660655900000001, 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 922 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698992+0000", 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698992+0000", 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.698993+0000", 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.886e-06 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699035+0000", 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1557000000000002e-05 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699046+0000", 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0699999999999999e-05 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699057+0000", 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1708e-05 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699097+0000", 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9999000000000001e-05 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699102+0000", 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9590000000000003e-06 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:957 4.16 4.bad6e096 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.729802+0000", 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.123798561, 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.125826207, 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 957 2024-05-07T11:14:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.729802+0000", 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.729802+0000", 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.729803+0000", 2024-05-07T11:14:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.729807+0000", 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.729818+0000", 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0584000000000001e-05 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.729823+0000", 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1390000000000003e-06 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.729864+0000", 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0629e-05 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.729869+0000", 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3900000000000001e-06 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:705 4.7 4.613165c7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.509302+0000", 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34429845199999998, 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34635821, 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 705 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509302+0000", 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509302+0000", 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509303+0000", 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8100000000000002e-07 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509308+0000", 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9139999999999999e-06 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509315+0000", 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8260000000000004e-06 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509319+0000", 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4059999999999998e-06 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509352+0000", 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2772999999999999e-05 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509357+0000", 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7829999999999998e-06 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:742 4.30 4.c8c4a730 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.541826+0000", 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.31177519999999997, 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.31386662599999998, 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 742 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541826+0000", 2024-05-07T11:14:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541826+0000", 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541826+0000", 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6300000000000001e-07 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541829+0000", 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.644e-06 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541834+0000", 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5890000000000002e-06 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541857+0000", 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2320999999999999e-05 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541900+0000", 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3398e-05 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.541906+0000", 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9610000000000002e-06 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:779 4.14 4.745f6494 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.573606+0000", 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.27999468, 2024-05-07T11:14:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.28211639700000002, 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 779 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.573606+0000", 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.573606+0000", 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.573608+0000", 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.79e-06 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.573618+0000", 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7899999999999994e-06 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.573645+0000", 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7046000000000002e-05 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.573658+0000", 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3200000000000001e-05 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.573818+0000", 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016014100000000001 2024-05-07T11:14:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.573831+0000", 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3346999999999999e-05 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:816 4.29 4.9a057969 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.605904+0000", 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.24769702599999999, 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.24985053300000001, 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 816 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605904+0000", 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605904+0000", 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605905+0000", 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.54e-07 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605909+0000", 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3409999999999996e-06 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605919+0000", 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0499000000000001e-05 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605924+0000", 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.006e-06 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605971+0000", 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6245999999999997e-05 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.605979+0000", 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7639999999999994e-06 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:849 4.3 4.fbca64c3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.634912+0000", 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.21868837099999999, 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.220872334, 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 849 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.634912+0000", 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.634912+0000", 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.634913+0000", 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3200000000000005e-07 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.634917+0000", 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5499999999999999e-06 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.634925+0000", 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7730000000000005e-06 2024-05-07T11:14:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.634931+0000", 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2229999999999998e-06 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.635003+0000", 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2024e-05 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.635009+0000", 2024-05-07T11:14:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5660000000000003e-06 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:884 4.3d 4.7ee0107d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.666069+0000", 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.18753191299999999, 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.18974839199999999, 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 884 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666069+0000", 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666069+0000", 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666070+0000", 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2699999999999999e-07 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666074+0000", 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666084+0000", 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0515e-05 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666090+0000", 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1730000000000003e-06 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666125+0000", 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5367000000000002e-05 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666130+0000", 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7480000000000001e-06 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:923 4.1b 4.c777cc5b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.699819+0000", 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.15378134500000001, 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15602930100000001, 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 923 2024-05-07T11:14:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699819+0000", 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699819+0000", 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699820+0000", 2024-05-07T11:14:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6599999999999996e-07 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699824+0000", 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5580000000000001e-06 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699834+0000", 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0036e-05 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699838+0000", 2024-05-07T11:14:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6820000000000002e-06 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699905+0000", 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6501000000000006e-05 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.699914+0000", 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6300000000000004e-06 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:958 4.35 4.362d49f5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.730668+0000", 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.122933138, 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.125212083, 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 958 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.730668+0000", 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.730668+0000", 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.730668+0000", 2024-05-07T11:14:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8899999999999999e-07 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.730673+0000", 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2490000000000003e-06 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.730683+0000", 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.057e-05 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.730688+0000", 2024-05-07T11:14:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9250000000000003e-06 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.730729+0000", 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1242999999999998e-05 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.730735+0000", 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7780000000000004e-06 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4.901be7f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34336514400000001, 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34567566599999999, 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:780 4.d 4.9141130d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.574498+0000", 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.27910311300000001, 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.281444258, 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 780 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.574498+0000", 2024-05-07T11:14:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.574498+0000", 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.574500+0000", 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.877e-06 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.574534+0000", 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4156000000000003e-05 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.574567+0000", 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3395999999999997e-05 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.574572+0000", 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7809999999999996e-06 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.574640+0000", 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7816000000000003e-05 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.574646+0000", 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:817 4.3a 4.694b453a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.606752+0000", 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.24684836199999999, 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.249221258, 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 817 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.606752+0000", 2024-05-07T11:14:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.606752+0000", 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.606753+0000", 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0399999999999995e-07 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.606757+0000", 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.703e-06 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.606767+0000", 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0387000000000001e-05 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.606772+0000", 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9459999999999997e-06 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.606809+0000", 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6415999999999998e-05 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.606814+0000", 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9540000000000003e-06 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:850 4.37 4.8c71b577 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.635897+0000", 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.217704229, 2024-05-07T11:14:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.22010792000000001, 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 850 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.635897+0000", 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.635897+0000", 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.635897+0000", 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7599999999999997e-07 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.635901+0000", 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9589999999999997e-06 2024-05-07T11:14:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.635929+0000", 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7812000000000001e-05 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.635934+0000", 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9060000000000001e-06 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.635977+0000", 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3012000000000001e-05 2024-05-07T11:14:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.635983+0000", 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6890000000000001e-06 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:924 4.3a 4.491d8efa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.700741+0000", 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.152859675, 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15529505599999999, 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 924 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.700741+0000", 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.700741+0000", 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.700742+0000", 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.92e-07 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.700769+0000", 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7217999999999999e-05 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.700780+0000", 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0634e-05 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.700785+0000", 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8749999999999999e-06 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.700825+0000", 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0105000000000003e-05 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.700829+0000", 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.826e-06 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:959 4.a 4.72a54e8a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.731601+0000", 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.121999511, 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.124494593, 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 959 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.731601+0000", 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.731601+0000", 2024-05-07T11:14:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.731603+0000", 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.81e-06 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.731616+0000", 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.277e-05 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.731643+0000", 2024-05-07T11:14:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7356e-05 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.731656+0000", 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3217000000000001e-05 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.731727+0000", 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0282000000000002e-05 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.731732+0000", 2024-05-07T11:14:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6019999999999999e-06 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4.5197a39f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34229171000000003, 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34481912399999998, 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.162 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.165 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:744 4.1d 4.5aa9f2dd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.543524+0000", 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.31007724599999997, 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.31263790400000002, 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 744 2024-05-07T11:14:25.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.543524+0000", 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.543524+0000", 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.543524+0000", 2024-05-07T11:14:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.75e-07 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.543529+0000", 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3549999999999998e-06 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.543538+0000", 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3260000000000002e-06 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.543544+0000", 2024-05-07T11:14:25.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6130000000000003e-06 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.543578+0000", 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4054000000000003e-05 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.543585+0000", 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8909999999999995e-06 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:781 4.1a 4.ff02c65a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.575246+0000", 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.27835453399999999, 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.280947695, 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 781 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.575246+0000", 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.575246+0000", 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.575247+0000", 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.575251+0000", 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8210000000000003e-06 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.575261+0000", 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0530000000000001e-05 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.575266+0000", 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0509999999999996e-06 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.575309+0000", 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3047000000000003e-05 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.575315+0000", 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9190000000000004e-06 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:818 4.18 4.b6d51bd8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.607661+0000", 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.245939727, 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.248566343, 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 818 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.607661+0000", 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.607661+0000", 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.607662+0000", 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0200000000000001e-07 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.607666+0000", 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9820000000000002e-06 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.607676+0000", 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0095000000000001e-05 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.607681+0000", 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6410000000000001e-06 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.607746+0000", 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5388000000000005e-05 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.607754+0000", 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7230000000000004e-06 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:851 4.1e 4.d19d775e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.636721+0000", 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.21687986500000001, 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.219538922, 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 851 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.636721+0000", 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.636721+0000", 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.636722+0000", 2024-05-07T11:14:25.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.68e-07 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.636725+0000", 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.636736+0000", 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0173000000000001e-05 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.636740+0000", 2024-05-07T11:14:25.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7140000000000001e-06 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.636815+0000", 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4355000000000002e-05 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.636820+0000", 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1000000000000003e-06 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:885 4.29 4.9e02bb69 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.666956+0000", 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.186644539, 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.189336479, 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 885 2024-05-07T11:14:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666956+0000", 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666956+0000", 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666957+0000", 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666961+0000", 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8399999999999997e-06 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666971+0000", 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0438000000000001e-05 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.666978+0000", 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3790000000000003e-06 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.667012+0000", 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4551999999999997e-05 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.667017+0000", 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2399999999999998e-06 2024-05-07T11:14:25.185 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:925 4.2c 4.508cd02c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.702045+0000", 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.151556147, 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15428139699999999, 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.186 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 925 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702045+0000", 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702045+0000", 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702047+0000", 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8729999999999999e-06 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702102+0000", 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5420000000000001e-05 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702130+0000", 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8039e-05 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702144+0000", 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.385e-05 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702263+0000", 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000119549 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702269+0000", 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7649999999999999e-06 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.189 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:962 4.12 4.d242cc52 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.734213+0000", 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.119387935, 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.122160774, 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.190 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 962 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.734213+0000", 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.734213+0000", 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.734215+0000", 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8759999999999999e-06 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.734235+0000", 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9826999999999998e-05 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.734262+0000", 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7529999999999999e-05 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.734276+0000", 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3579e-05 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.734380+0000", 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104036 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.734395+0000", 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5583e-05 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.193 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:708 4.3 4.5009b43 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.512238+0000", 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34136270200000002, 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34416763, 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.194 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 708 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.512238+0000", 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.512238+0000", 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.512239+0000", 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.512243+0000", 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4469999999999999e-06 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.512254+0000", 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0342e-05 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.512259+0000", 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1880000000000001e-06 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.512303+0000", 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4002999999999999e-05 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.512308+0000", 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7910000000000004e-06 2024-05-07T11:14:25.197 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:745 4.32 4.d21188b2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.544428+0000", 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.30917271899999998, 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.312007959, 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.198 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 745 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.544428+0000", 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.544428+0000", 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.544429+0000", 2024-05-07T11:14:25.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8899999999999999e-07 2024-05-07T11:14:25.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.544433+0000", 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8770000000000003e-06 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.544443+0000", 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0479000000000001e-05 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.544448+0000", 2024-05-07T11:14:25.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9609999999999996e-06 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.544488+0000", 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0062999999999999e-05 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.544493+0000", 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8749999999999999e-06 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:782 4.6 4.73af886 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.576121+0000", 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.27747996800000002, 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.28034736599999999, 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 782 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.576121+0000", 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.576121+0000", 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.576122+0000", 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.576128+0000", 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3099999999999997e-06 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.576138+0000", 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0443e-05 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.576144+0000", 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2310000000000004e-06 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.576187+0000", 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3135e-05 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.576193+0000", 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5230000000000001e-06 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.206 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:854 4.1f 4.dad0e91f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.639464+0000", 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.214136779, 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.21703471099999999, 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 854 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.639464+0000", 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.639464+0000", 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.639465+0000", 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1399999999999996e-07 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.639495+0000", 2024-05-07T11:14:25.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0537999999999998e-05 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.639506+0000", 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0586e-05 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.639511+0000", 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9350000000000002e-06 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.639549+0000", 2024-05-07T11:14:25.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7991999999999998e-05 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.639553+0000", 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5870000000000003e-06 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:886 4.33 4.3eea433 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.667971+0000", 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.18562941899999999, 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.188559008, 2024-05-07T11:14:25.210 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 886 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.667971+0000", 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.667971+0000", 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.667973+0000", 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9269999999999999e-06 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668010+0000", 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6906000000000002e-05 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668038+0000", 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.758e-05 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668063+0000", 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5126e-05 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668188+0000", 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124738 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668204+0000", 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5860000000000001e-05 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:926 4.2c 4.b4c606c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.702893+0000", 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.15070818, 2024-05-07T11:14:25.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15366922699999999, 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 926 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702893+0000", 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702893+0000", 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702893+0000", 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0500000000000003e-07 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702897+0000", 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1130000000000003e-06 2024-05-07T11:14:25.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702908+0000", 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0451999999999999e-05 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702914+0000", 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.784e-06 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702955+0000", 2024-05-07T11:14:25.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1050999999999997e-05 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.702960+0000", 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5289999999999999e-06 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:963 4.24 4.932059a4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.735045+0000", 2024-05-07T11:14:25.218 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.118555487, 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.12154683199999999, 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 963 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735045+0000", 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735045+0000", 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735047+0000", 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.813e-06 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735074+0000", 2024-05-07T11:14:25.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6588e-05 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735084+0000", 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0570999999999999e-05 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735089+0000", 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.079e-06 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735144+0000", 2024-05-07T11:14:25.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5033e-05 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735149+0000", 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6890000000000003e-06 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4.630793e0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34049190699999998, 2024-05-07T11:14:25.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34351464100000001, 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:25.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:25.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:746 4.24 4.64558fe4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.545299+0000", 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.30830132399999999, 2024-05-07T11:14:25.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.31135483200000003, 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 746 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.545299+0000", 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.545299+0000", 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.545300+0000", 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4300000000000002e-07 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.545307+0000", 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9190000000000002e-06 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.545318+0000", 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0489000000000001e-05 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.545322+0000", 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8359999999999999e-06 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.545362+0000", 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.96e-05 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.545367+0000", 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8080000000000004e-06 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.230 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:784 4.31 4.98531e71 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.578014+0000", 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.27558692299999998, 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.27867343100000003, 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 784 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578014+0000", 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578014+0000", 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578016+0000", 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.877e-06 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578045+0000", 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9652999999999999e-05 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578088+0000", 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2499000000000001e-05 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578101+0000", 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3349999999999999e-05 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578243+0000", 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014128 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578251+0000", 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6610000000000006e-06 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:820 4.32 4.f154b6f2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.234 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.609322+0000", 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.24427931, 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.247396171, 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 820 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.609322+0000", 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.609322+0000", 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.609322+0000", 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4799999999999998e-07 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.609327+0000", 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4399999999999998e-06 2024-05-07T11:14:25.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.609334+0000", 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8080000000000005e-06 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.609339+0000", 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5430000000000004e-06 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.609373+0000", 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4056000000000001e-05 2024-05-07T11:14:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.609379+0000", 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6130000000000003e-06 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:856 4.1b 4.27fa171b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.641314+0000", 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.21228640300000001, 2024-05-07T11:14:25.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.215434768, 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 856 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.641314+0000", 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.641314+0000", 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.641316+0000", 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.843e-06 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.641351+0000", 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4659999999999997e-05 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.641378+0000", 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7189e-05 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.641391+0000", 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3247e-05 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.641546+0000", 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154671 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.641562+0000", 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5763000000000001e-05 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:887 4.a 4.56badf0a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.668732+0000", 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.18486861399999999, 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.18804863999999999, 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.242 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 887 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668732+0000", 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668732+0000", 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668733+0000", 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668737+0000", 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.653e-06 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668746+0000", 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8789999999999998e-06 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668751+0000", 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6809999999999997e-06 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668797+0000", 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6217999999999997e-05 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.668802+0000", 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.25e-06 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:927 4.16 4.9ffa8316 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.703720+0000", 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.14988096300000001, 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15309155499999999, 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.246 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 927 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.703720+0000", 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.703720+0000", 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.703721+0000", 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9699999999999995e-07 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.703734+0000", 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3791000000000001e-05 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.703745+0000", 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0888e-05 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.703750+0000", 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0499999999999999e-06 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.703783+0000", 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2911999999999999e-05 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.703788+0000", 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5510000000000001e-06 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.249 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:964 4.20 4.53588060 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.735902+0000", 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.117698569, 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.12094062899999999, 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.250 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 964 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735902+0000", 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735902+0000", 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735903+0000", 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9500000000000002e-07 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735910+0000", 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6989999999999997e-06 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735920+0000", 2024-05-07T11:14:25.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0549e-05 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735925+0000", 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8890000000000001e-06 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735975+0000", 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9790999999999998e-05 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.735983+0000", 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3659999999999992e-06 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4.cfa6f82c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.33955587700000001, 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34282855600000001, 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.254 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:747 4.12 4.a42a2e12 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.546165+0000", 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.307435603, 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.31073984399999999, 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.258 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 747 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546165+0000", 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546165+0000", 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546167+0000", 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8029999999999999e-06 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546176+0000", 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2329999999999995e-06 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546204+0000", 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7339999999999999e-05 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546217+0000", 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3757000000000001e-05 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546325+0000", 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107478 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546340+0000", 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5186e-05 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:785 4.1f 4.6cd5ec5f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.578962+0000", 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.27463914299999997, 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.27797475500000002, 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.262 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 785 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578962+0000", 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578962+0000", 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578963+0000", 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.79e-06 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.578978+0000", 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4703e-05 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.579005+0000", 2024-05-07T11:14:25.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7086000000000001e-05 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.579019+0000", 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3434e-05 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.579154+0000", 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013559100000000001 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.579168+0000", 2024-05-07T11:14:25.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3243e-05 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:857 4.3d 4.f9bc57d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.642076+0000", 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.21152438800000001, 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.21489049399999999, 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.266 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 857 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642076+0000", 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642076+0000", 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642077+0000", 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642081+0000", 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8589999999999998e-06 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642091+0000", 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0502e-05 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642096+0000", 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8790000000000002e-06 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642138+0000", 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1882999999999999e-05 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642144+0000", 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6409999999999999e-06 2024-05-07T11:14:25.269 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:888 4.c 4.273b994c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.669693+0000", 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.18390795700000001, 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.187305635, 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.270 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 888 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.669693+0000", 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.669693+0000", 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.669695+0000", 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8899999999999999e-06 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.669742+0000", 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7630000000000003e-05 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.669770+0000", 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7328999999999999e-05 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.669783+0000", 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3433e-05 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.669876+0000", 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2913999999999998e-05 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.669881+0000", 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.809e-06 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.273 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:966 4.20 4.e0bd7320 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.737696+0000", 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.11590460399999999, 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.11933288, 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 966 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.737696+0000", 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.737696+0000", 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.737697+0000", 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.737701+0000", 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2699999999999998e-06 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.737712+0000", 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0380000000000001e-05 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.737716+0000", 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8679999999999998e-06 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.737766+0000", 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9543000000000003e-05 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.737775+0000", 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.636e-06 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:712 4.10 4.d21a71d0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.515839+0000", 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.33776158299999998, 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34122441999999997, 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 712 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.515839+0000", 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.515839+0000", 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.515840+0000", 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9699999999999995e-07 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.515844+0000", 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4569999999999998e-06 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.515855+0000", 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0444e-05 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.515860+0000", 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8450000000000002e-06 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.515902+0000", 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2098999999999998e-05 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.515907+0000", 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1769999999999997e-06 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:748 4.2 4.65b5bb82 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.281 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.546978+0000", 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.30662330900000001, 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.31014099699999997, 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 748 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546978+0000", 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546978+0000", 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546978+0000", 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9500000000000002e-07 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.546982+0000", 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.014e-06 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547010+0000", 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7642000000000001e-05 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547015+0000", 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8459999999999999e-06 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547060+0000", 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4821000000000003e-05 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547065+0000", 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3639999999999998e-06 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:788 4.1 4.3baa6f81 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.285 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.581574+0000", 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.27202642300000002, 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.27557787, 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 788 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.581574+0000", 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.581574+0000", 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.581575+0000", 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.581579+0000", 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3159999999999998e-06 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.581589+0000", 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9990000000000003e-06 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.581594+0000", 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.826e-06 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.581663+0000", 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8349000000000006e-05 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.581672+0000", 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1589999999999999e-06 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:821 4.23 4.99095ee3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.610188+0000", 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.243413096, 2024-05-07T11:14:25.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.24699818300000001, 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 821 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.610188+0000", 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.610188+0000", 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.610188+0000", 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9500000000000003e-07 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.610191+0000", 2024-05-07T11:14:25.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.926e-06 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.610198+0000", 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8120000000000002e-06 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.610202+0000", 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9890000000000003e-06 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.610254+0000", 2024-05-07T11:14:25.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2206999999999997e-05 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.610259+0000", 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4059999999999998e-06 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:858 4.29 4.5db8c429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.642998+0000", 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.21060238100000001, 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.21422005499999999, 2024-05-07T11:14:25.293 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 858 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642998+0000", 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642998+0000", 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.642999+0000", 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643003+0000", 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1459999999999998e-06 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643014+0000", 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0594000000000001e-05 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643019+0000", 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9110000000000001e-06 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643071+0000", 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2568000000000002e-05 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643080+0000", 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7299999999999994e-06 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:889 4.2 4.a73fabc2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.297 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.670678+0000", 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.182922525, 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.186573607, 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 889 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.670678+0000", 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.670678+0000", 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.670679+0000", 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6599999999999996e-07 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.670683+0000", 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9990000000000002e-06 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.670693+0000", 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9869999999999994e-06 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.670698+0000", 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6349999999999997e-06 2024-05-07T11:14:25.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.670753+0000", 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5908000000000001e-05 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.670758+0000", 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7500000000000003e-06 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.301 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:929 4.3d 4.4bce553d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.705396+0000", 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.148204631, 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.151887623, 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 929 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.705396+0000", 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.705396+0000", 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.705397+0000", 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.99e-07 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.705401+0000", 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6519999999999999e-06 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.705409+0000", 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6710000000000005e-06 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.705414+0000", 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7890000000000002e-06 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.705449+0000", 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5107000000000001e-05 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.705454+0000", 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3410000000000002e-06 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:94 3.14 3.6e5f474 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.740254+0000", 2024-05-07T11:14:25.305 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.11334670199999999, 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.117063825, 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.740254+0000", 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.740254+0000", 2024-05-07T11:14:25.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.740256+0000", 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.95e-06 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.742728+0000", 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024716550000000001 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.742740+0000", 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2172e-05 2024-05-07T11:14:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.742746+0000", 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.302e-06 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.742791+0000", 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4990000000000001e-05 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.742798+0000", 2024-05-07T11:14:25.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6710000000000002e-06 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4.dd85b7b0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.33682992499999997, 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34059146299999998, 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.309 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:25.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:25.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:749 4.6 4.c0cae786 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.547817+0000", 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.30578407000000002, 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30966509199999998, 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.313 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 749 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547817+0000", 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547817+0000", 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547817+0000", 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6700000000000003e-07 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547821+0000", 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8920000000000002e-06 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547831+0000", 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.961e-06 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547836+0000", 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7990000000000001e-06 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547909+0000", 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2948999999999996e-05 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.547916+0000", 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6089999999999997e-06 2024-05-07T11:14:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:790 4.22 4.f89ede22 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.583297+0000", 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.27030374200000001, 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.27421727800000001, 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.317 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 790 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.583297+0000", 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.583297+0000", 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.583299+0000", 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9230000000000001e-06 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.583309+0000", 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0166999999999999e-05 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.583336+0000", 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6993000000000001e-05 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.583350+0000", 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3623e-05 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.583477+0000", 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000127682 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.583493+0000", 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.522e-05 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:822 4.22 4.60cfb8a2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.611190+0000", 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.242410564, 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.246355043, 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 822 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.611190+0000", 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.611190+0000", 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.611191+0000", 2024-05-07T11:14:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.611208+0000", 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6898999999999999e-05 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.611218+0000", 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0541e-05 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.611223+0000", 2024-05-07T11:14:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6829999999999999e-06 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.611293+0000", 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9602000000000002e-05 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.611299+0000", 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.037e-06 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:859 4.3f 4.8e75f43f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.643916+0000", 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.20968482999999999, 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.21366189299999999, 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 859 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643916+0000", 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643916+0000", 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643918+0000", 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7999999999999999e-06 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643927+0000", 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3060000000000003e-06 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643954+0000", 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7236000000000001e-05 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.643968+0000", 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3502999999999999e-05 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.644089+0000", 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121265 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.644103+0000", 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.436e-05 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:890 4.33 4.c81eeef3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.671542+0000", 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.18205852, 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.18606613, 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 890 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.671542+0000", 2024-05-07T11:14:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.671542+0000", 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.671543+0000", 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.671548+0000", 2024-05-07T11:14:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2989999999999996e-06 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.671559+0000", 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0461e-05 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.671564+0000", 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2000000000000002e-06 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.671611+0000", 2024-05-07T11:14:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7484999999999997e-05 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.671617+0000", 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8579999999999996e-06 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4.bfa2088 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.33598405399999998, 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.34002345499999997, 2024-05-07T11:14:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:751 4.20 4.c9c143a0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.549483+0000", 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.304117572, 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30818748099999999, 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 751 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.549483+0000", 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.549483+0000", 2024-05-07T11:14:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.549484+0000", 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.549488+0000", 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8689999999999997e-06 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.549498+0000", 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0489000000000001e-05 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.549503+0000", 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8720000000000001e-06 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.549544+0000", 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0815999999999997e-05 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.549549+0000", 2024-05-07T11:14:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8380000000000001e-06 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:791 4.c 4.dd74e70c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.584125+0000", 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.26947599300000002, 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.27357777300000002, 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 791 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.584125+0000", 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.584125+0000", 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.584127+0000", 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7799999999999999e-06 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.584139+0000", 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2602000000000001e-05 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.584166+0000", 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6820000000000001e-05 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.584179+0000", 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2816999999999999e-05 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.584256+0000", 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6870000000000001e-05 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.584263+0000", 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4410000000000004e-06 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:823 4.3a 4.ebefe17a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.612045+0000", 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.24155585299999999, 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.24568948199999999, 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 823 2024-05-07T11:14:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612045+0000", 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612045+0000", 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612046+0000", 2024-05-07T11:14:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7100000000000001e-07 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612074+0000", 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8782e-05 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612085+0000", 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0461e-05 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612090+0000", 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8470000000000003e-06 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612131+0000", 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1389e-05 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612137+0000", 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6729999999999997e-06 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:860 4.2d 4.fe82a8ad (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.644848+0000", 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.20875328200000001, 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.212917468, 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 860 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.644848+0000", 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.644848+0000", 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.644848+0000", 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.23e-07 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.644878+0000", 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9326999999999999e-05 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.644888+0000", 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0777e-05 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.644893+0000", 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9729999999999997e-06 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.644932+0000", 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8760000000000002e-05 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.644938+0000", 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6389999999999997e-06 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:892 4.3d 4.8ad782bd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.673260+0000", 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.18034118499999999, 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.184537271, 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 892 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.673260+0000", 2024-05-07T11:14:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.673260+0000", 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.673261+0000", 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8199999999999999e-06 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.673271+0000", 2024-05-07T11:14:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9669999999999996e-06 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.673310+0000", 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8211999999999999e-05 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.673315+0000", 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1669999999999998e-06 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.673358+0000", 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2898000000000002e-05 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.673364+0000", 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9379999999999997e-06 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:930 4.7 4.37111647 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.706273+0000", 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.14732753300000001, 2024-05-07T11:14:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15155411299999999, 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 930 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.706273+0000", 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.706273+0000", 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.706274+0000", 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3300000000000002e-07 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.706278+0000", 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.585e-06 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.706287+0000", 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5119999999999997e-06 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.706292+0000", 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6979999999999997e-06 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.706326+0000", 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4109999999999997e-05 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.706332+0000", 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7459999999999997e-06 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4.79f2605 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.33517666899999998, 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.33943462499999999, 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:752 4.17 4.f62eaa57 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.550386+0000", 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.30321445400000002, 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30750304299999998, 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 752 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.550386+0000", 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.550386+0000", 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.550388+0000", 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8700000000000001e-06 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.550398+0000", 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094e-05 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.550426+0000", 2024-05-07T11:14:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7512e-05 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.550439+0000", 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.33e-05 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.550546+0000", 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106766 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.550561+0000", 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5163e-05 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:792 4.20 4.d8ee5460 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.585006+0000", 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.26859450600000001, 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.27291468499999999, 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 792 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585006+0000", 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585006+0000", 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585007+0000", 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.99e-07 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585020+0000", 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585031+0000", 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0173000000000001e-05 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585035+0000", 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.668e-06 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585103+0000", 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7705000000000003e-05 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585108+0000", 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8339999999999998e-06 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:824 4.37 4.8e9fdd77 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.612952+0000", 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.24064864499999999, 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.245000578, 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 824 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612952+0000", 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612952+0000", 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612953+0000", 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612962+0000", 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.653e-06 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612972+0000", 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0521e-05 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.612977+0000", 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3770000000000004e-06 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.613020+0000", 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2789e-05 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.613026+0000", 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7570000000000001e-06 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:861 4.31 4.98f657f1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.645665+0000", 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.20793610600000001, 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.21231868100000001, 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 861 2024-05-07T11:14:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.645665+0000", 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.645665+0000", 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.645665+0000", 2024-05-07T11:14:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6300000000000005e-07 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.645669+0000", 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6550000000000002e-06 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.645679+0000", 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9680000000000001e-06 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.645684+0000", 2024-05-07T11:14:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7210000000000002e-06 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.645750+0000", 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6136999999999994e-05 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.645758+0000", 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4749999999999993e-06 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:894 4.10 4.a8f7810 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.674950+0000", 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.17865129399999999, 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.183065741, 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 894 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.674950+0000", 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.674950+0000", 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.674950+0000", 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2500000000000005e-07 2024-05-07T11:14:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.674955+0000", 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3059999999999999e-06 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.674965+0000", 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0457e-05 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.674970+0000", 2024-05-07T11:14:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9529999999999998e-06 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.675011+0000", 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0679000000000001e-05 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.675016+0000", 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5690000000000004e-06 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:931 4.23 4.53966863 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.707155+0000", 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.14644621599999999, 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.150891198, 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 931 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.707155+0000", 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.707155+0000", 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.707155+0000", 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0399999999999995e-07 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.707161+0000", 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7450000000000001e-06 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.707172+0000", 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0461e-05 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.707176+0000", 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.933e-06 2024-05-07T11:14:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.707226+0000", 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9418e-05 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.707234+0000", 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0779999999999996e-06 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:717 4.31 4.9ac39fb1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.520249+0000", 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.33335190799999997, 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.33785502299999998, 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 717 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.520249+0000", 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.520249+0000", 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.520251+0000", 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8729999999999999e-06 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.520263+0000", 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.253e-05 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.520291+0000", 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7432000000000001e-05 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.520304+0000", 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3393999999999999e-05 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.520445+0000", 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014066400000000001 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.520469+0000", 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4579999999999998e-05 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:753 4.18 4.c18fac18 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.551186+0000", 2024-05-07T11:14:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.30241500500000001, 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30695082099999998, 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 753 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.551186+0000", 2024-05-07T11:14:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.551186+0000", 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.551188+0000", 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7999999999999999e-06 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.551200+0000", 2024-05-07T11:14:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2415999999999999e-05 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.551227+0000", 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7083000000000001e-05 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.551241+0000", 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4047e-05 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.551332+0000", 2024-05-07T11:14:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1094999999999994e-05 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.551341+0000", 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9150000000000002e-06 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:793 4.d 4.31bc808d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.585953+0000", 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.26764796099999999, 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.27222073200000002, 2024-05-07T11:14:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 793 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585953+0000", 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585953+0000", 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585954+0000", 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585962+0000", 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5140000000000001e-06 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585972+0000", 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9790000000000005e-06 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.585977+0000", 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7419999999999997e-06 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.586046+0000", 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9425999999999996e-05 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.586071+0000", 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4518000000000001e-05 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:862 4.3a 4.8698d07a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.646631+0000", 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.20696972899999999, 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.21157614799999999, 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 862 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.646631+0000", 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.646631+0000", 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.646633+0000", 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8160000000000001e-06 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.646658+0000", 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4845999999999999e-05 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.646685+0000", 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7532999999999999e-05 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.646699+0000", 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.382e-05 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.646807+0000", 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805499999999999 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.646820+0000", 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2826999999999999e-05 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:896 4.3d 4.1aefe57d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.676613+0000", 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.17698807899999999, 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.181626703, 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 896 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.676613+0000", 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.676613+0000", 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.676615+0000", 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8059999999999999e-06 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.676625+0000", 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9739999999999997e-06 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.676652+0000", 2024-05-07T11:14:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7066000000000001e-05 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.676665+0000", 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3209e-05 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.676756+0000", 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1129000000000001e-05 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.676761+0000", 2024-05-07T11:14:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5550000000000002e-06 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:932 4.3a 4.d89f7f7a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.708025+0000", 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.145575596, 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.15024859400000001, 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 932 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708025+0000", 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708025+0000", 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708026+0000", 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0900000000000001e-07 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708030+0000", 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0099999999999997e-06 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708040+0000", 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0180000000000001e-05 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708045+0000", 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.729e-06 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708108+0000", 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3057000000000003e-05 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708113+0000", 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7709999999999997e-06 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4.3f883cd4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.33238399099999999, 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.33708966200000001, 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.410 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:754 4.38 4.68832578 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.552030+0000", 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.30157051200000001, 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30632487600000002, 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 754 2024-05-07T11:14:25.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552030+0000", 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552030+0000", 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552031+0000", 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3300000000000001e-07 2024-05-07T11:14:25.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552036+0000", 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4569999999999996e-06 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552047+0000", 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0643e-05 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552058+0000", 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1229999999999999e-05 2024-05-07T11:14:25.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552091+0000", 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2879999999999997e-05 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552096+0000", 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.797e-06 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.417 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:794 4.17 4.88654857 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.586783+0000", 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.26681803500000001, 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.27160314200000002, 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 794 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.586783+0000", 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.586783+0000", 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.586783+0000", 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1299999999999999e-07 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.586788+0000", 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0380000000000001e-06 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.586797+0000", 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9180000000000006e-06 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.586802+0000", 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.702e-06 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.586871+0000", 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9016999999999993e-05 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.586877+0000", 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1070000000000001e-06 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:826 4.2 4.461a1042 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.614580+0000", 2024-05-07T11:14:25.421 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.23902044, 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.24383698300000001, 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 826 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.614580+0000", 2024-05-07T11:14:25.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.614580+0000", 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.614581+0000", 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6300000000000005e-07 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.614591+0000", 2024-05-07T11:14:25.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5030000000000003e-06 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.614599+0000", 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.67e-06 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.614604+0000", 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5539999999999999e-06 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.614641+0000", 2024-05-07T11:14:25.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7599999999999999e-05 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.614646+0000", 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.69e-06 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:897 4.24 4.624a3d24 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.677381+0000", 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.17622020699999999, 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.18106818499999999, 2024-05-07T11:14:25.425 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 897 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.677381+0000", 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.677381+0000", 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.677382+0000", 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.81e-06 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.677392+0000", 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3570000000000004e-06 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.677419+0000", 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7042e-05 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.677432+0000", 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3297e-05 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.677541+0000", 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000108655 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.677554+0000", 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2847000000000001e-05 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:933 4.3a 4.c33ff27a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.708953+0000", 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.14464754599999999, 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.14952613200000001, 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.429 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 933 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708953+0000", 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708953+0000", 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708955+0000", 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8160000000000001e-06 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708969+0000", 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4153e-05 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.708997+0000", 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7676999999999999e-05 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.709010+0000", 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2927e-05 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.709150+0000", 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140001 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.709165+0000", 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4989e-05 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:755 4.12 4.3ef04952 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.552927+0000", 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.30067431, 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30558433699999998, 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 755 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552927+0000", 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552927+0000", 2024-05-07T11:14:25.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552928+0000", 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.854e-06 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552939+0000", 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0852999999999999e-05 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552967+0000", 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7739e-05 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.552981+0000", 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3777e-05 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.553073+0000", 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2028999999999996e-05 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.553078+0000", 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4410000000000001e-06 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:795 4.22 4.ba3d3ca2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.587659+0000", 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.26594132300000001, 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.27088182900000002, 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 795 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.587659+0000", 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.587659+0000", 2024-05-07T11:14:25.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.587660+0000", 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7100000000000001e-07 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.587665+0000", 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3640000000000001e-06 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.587675+0000", 2024-05-07T11:14:25.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9830000000000008e-06 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.587679+0000", 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6979999999999997e-06 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.587749+0000", 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9305000000000001e-05 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.587754+0000", 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7300000000000002e-06 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:935 4.18 4.e1ce3598 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.710668+0000", 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.14293310000000001, 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.14790541700000001, 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.441 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 935 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.710668+0000", 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.710668+0000", 2024-05-07T11:14:25.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.710668+0000", 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5600000000000005e-07 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.710672+0000", 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9700000000000001e-06 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.710685+0000", 2024-05-07T11:14:25.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.256e-05 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.710690+0000", 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9559999999999996e-06 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.710760+0000", 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9750000000000001e-05 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.710768+0000", 2024-05-07T11:14:25.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7509999999999997e-06 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4.36204744 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.32993291299999999, 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.33493590899999998, 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.445 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:25.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:756 4.1e 4.417db39e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.553758+0000", 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.29984296700000002, 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30487786700000002, 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 756 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.553758+0000", 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.553758+0000", 2024-05-07T11:14:25.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.553759+0000", 2024-05-07T11:14:25.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1600000000000001e-07 2024-05-07T11:14:25.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.553786+0000", 2024-05-07T11:14:25.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7563999999999999e-05 2024-05-07T11:14:25.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.553797+0000", 2024-05-07T11:14:25.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:25.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.553802+0000", 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9119999999999997e-06 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.553870+0000", 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8485000000000006e-05 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.553875+0000", 2024-05-07T11:14:25.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0830000000000003e-06 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:796 4.25 4.1b38e5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.588621+0000", 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.26498027800000001, 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.27004667100000002, 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.455 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 796 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.588621+0000", 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.588621+0000", 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.588622+0000", 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.906e-06 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.588632+0000", 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9000000000000001e-06 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.588660+0000", 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7277e-05 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.588673+0000", 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3603e-05 2024-05-07T11:14:25.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.588808+0000", 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000135165 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.588823+0000", 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5102e-05 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.458 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:827 4.35 4.8f04e35 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.615503+0000", 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.23809762800000001, 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.243194512, 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 827 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.615503+0000", 2024-05-07T11:14:25.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.615503+0000", 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.615504+0000", 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.68e-07 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.615507+0000", 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5619999999999999e-06 2024-05-07T11:14:25.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.615518+0000", 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0142999999999999e-05 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.615522+0000", 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.826e-06 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.615587+0000", 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5028000000000001e-05 2024-05-07T11:14:25.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.615593+0000", 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0279999999999997e-06 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:866 4.10 4.9017b810 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.649954+0000", 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.203647252, 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.20877536999999999, 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.462 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 866 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.649954+0000", 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.649954+0000", 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.649954+0000", 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.649958+0000", 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9609999999999999e-06 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.649967+0000", 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6880000000000005e-06 2024-05-07T11:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.649972+0000", 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2259999999999996e-06 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.650013+0000", 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0760000000000003e-05 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.650018+0000", 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9529999999999998e-06 2024-05-07T11:14:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:900 4.1d 4.b10e7c5d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.679877+0000", 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.173724042, 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.178882608, 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.466 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 900 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.679877+0000", 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.679877+0000", 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.679877+0000", 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.679882+0000", 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0999999999999997e-06 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.679893+0000", 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1336e-05 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.679899+0000", 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1040000000000003e-06 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.679942+0000", 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3461999999999998e-05 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.679952+0000", 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9830000000000008e-06 2024-05-07T11:14:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:936 4.5 4.999e0f45 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.711697+0000", 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.141903785, 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.147093524, 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.470 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 936 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.711697+0000", 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.711697+0000", 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.711699+0000", 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.889e-06 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.711712+0000", 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3563999999999999e-05 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.711755+0000", 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2490999999999997e-05 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.711760+0000", 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6689999999999997e-06 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.711827+0000", 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6950000000000001e-05 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.711832+0000", 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.473 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4.dee0441b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.32903455799999998, 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.334255741, 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:25.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:25.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:757 4.37 4.a25ce0f7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.554653+0000", 2024-05-07T11:14:25.477 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.29894738100000001, 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30419869700000002, 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 757 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.554653+0000", 2024-05-07T11:14:25.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.554653+0000", 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.554655+0000", 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7999999999999999e-06 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.554665+0000", 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4329999999999993e-06 2024-05-07T11:14:25.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.554692+0000", 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7169e-05 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.554705+0000", 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3183000000000001e-05 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.554810+0000", 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105406 2024-05-07T11:14:25.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.554823+0000", 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2816000000000001e-05 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:798 4.2a 4.f84e956a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.590326+0000", 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.26327495200000001, 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.26855787399999997, 2024-05-07T11:14:25.481 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 798 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.590326+0000", 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.590326+0000", 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.590328+0000", 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7999999999999999e-06 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.590338+0000", 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9760000000000007e-06 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.590365+0000", 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7016e-05 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.590378+0000", 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3536999999999999e-05 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.590491+0000", 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011277000000000001 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.590496+0000", 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6990000000000002e-06 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:828 4.34 4.a634f374 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.616516+0000", 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.237085294, 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.24239864999999999, 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 828 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.616516+0000", 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.616516+0000", 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.616517+0000", 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8530000000000001e-06 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.616527+0000", 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9629999999999993e-06 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.616555+0000", 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7379999999999999e-05 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.616568+0000", 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3363000000000001e-05 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.616678+0000", 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011000799999999999 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.616691+0000", 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2517000000000001e-05 2024-05-07T11:14:25.488 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:937 4.20 4.bd8c22e0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.712588+0000", 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.14101254799999999, 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.14635828300000001, 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.489 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 937 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.712588+0000", 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.712588+0000", 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.712590+0000", 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8199999999999999e-06 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.712600+0000", 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7089999999999997e-06 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.712627+0000", 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7433999999999999e-05 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.712641+0000", 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.712780+0000", 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013923700000000001 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.712787+0000", 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5070000000000003e-06 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.492 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:723 4.29 4.c9c91869 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.525495+0000", 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.32810551100000002, 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.33348187200000001, 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 723 2024-05-07T11:14:25.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.525495+0000", 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.525495+0000", 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.525496+0000", 2024-05-07T11:14:25.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.525500+0000", 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7910000000000002e-06 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.525510+0000", 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8789999999999998e-06 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.525514+0000", 2024-05-07T11:14:25.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8489999999999997e-06 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.525582+0000", 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7460999999999997e-05 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.525591+0000", 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3449999999999995e-06 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:758 4.20 4.34dbf1e0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.555522+0000", 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.29807896099999998, 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.303487216, 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 758 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.555522+0000", 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.555522+0000", 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.555523+0000", 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.555527+0000", 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2729999999999996e-06 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.555537+0000", 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0475000000000001e-05 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.555542+0000", 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.933e-06 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.555583+0000", 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0667999999999998e-05 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.555589+0000", 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.711e-06 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:799 4.5 4.9e70a645 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.591129+0000", 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.26247224800000002, 2024-05-07T11:14:25.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.267911917, 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 799 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591129+0000", 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591129+0000", 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591129+0000", 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0399999999999995e-07 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591133+0000", 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9740000000000004e-06 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591144+0000", 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0417999999999999e-05 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591149+0000", 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9699999999999998e-06 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591189+0000", 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0111000000000003e-05 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591194+0000", 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.831e-06 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:829 4.14 4.d6980ad4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.617383+0000", 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.23621799900000001, 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.241713609, 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.504 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 829 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.617383+0000", 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.617383+0000", 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.617383+0000", 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7299999999999995e-07 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.617387+0000", 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6449999999999998e-06 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.617397+0000", 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0132000000000001e-05 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.617402+0000", 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7809999999999996e-06 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.617460+0000", 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7633000000000002e-05 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.617464+0000", 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6840000000000004e-06 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:868 4.8 4.f70ed908 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.651758+0000", 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.201842933, 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.20737362300000001, 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.508 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 868 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.651758+0000", 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.651758+0000", 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.651759+0000", 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0500000000000003e-07 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.651768+0000", 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4900000000000006e-06 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.651777+0000", 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0750000000000004e-06 2024-05-07T11:14:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.651782+0000", 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1340000000000003e-06 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.651819+0000", 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6887000000000001e-05 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.651825+0000", 2024-05-07T11:14:25.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:902 4.1c 4.b1c02adc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.681641+0000", 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.17196013199999999, 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.177523653, 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 902 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.681641+0000", 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.681641+0000", 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.681641+0000", 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7199999999999998e-07 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.681651+0000", 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9040000000000004e-06 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.681662+0000", 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1054e-05 2024-05-07T11:14:25.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.681668+0000", 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0299999999999999e-06 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.681703+0000", 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4885000000000002e-05 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.681709+0000", 2024-05-07T11:14:25.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5439999999999998e-06 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:938 4.33 4.9a2864b3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.713454+0000", 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.14014666100000001, 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.145744015, 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.516 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 938 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.713454+0000", 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.713454+0000", 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.713456+0000", 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.877e-06 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.713494+0000", 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8166e-05 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.713522+0000", 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7305999999999999e-05 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.713535+0000", 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3193999999999999e-05 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.713668+0000", 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013369099999999999 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.713693+0000", 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4790000000000002e-05 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:725 4.20 4.1479dde0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.527130+0000", 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.32647101299999998, 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.33210105699999998, 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.520 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 725 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.527130+0000", 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.527130+0000", 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.527130+0000", 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7800000000000001e-07 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.527134+0000", 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.817e-06 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.527144+0000", 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0159e-05 2024-05-07T11:14:25.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.527149+0000", 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7230000000000004e-06 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.527216+0000", 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7033999999999995e-05 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.527222+0000", 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7069999999999997e-06 2024-05-07T11:14:25.523 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:759 4.1d 4.d91a295d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.556389+0000", 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.29721136999999997, 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30287523399999999, 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.524 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 759 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.556389+0000", 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.556389+0000", 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.556390+0000", 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6499999999999999e-07 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.556394+0000", 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1620000000000001e-06 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.556404+0000", 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037999999999999e-05 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.556409+0000", 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6639999999999997e-06 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.556474+0000", 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5092999999999995e-05 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.556480+0000", 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.925e-06 2024-05-07T11:14:25.527 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:800 4.17 4.1aad12d7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.591916+0000", 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.26168460100000002, 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.26738228000000003, 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.528 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 800 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591916+0000", 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591916+0000", 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591917+0000", 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6199999999999997e-07 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591921+0000", 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2560000000000004e-06 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591949+0000", 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7494000000000001e-05 2024-05-07T11:14:25.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591954+0000", 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1270000000000002e-06 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591994+0000", 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0195999999999999e-05 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.591999+0000", 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3140000000000003e-06 2024-05-07T11:14:25.531 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:830 4.10 4.573ee490 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.618175+0000", 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.23542562, 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.241171578, 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.532 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 830 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.618175+0000", 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.618175+0000", 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.618176+0000", 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0500000000000003e-07 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.618180+0000", 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3599999999999998e-06 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.618208+0000", 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7648e-05 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.618213+0000", 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9300000000000002e-06 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.618260+0000", 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6987000000000003e-05 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.618268+0000", 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6809999999999998e-06 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.535 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:903 4.2c 4.8e84b52c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.682519+0000", 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.17108146900000001, 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.176859354, 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 903 2024-05-07T11:14:25.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.682519+0000", 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.682519+0000", 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.682520+0000", 2024-05-07T11:14:25.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8999999999999996e-07 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.682524+0000", 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.682534+0000", 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0448000000000001e-05 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.682539+0000", 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8969999999999999e-06 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.682577+0000", 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8380999999999997e-05 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.682583+0000", 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4539999999999998e-06 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:939 4.29 4.b0e4b8a9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.714255+0000", 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.13934586600000001, 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.145154593, 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 939 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.714255+0000", 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.714255+0000", 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.714257+0000", 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7999999999999999e-06 2024-05-07T11:14:25.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.714269+0000", 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2577e-05 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.714297+0000", 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7440000000000002e-05 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.714317+0000", 2024-05-07T11:14:25.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0559000000000001e-05 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.714355+0000", 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7981000000000001e-05 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.714362+0000", 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8959999999999997e-06 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:726 4.27 4.9a44627 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528002+0000", 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.32559881899999998, 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.33143997400000003, 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 726 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528002+0000", 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528002+0000", 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528002+0000", 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6600000000000002e-07 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528006+0000", 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2160000000000002e-06 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528012+0000", 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6150000000000002e-06 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528016+0000", 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6339999999999999e-06 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528083+0000", 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6642000000000003e-05 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528089+0000", 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0610000000000001e-06 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:760 4.16 4.cd6859d6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.557186+0000", 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.29641470599999997, 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30228701299999999, 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 760 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.557186+0000", 2024-05-07T11:14:25.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.557186+0000", 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.557187+0000", 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4499999999999996e-07 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.557191+0000", 2024-05-07T11:14:25.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5600000000000004e-06 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.557202+0000", 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0526999999999999e-05 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.557207+0000", 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9200000000000003e-06 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.557249+0000", 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1956000000000003e-05 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.557255+0000", 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8050000000000003e-06 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:801 4.a 4.7230c0ca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.592844+0000", 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.26075704199999999, 2024-05-07T11:14:25.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.266661329, 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 801 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.592844+0000", 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.592844+0000", 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.592844+0000", 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.75e-07 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.592848+0000", 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7610000000000001e-06 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.592858+0000", 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9820000000000003e-06 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.592863+0000", 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6569999999999996e-06 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.592931+0000", 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8161e-05 2024-05-07T11:14:25.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.592937+0000", 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9920000000000004e-06 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:904 4.1e 4.a090781e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.683416+0000", 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.170184747, 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.17612087000000001, 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.555 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 904 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.683416+0000", 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.683416+0000", 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.683418+0000", 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.683430+0000", 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1943000000000001e-05 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.683457+0000", 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7356999999999999e-05 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.683470+0000", 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3176000000000001e-05 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.683591+0000", 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120878 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.683605+0000", 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.343e-05 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:940 4.36 4.c1539e36 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.715122+0000", 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.13847853600000001, 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.144445356, 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.559 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 940 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.715122+0000", 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.715122+0000", 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.715123+0000", 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0800000000000004e-07 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.715127+0000", 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1370000000000004e-06 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.715138+0000", 2024-05-07T11:14:25.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.063e-05 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.715143+0000", 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.101e-06 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.715183+0000", 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9842999999999998e-05 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.715188+0000", 2024-05-07T11:14:25.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7080000000000002e-06 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4.77ff6a72 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.32473469599999999, 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.33073361499999998, 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.563 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:25.566 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:761 4.32 4.4d9e16f2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.558087+0000", 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.29551353000000002, 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30154315799999998, 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.567 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 761 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558087+0000", 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558087+0000", 2024-05-07T11:14:25.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558089+0000", 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.813e-06 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558099+0000", 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0093e-05 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558126+0000", 2024-05-07T11:14:25.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7106000000000001e-05 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558140+0000", 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3387000000000001e-05 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558218+0000", 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8119000000000002e-05 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558229+0000", 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1005999999999999e-05 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:802 4.1a 4.1bb759a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.593742+0000", 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.25985882599999999, 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.26592017800000001, 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.571 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 802 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.593742+0000", 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.593742+0000", 2024-05-07T11:14:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.593743+0000", 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2699999999999999e-07 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.593749+0000", 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2339999999999999e-06 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.593759+0000", 2024-05-07T11:14:25.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0536e-05 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.593765+0000", 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2569999999999998e-06 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.593809+0000", 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4240000000000003e-05 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.593815+0000", 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6609999999999997e-06 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:833 4.29 4.fd9e5169 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.620846+0000", 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.23275522000000001, 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.23884813999999999, 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.575 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 833 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.620846+0000", 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.620846+0000", 2024-05-07T11:14:25.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.620846+0000", 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2399999999999997e-07 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.620850+0000", 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.177e-06 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.620861+0000", 2024-05-07T11:14:25.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0665e-05 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.620866+0000", 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0769999999999998e-06 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.620916+0000", 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9848000000000001e-05 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.620925+0000", 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1449999999999997e-06 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:870 4.2c 4.4653912c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.653836+0000", 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.19976443599999999, 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.20588819999999999, 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 870 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.653836+0000", 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.653836+0000", 2024-05-07T11:14:25.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.653837+0000", 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.06e-07 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.653841+0000", 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.788e-06 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.653848+0000", 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.653853+0000", 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6199999999999998e-06 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.653886+0000", 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3272999999999998e-05 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.653892+0000", 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1889999999999998e-06 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:905 4.16 4.9ede18d6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.684139+0000", 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.16946207699999999, 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.17561765500000001, 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 905 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.684139+0000", 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.684139+0000", 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.684139+0000", 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7299999999999995e-07 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.684143+0000", 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5530000000000001e-06 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.684153+0000", 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0051000000000001e-05 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.684175+0000", 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2228000000000001e-05 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.684216+0000", 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0608999999999997e-05 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.684221+0000", 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9200000000000003e-06 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:941 4.38 4.9fa4eeb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.716027+0000", 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.13757359299999999, 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.143760531, 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.587 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 941 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716027+0000", 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716027+0000", 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716028+0000", 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8400000000000004e-07 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716033+0000", 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3349999999999997e-06 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716044+0000", 2024-05-07T11:14:25.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0475999999999999e-05 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716055+0000", 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.129e-05 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716101+0000", 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6372999999999998e-05 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716109+0000", 2024-05-07T11:14:25.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4730000000000003e-06 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:728 4.2a 4.19ba37ea (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.529772+0000", 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.32382841299999998, 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.33004783799999998, 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.591 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 728 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.529772+0000", 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.529772+0000", 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.529773+0000", 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.99e-07 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.529778+0000", 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.843e-06 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.529788+0000", 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0429e-05 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.529793+0000", 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7670000000000003e-06 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.529863+0000", 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9658000000000003e-05 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.529869+0000", 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9649999999999996e-06 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:762 4.36 4.8231fcf6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.558986+0000", 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.29461459800000001, 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30086530500000003, 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 762 2024-05-07T11:14:25.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558986+0000", 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558986+0000", 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558987+0000", 2024-05-07T11:14:25.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1600000000000001e-07 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.558991+0000", 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.121e-06 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.559019+0000", 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7679999999999999e-05 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.559024+0000", 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9200000000000003e-06 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.559096+0000", 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1967999999999999e-05 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.559101+0000", 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4140000000000002e-06 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:803 4.29 4.e02cc629 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.594591+0000", 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.25901008199999997, 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.26529299200000001, 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 803 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.594591+0000", 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.594591+0000", 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.594591+0000", 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6899999999999997e-07 2024-05-07T11:14:25.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.594595+0000", 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5700000000000001e-06 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.594605+0000", 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.005e-05 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.594610+0000", 2024-05-07T11:14:25.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7010000000000004e-06 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.594677+0000", 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7350999999999999e-05 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.594686+0000", 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7660000000000004e-06 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:834 4.11 4.330ef511 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.621820+0000", 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.23178125999999999, 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.23809654399999999, 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 834 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.621820+0000", 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.621820+0000", 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.621820+0000", 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0900000000000001e-07 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.621854+0000", 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3519999999999998e-05 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.621865+0000", 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0861e-05 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.621870+0000", 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2979999999999999e-06 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.621921+0000", 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1279000000000002e-05 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.621930+0000", 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9420000000000001e-06 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:906 4.13 4.f2b38193 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.685080+0000", 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.16852049399999999, 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.17486690899999999, 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 906 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.685080+0000", 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.685080+0000", 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.685081+0000", 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.685085+0000", 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9539999999999998e-06 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.685095+0000", 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0373999999999999e-05 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.685101+0000", 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2399999999999998e-06 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.685151+0000", 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0767999999999999e-05 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.685157+0000", 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:942 4.e 4.e032e44e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.716895+0000", 2024-05-07T11:14:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.13670573, 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.143085297, 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 942 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716895+0000", 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716895+0000", 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716896+0000", 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9500000000000002e-07 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716900+0000", 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1339999999999997e-06 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716910+0000", 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0487e-05 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716916+0000", 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2220000000000001e-06 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716958+0000", 2024-05-07T11:14:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2793999999999997e-05 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.716963+0000", 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:729 4.e 4.e3ee914e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.530625+0000", 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.32297556599999999, 2024-05-07T11:14:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.32938611499999998, 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 729 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.530625+0000", 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.530625+0000", 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.530626+0000", 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0999999999999998e-07 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.530630+0000", 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.530640+0000", 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0533000000000001e-05 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.530645+0000", 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9339999999999997e-06 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.530682+0000", 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6971000000000002e-05 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.530687+0000", 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3290000000000004e-06 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:763 4.2d 4.f1a7cf6d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.559858+0000", 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.293742693, 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.30018513299999999, 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 763 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.559858+0000", 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.559858+0000", 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.559860+0000", 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.81e-06 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.559869+0000", 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2699999999999993e-06 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.559896+0000", 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.722e-05 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.559910+0000", 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3349999999999999e-05 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.560033+0000", 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000122774 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.560038+0000", 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7420000000000003e-06 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:835 4.30 4.31a81f70 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.622715+0000", 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.23088542500000001, 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.237379228, 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 835 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.622715+0000", 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.622715+0000", 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.622716+0000", 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1500000000000004e-07 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.622721+0000", 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6090000000000003e-06 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.622731+0000", 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0448999999999999e-05 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.622736+0000", 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8980000000000004e-06 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.622786+0000", 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9880999999999999e-05 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.622793+0000", 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5020000000000003e-06 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:872 4.14 4.22279214 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.655599+0000", 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.198001338, 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.20452890000000001, 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 872 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.655599+0000", 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.655599+0000", 2024-05-07T11:14:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.655600+0000", 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1200000000000002e-07 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.655604+0000", 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9790000000000004e-06 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.655615+0000", 2024-05-07T11:14:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.655620+0000", 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0509999999999996e-06 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.655654+0000", 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4751e-05 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.655660+0000", 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5679999999999999e-06 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:943 4.18 4.f7033858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.717788+0000", 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.13581331599999999, 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.14237417199999999, 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 943 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.717788+0000", 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.717788+0000", 2024-05-07T11:14:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.717789+0000", 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8369999999999999e-06 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.717800+0000", 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0322999999999999e-05 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.717828+0000", 2024-05-07T11:14:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8016000000000001e-05 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.717841+0000", 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.364e-05 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.717977+0000", 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013565100000000001 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.718002+0000", 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5089999999999999e-05 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4.eb7b6a32 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.35171828199999999, 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.35831137400000002, 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.634 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:25.637 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:730 4.2a 4.57147baa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.531608+0000", 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.32199281099999999, 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.328619102, 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.638 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 730 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.531608+0000", 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.531608+0000", 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.531610+0000", 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8700000000000001e-06 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.531620+0000", 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0386e-05 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.531648+0000", 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7719999999999999e-05 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.531661+0000", 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3203e-05 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.531767+0000", 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010608200000000001 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.531772+0000", 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.169e-06 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:764 4.10 4.6f9a4190 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.560712+0000", 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.29288923, 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.29954783299999999, 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 764 2024-05-07T11:14:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.560712+0000", 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.560712+0000", 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.560712+0000", 2024-05-07T11:14:25.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0699999999999996e-07 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.560717+0000", 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.560744+0000", 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7566e-05 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.560749+0000", 2024-05-07T11:14:25.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9309999999999999e-06 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.560795+0000", 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5793e-05 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.560803+0000", 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9789999999999993e-06 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.645 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:805 4.2d 4.52a909ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.596275+0000", 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.25732566600000001, 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.26401804600000001, 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 805 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.596275+0000", 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.596275+0000", 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.596276+0000", 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.23e-07 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.596280+0000", 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0260000000000001e-06 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.596290+0000", 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0479000000000001e-05 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.596295+0000", 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9450000000000001e-06 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.596329+0000", 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3657e-05 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.596334+0000", 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1540000000000001e-06 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:836 4.29 4.2294869 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.623629+0000", 2024-05-07T11:14:25.649 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.22997169000000001, 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.23669678, 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 836 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.623629+0000", 2024-05-07T11:14:25.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.623629+0000", 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.623631+0000", 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9069999999999999e-06 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.623641+0000", 2024-05-07T11:14:25.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393e-05 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.623669+0000", 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7195999999999998e-05 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.623682+0000", 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3190000000000001e-05 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.623788+0000", 2024-05-07T11:14:25.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106288 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.623804+0000", 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5809999999999999e-05 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:909 4.29 4.7cacfc29 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.687577+0000", 2024-05-07T11:14:25.653 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.16602402999999999, 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.17279830800000001, 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 909 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.687577+0000", 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.687577+0000", 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.687579+0000", 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8640000000000001e-06 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.687588+0000", 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6260000000000007e-06 2024-05-07T11:14:25.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.687617+0000", 2024-05-07T11:14:25.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8619000000000002e-05 2024-05-07T11:14:25.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.687630+0000", 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.345e-05 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.687734+0000", 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103362 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.687739+0000", 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:944 4.10 4.7bad1890 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.718642+0000", 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.13495874999999999, 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.14176443, 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 944 2024-05-07T11:14:25.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.718642+0000", 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.718642+0000", 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.718643+0000", 2024-05-07T11:14:25.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1800000000000005e-07 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.718647+0000", 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1620000000000001e-06 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.718657+0000", 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0232e-05 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.718662+0000", 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9649999999999999e-06 2024-05-07T11:14:25.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.718728+0000", 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5605000000000006e-05 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.718737+0000", 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0610000000000002e-06 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.662 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4.8fa9765f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.34759454000000001, 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.35443115600000002, 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:765 4.5 4.96561485 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.666 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.561543+0000", 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.29205738399999998, 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.29892606500000002, 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 765 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.561543+0000", 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.561543+0000", 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.561544+0000", 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.75e-07 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.561548+0000", 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8909999999999997e-06 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.561558+0000", 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9210000000000004e-06 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.561563+0000", 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7899999999999999e-06 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.561620+0000", 2024-05-07T11:14:25.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7439999999999999e-05 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.561626+0000", 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4369999999999998e-06 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:837 4.20 4.850a7d60 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.624437+0000", 2024-05-07T11:14:25.670 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.22916394100000001, 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.236063683, 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 837 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.624437+0000", 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.624437+0000", 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.624439+0000", 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7859999999999999e-06 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.624448+0000", 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2969999999999992e-06 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.624475+0000", 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7229e-05 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.624488+0000", 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.309e-05 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.624591+0000", 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102867 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.624600+0000", 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7600000000000008e-06 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:874 4.1a 4.ae3e711a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.657382+0000", 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.19621836400000001, 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.20315007199999999, 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.674 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 874 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.657382+0000", 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.657382+0000", 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.657384+0000", 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9069999999999999e-06 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.657394+0000", 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.876e-06 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.657422+0000", 2024-05-07T11:14:25.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7447e-05 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.657435+0000", 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3179999999999999e-05 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.657512+0000", 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7601999999999993e-05 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.657524+0000", 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.151e-05 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:910 4.11 4.cb1bbfd1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.688370+0000", 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.16523052299999999, 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.172193174, 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.678 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 910 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.688370+0000", 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.688370+0000", 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.688371+0000", 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3200000000000004e-07 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.688377+0000", 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3199999999999996e-06 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.688388+0000", 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0624e-05 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.688393+0000", 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9320000000000004e-06 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.688433+0000", 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9749000000000002e-05 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.688437+0000", 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4100000000000001e-06 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.681 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:945 4.12 4.c4d6ef52 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.719540+0000", 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.13406115800000001, 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.14105669600000001, 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for peered", 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 945 2024-05-07T11:14:25.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.719540+0000", 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.719540+0000", 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.719541+0000", 2024-05-07T11:14:25.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7999999999999999e-06 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.719554+0000", 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3010000000000001e-05 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.719582+0000", 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7155999999999999e-05 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.719595+0000", 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3210000000000001e-05 2024-05-07T11:14:25.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.719725+0000", 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012995500000000001 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.719730+0000", 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5729999999999998e-06 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:25.685 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-05-07T11:14:25.686 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 207 2024-05-07T11:14:25.686 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:25.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:25.689 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:25.689 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:25.686+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:25.788 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:25.787+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:25.825 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:25.825 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:25.825 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:25.840 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:25.840 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:25.848 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:25.849 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:25.850 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:25.852 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:25.852 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:25.888 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:25.888+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:25.990 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:25.989+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:26.005 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:26.005 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:26.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:26.091 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:26.091+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:26.125 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:26.125 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:26.134 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:26.228 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:26.192+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:26.243 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:26.244 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:26.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:26.297 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:26.297+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:26.362 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:26.362 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:26.371 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:26.412 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:26.412+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:26.488 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:26.488 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:26.495 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:26.495+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:26.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:26.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T11:14:26.598 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:26.598+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:26.612 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:26.612 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:26.622 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:26.698 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:26.698+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:26.729 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:26.729 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:26.739 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:26.800 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:26.800+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:26.851 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:26.851 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:26.860 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:26.900 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:26.900+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:27.001 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:27.001+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:27.009 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:27.009 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:27.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:27.103 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:27.102+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:27.165 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:27.165 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:27.175 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:27.204 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:27.204+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:27.289 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:27.290 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:27.300 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:27.343 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:27.343+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:27.406 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:27.405+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:27.416 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:27.416 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:27.426 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:27.504 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-05-07T11:14:27.511 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:27.510+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:27.582 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:27.582 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:27.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:27.634 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:27.634+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:27.703 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:27.703 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:27.708 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:27.708+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:27.712 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:27.809 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:27.808+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:27.819 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:27.819 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:27.829 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:27.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:27.910 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:27.909+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:27.938 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:27.938 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:27.948 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:27.995 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:27.995 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:27.995 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:28.010 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:28.010+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:28.020 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:28.020 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:28.023 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:28.024 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:28.062 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:120 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-set-vals in=97593b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:28.060786+0000", 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0024045630000000002, 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024221220000000001, 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.060786+0000", 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.060786+0000", 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.060786+0000", 2024-05-07T11:14:28.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4e-07 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.060870+0000", 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3916000000000001e-05 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.060880+0000", 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6390000000000004e-06 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.060885+0000", 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1019999999999996e-06 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.060921+0000", 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5454999999999999e-05 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.060968+0000", 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7815999999999998e-05 2024-05-07T11:14:28.066 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(client.4549.0:3637 4.0 e55/24 4:026655a4:::1000000105d.00000000:head v 55'49, mlcod=55'47)", 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:28.061890+0000", 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0013004150000000001, 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001354615, 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.061890+0000", 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.061890+0000", 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.061890+0000", 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3399999999999999e-07 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.061896+0000", 2024-05-07T11:14:28.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2560000000000002e-06 2024-05-07T11:14:28.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.061905+0000", 2024-05-07T11:14:28.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5429999999999999e-06 2024-05-07T11:14:28.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.061912+0000", 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1679999999999998e-06 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.061945+0000", 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.273e-05 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.061957+0000", 2024-05-07T11:14:28.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1579e-05 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:3638 4.1c 4:39d37d05:::1000000105e.00000000:head [write 0~89 in=89b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:28.062236+0000", 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.00095432899999999996, 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010425390000000001, 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:28.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.072 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.072 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.072 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 3638 2024-05-07T11:14:28.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.072 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.062236+0000", 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.062236+0000", 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.062237+0000", 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6199999999999997e-07 2024-05-07T11:14:28.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.062241+0000", 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6079999999999998e-06 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.062248+0000", 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2989999999999999e-06 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.062253+0000", 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7439999999999998e-06 2024-05-07T11:14:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.062290+0000", 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7156999999999997e-05 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.062359+0000", 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8980999999999996e-05 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:3639 4.2a 4:54c568fa:::1000000105f.00000000:head [write 0~870 in=870b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:28.063104+0000", 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.6577999999999997e-05, 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021242599999999999, 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 3639 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.063104+0000", 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.063104+0000", 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.063104+0000", 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2799999999999996e-07 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.063108+0000", 2024-05-07T11:14:28.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6619999999999998e-06 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.063115+0000", 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7349999999999999e-06 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.063119+0000", 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6009999999999997e-06 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.063166+0000", 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7042000000000001e-05 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:28.063277+0000", 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000110537 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 4 2024-05-07T11:14:28.079 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:28.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:28.111 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:28.111+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:28.198 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:28.199 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:28.209 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:28.252 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:28.252+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:28.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-07T11:14:28.314 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:28.313+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:28.330 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8268179789999999, 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.331 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.336 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8226942369999999, 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:28.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:28.342 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.342 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.342 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8226454419999998, 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.343 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:28.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:28.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:28.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.348 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.822612151, 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:28.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:28.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:28.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:28.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8221553830000001, 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:28.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:28.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:28.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.822120365, 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.360 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:28.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8220969780000003, 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.366 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:28.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8213017809999998, 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.372 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.820359243, 2024-05-07T11:14:28.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.382 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8184648409999999, 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8173914070000001, 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.388 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.393 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8155916039999997, 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:28.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:28.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:28.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.399 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8146555740000001, 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:28.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8119296220000001, 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:28.410 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.811083751, 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:28.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:28.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:28.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:28.415 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8102763660000001, 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:28.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.807483688, 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:28.421 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.426 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.80503261, 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.427 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8041342550000001, 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:28.437 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.7998343930000003, 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:28.443 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:28.443 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:28.444 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:28.443+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:28.445 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:28.545 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:28.545+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:28.552 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:28.552 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:28.552 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:28.552 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:28.562 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:28.637 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:14:28.648 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:28.647+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:28.682 INFO:tasks.workunit.client.0.smithi062.stderr:Updating files: 21% (923/4287) Updating files: 22% (944/4287) Updating files: 23% (987/4287) Updating files: 24% (1029/4287) Updating files: 25% (1072/4287) Updating files: 26% (1115/4287) Updating files: 27% (1158/4287) Updating files: 28% (1201/4287) Updating files: 29% (1244/4287) Updating files: 30% (1287/4287) Updating files: 30% (1317/4287) Updating files: 31% (1329/4287) Updating files: 32% (1372/4287) Updating files: 33% (1415/4287) Updating files: 34% (1458/4287) Updating files: 35% (1501/4287) Updating files: 36% (1544/4287) Updating files: 37% (1587/4287) Updating files: 38% (1630/4287) Updating files: 39% (1672/4287) Updating files: 40% (1715/4287) Updating files: 41% (1758/4287) Updating files: 42% (1801/4287) Updating files: 43% (1844/4287) Updating files: 44% (1887/4287) Updating files: 45% (1930/4287) Updating files: 46% (1973/4287) Updating files: 47% (2015/4287) Updating files: 48% (2058/4287) Updating files: 49% (2101/4287) Updating files: 50% (2144/4287) Updating files: 51% (2187/4287) Updating files: 52% (2230/4287) Updating files: 53% (2273/4287) Updating files: 54% (2315/4287) Updating files: 55% (2358/4287) Updating files: 55% (2396/4287) Updating files: 56% (2401/4287) Updating files: 57% (2444/4287) Updating files: 58% (2487/4287) Updating files: 59% (2530/4287) Updating files: 60% (2573/4287) Updating files: 61% (2616/4287) Updating files: 62% (2658/4287) Updating files: 63% (2701/4287) Updating files: 64% (2744/4287) Updating files: 65% (2787/4287) Updating files: 66% (2830/4287) Updating files: 67% (2873/4287) Updating files: 68% (2916/4287) Updating files: 69% (2959/4287) Updating files: 70% (3001/4287) Updating files: 71% (3044/4287) Updating files: 72% (3087/4287) Updating files: 73% (3130/4287) Updating files: 74% (3173/4287) Updating files: 75% (3216/4287) Updating files: 76% (3259/4287) Updating files: 77% (3301/4287) Updating files: 78% (3344/4287) Updating files: 79% (3387/4287) Updating files: 80% (3430/4287) Updating files: 80% (3447/4287) Updating files: 81% (3473/4287) Updating files: 82% (3516/4287) Updating files: 83% (3559/4287) Updating files: 84% (3602/4287) Updating files: 85% (3644/4287) Updating files: 86% (3687/4287) Updating files: 87% (3730/4287) Updating files: 88% (3773/4287) Updating files: 89% (3816/4287) Updating files: 90% (3859/4287) Updating files: 91% (3902/4287) Updating files: 92% (3945/4287) Updating files: 93% (3987/4287) Updating files: 94% (4030/4287) Updating files: 95% (4073/4287) Updating files: 96% (4116/4287) Updating files: 97% (4159/4287) Updating files: 98% (4202/4287) Updating files: 99% (4245/4287) Updating files: 100% (4287/4287) Updating files: 100% (4287/4287), done. 2024-05-07T11:14:28.690 INFO:tasks.workunit.client.0.smithi062.stderr:+ cd xfstests-dev 2024-05-07T11:14:28.691 INFO:tasks.workunit.client.0.smithi062.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2024-05-07T11:14:28.710 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:28.710 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:28.711 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:28.711 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:28.711 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:28.722 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:28.748 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-05-07T11:14:28.749 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:28.748+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:28.850 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:28.850+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:28.868 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.360822808, 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.3607347260000004, 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.3519715989999996, 2024-05-07T11:14:28.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:28.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:28.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:28.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:28.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.3476085519999996, 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:28.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:28.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:28.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.892 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.892 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:28.892 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.3449757150000003, 2024-05-07T11:14:28.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:28.892 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.892 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.892 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.892 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.892 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.892 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.897 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.3407048130000003, 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:28.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:28.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:28.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:28.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:28.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:28.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:28.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:28.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:28.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:28.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:28.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:28.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:28.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:28.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:28.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:28.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:28.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:28.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:28.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:28.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:28.907 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.907 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.907 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.908 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.908 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:28.908 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.3312066050000002, 2024-05-07T11:14:28.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:28.908 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.908 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.909 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.909 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.909 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.909 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.909 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:28.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.910 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:28.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:28.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:28.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:28.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:28.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:28.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:28.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:28.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:28.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:28.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:28.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:28.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:28.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:28.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:28.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:28.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:28.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:28.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:28.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:28.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:28.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:28.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:28.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:28.920 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.920 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.920 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.921 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.921 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:28.921 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.3285663359999997, 2024-05-07T11:14:28.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:28.921 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.921 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.922 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.922 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.922 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.922 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.922 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:28.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.923 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:28.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:28.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:28.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:28.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:28.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:28.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:28.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:28.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:28.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:28.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:28.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:28.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:28.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:28.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.929 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.3183868790000002, 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.3046114079999995, 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.935 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:28.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:28.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:28.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.2985863469999996, 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:28.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:28.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:28.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:28.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:28.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:28.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:28.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:28.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:28.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:28.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:28.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:28.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:28.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:28.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:28.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:28.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:28.949 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.949 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.949 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.949 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.950 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:28.950 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.2977443580000001, 2024-05-07T11:14:28.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:28.950 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.950 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.950 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.950 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.951 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.951 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.951 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:28.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.951 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:28.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.2951800589999998, 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.2943337100000001, 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.2900382339999998, 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:28.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.2872504349999998, 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:28.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.2864329950000002, 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.980 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:28.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:28.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:28.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:28.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:28.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:28.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:28.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:28.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:28.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:28.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:28.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:28.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:28.988 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.988 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:28.988 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:28.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.988 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:28.988 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:28.989 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.2846266049999997, 2024-05-07T11:14:28.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:28.989 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:28.989 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:28.989 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:28.989 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:28.989 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:28.990 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:28.990 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:28.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.990 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:28.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:28.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:28.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:28.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:28.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:28.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:28.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:28.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:28.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:28.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:28.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:28.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:28.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:28.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:28.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:28.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:28.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:28.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:28.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:28.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:28.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:28.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:28.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:28.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:28.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:28.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:28.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:28.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:28.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:28.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:28.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:28.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:28.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:28.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:28.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:28.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:28.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:28.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:29.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:29.000 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.000 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.000 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.000 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.001 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:29.001 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.2776321590000004, 2024-05-07T11:14:29.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:29.001 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.001 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.001 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.001 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.002 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.002 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.002 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:29.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.002 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:29.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:29.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:29.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:29.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:29.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:29.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:29.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:29.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:29.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:29.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:29.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:29.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:29.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:29.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:29.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:29.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:29.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:29.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:29.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:29.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:29.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:29.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:29.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:29.011 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.011 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.012 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.012 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.012 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:29.012 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 4.264562658, 2024-05-07T11:14:29.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:29.012 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.013 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.013 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.013 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.013 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.013 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.013 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:29.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:29.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:29.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:29.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:29.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:29.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:29.019 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.019 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.019 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.019 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.020 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.020 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:29.022 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:29.022 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:29.020+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:29.122 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:29.122+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:29.129 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:29.130 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:29.130 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:29.130 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:29.137 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:29.223 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:29.224+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:29.281 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:29.281 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:29.281 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:29.281 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:29.281 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:29.290 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:29.334 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:29.333+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:29.396 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8928372429999998, 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8887135009999998, 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8886647060000001, 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8886314149999999, 2024-05-07T11:14:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:29.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:29.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:29.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:29.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:29.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:29.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:29.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:29.430 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8881746469999996, 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.431 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:29.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.437 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8881396290000003, 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:29.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:29.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:29.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:29.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8881162419999997, 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.444 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:29.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:29.450 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.450 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.450 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.451 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.451 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:29.451 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8873210450000002, 2024-05-07T11:14:29.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:29.451 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.451 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.451 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.451 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.451 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.452 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.452 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:29.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.452 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:29.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:29.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8863785069999999, 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:29.457 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:29.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:29.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:29.463 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8844841050000003, 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:29.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:29.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:29.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.883410671, 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.470 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:29.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:29.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:29.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:29.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:29.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:29.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:29.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:29.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:29.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:29.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:29.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:29.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:29.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:29.477 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.477 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.477 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.478 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.478 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:29.478 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8816108680000001, 2024-05-07T11:14:29.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:29.478 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.478 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.478 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.478 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.478 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.478 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:29.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:29.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:29.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:29.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:29.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:29.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:29.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.880674838, 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:29.485 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:29.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:29.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:29.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:29.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:29.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:29.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:29.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:29.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:29.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:29.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:29.492 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8779488860000004, 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:29.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:29.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:29.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:29.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:29.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:29.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:29.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:29.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:29.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:29.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:29.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:29.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:29.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:29.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:29.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:29.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:29.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:29.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:29.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:29.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:29.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:29.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:29.501 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.501 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.501 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.502 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.502 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:29.502 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8771030150000003, 2024-05-07T11:14:29.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:29.502 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.502 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.503 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.503 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.503 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.503 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.503 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:29.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.504 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:29.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:29.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.509 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8762956299999995, 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.510 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:29.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8735029519999999, 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:29.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:29.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:29.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:29.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:29.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.521 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8710518739999999, 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.522 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:29.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:29.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:29.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:29.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:29.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:29.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:29.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:29.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:29.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:29.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:29.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:29.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:29.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:29.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:29.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:29.529 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.529 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.529 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.530 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.530 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:29.530 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8701535190000005, 2024-05-07T11:14:29.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:29.530 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.530 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.531 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.531 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.531 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.531 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.531 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:29.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.531 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:29.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:29.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:29.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:29.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:29.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:29.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:29.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:29.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:29.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:29.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:29.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:29.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:29.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:29.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:29.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:29.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:29.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:29.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:29.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:29.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:29.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:29.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:29.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:29.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.539 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8658536569999997, 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:29.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:29.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:29.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:29.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:29.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:29.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.546 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:29.546 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:29.546 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:29.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T11:14:29.549 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:29.547+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:29.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:29.649 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:29.648+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:29.657 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:29.657 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:29.657 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:29.657 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:29.666 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:29.749 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:29.749+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:29.809 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:29.810 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:29.810 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:29.810 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:29.810 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:29.818 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:29.861 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:29.861+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:29.924 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.417139347, 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.4170512649999996, 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.4082881379999996, 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.4039250909999996, 2024-05-07T11:14:29.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:29.945 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.945 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.945 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.945 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.946 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.946 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:29.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.4012922540000003, 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:29.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.957 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3970213520000003, 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3875231440000002, 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.963 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:29.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.968 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3848828749999997, 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.969 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.974 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3747034180000002, 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:29.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:29.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:29.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3609279470000004, 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:29.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3549028859999996, 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3540608970000001, 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3514965979999998, 2024-05-07T11:14:29.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:29.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:30.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3506502490000001, 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:30.003 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:30.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:30.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:30.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3463547729999998, 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:30.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.014 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3435669739999998, 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3427495340000002, 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:30.020 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:30.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:30.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3409431439999997, 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:30.026 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:30.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:30.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:30.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.3339486980000004, 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:30.032 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:30.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:30.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:30.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 5.320879197, 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.043 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:30.044 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.044 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:30.044 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:30.044 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:30.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:30.046 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:30.045+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:30.046 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:30.150 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:30.146+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:30.154 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:30.155 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:30.155 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:30.155 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:30.163 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:30.192 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:30.192 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:30.192 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:30.216 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:30.217 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:30.220 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:30.220 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:30.248 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:30.248+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:30.269 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:30.269 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:30.278 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:30.349 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:30.348+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:30.385 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:30.385 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:30.393 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:30.449 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:30.449+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:30.501 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:30.501 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:30.511 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:30.550 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:30.550+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:30.557 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-05-07T11:14:30.651 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:30.651+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:30.661 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:30.661 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:30.670 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:30.753 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:30.752+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:30.818 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:30.818 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:30.827 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:30.870 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:30.870+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:30.943 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:30.943 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:30.954 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:30.954 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:30.953+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:31.054 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:31.054+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:31.109 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:31.109 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:31.119 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:31.156 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:31.155+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:31.256 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:31.255+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:31.274 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:31.274 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:31.284 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:31.357 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:31.356+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:31.396 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:31.397 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:31.406 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:31.490 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:31.490+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:31.554 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:31.554 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:31.558 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:31.558+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:31.563 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:31.659 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:31.659+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:31.711 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:31.711 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:31.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:31.763 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:31.763+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:31.835 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:31.835 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:31.845 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:31.860 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:31.859+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:31.961 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:31.961+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:31.996 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:31.996 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:32.006 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:32.061 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:32.061+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:32.147 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:32.147 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:32.161 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:32.202 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:32.202+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:32.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:32.264 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:32.263+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:32.271 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:32.271 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:32.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:32.364 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:32.364+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:32.368 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:32.368 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:32.368 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:32.389 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:32.389 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:32.392 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:32.392 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:32.395 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:32.396 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:32.401 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:32.465 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:32.465+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:32.510 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:32.510 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:32.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:32.510 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:32.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.510 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.510 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.0026149449999995, 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.0025268629999999, 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.993763736, 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.989400689, 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.531 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.532 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.532 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:32.532 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9867678519999998, 2024-05-07T11:14:32.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:32.533 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.533 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.533 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.533 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.533 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.533 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.533 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:32.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:32.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9824969499999998, 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9729987419999997, 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9703584730000001, 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9601790159999997, 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.560 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9464035449999999, 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:32.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.940378484, 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.566 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:32.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:32.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:32.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9395364950000005, 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9369721960000001, 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.582 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9361258469999996, 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:32.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:32.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:32.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:32.587 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9318303710000002, 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.588 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:32.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9290425720000002, 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:32.593 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9282251319999997, 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9264187420000001, 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.604 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:32.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:32.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9194242959999999, 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:32.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 7.9063547950000004, 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:32.620 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:32.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T11:14:32.622 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:32.621+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:32.622 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:32.722 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:32.722+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:32.735 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:32.735 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:32.735 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:32.735 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:32.745 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:32.749 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:14:32.824 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:32.823+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:32.860 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-05-07T11:14:32.902 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:32.902 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:32.902 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:32.902 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:32.903 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:32.912 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:32.956 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:32.956+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:32.961 INFO:teuthology.orchestra.console.smithi149:Power off completed 2024-05-07T11:14:33.025 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:33.025+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5253258780000003, 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.029 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:33.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5212021359999994, 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.040 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5211533409999998, 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:33.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:33.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.046 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5211200500000004, 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:33.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:33.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:33.052 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.052 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.052 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5206632819999992, 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.053 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:33.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:33.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.058 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5206282639999991, 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.059 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.064 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5206048770000002, 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5198096799999998, 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:33.070 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.075 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5188671419999995, 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:33.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:33.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:33.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:33.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5169727399999999, 2024-05-07T11:14:33.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:33.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:33.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5158993059999997, 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:33.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:33.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:33.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5140995030000006, 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:33.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:33.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5131634730000005, 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:33.098 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.103 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5104375210000001, 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:33.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.109 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5095916500000008, 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5087842649999992, 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.115 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:33.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:33.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:33.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5059915870000005, 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:33.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:33.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5035405090000005, 2024-05-07T11:14:33.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.5026421540000001, 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:33.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.4983422920000002, 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:33.143 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:33.144 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:33.144+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:33.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:33.185 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2024-05-07T11:14:33.185 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:33.185 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-07T11:14:33.186 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-07T11:14:33.187 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2024-05-07T11:14:33.189 INFO:tasks.workunit.client.0.smithi062.stderr:+ make -j4 2024-05-07T11:14:33.204 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize -cfi 2024-05-07T11:14:33.245 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:33.245+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:33.256 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:33.257 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:33.257 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:33.257 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:33.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:33.346 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:33.346+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:33.410 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:33.410 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:33.410 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:33.411 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:33.411 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:33.419 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:33.447 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:33.448+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:33.526 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.018909786, 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.527 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.0188217040000005, 2024-05-07T11:14:33.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:33.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:33.537 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.0100585770000006, 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.538 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.0056955300000006, 2024-05-07T11:14:33.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:33.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:33.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.548 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.0030626930000004, 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:33.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:33.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:33.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9987917910000004, 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:33.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:33.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:33.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:33.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9892935830000003, 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:33.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9866533139999998, 2024-05-07T11:14:33.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:33.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:33.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:33.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:33.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9764738570000002, 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.572 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:33.577 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9626983859999996, 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:33.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:33.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:33.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9566733250000006, 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.583 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.588 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9558313359999993, 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:33.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:33.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:33.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:33.594 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9532670369999998, 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:33.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:33.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9524206880000001, 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.600 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:33.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:33.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9481252120000008, 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9453374130000007, 2024-05-07T11:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:33.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9445199730000002, 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9427135829999997, 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:33.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:33.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:33.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:33.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9357191369999995, 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.631 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:33.636 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 8.9226496359999992, 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:33.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:33.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:33.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:33.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:33.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:33.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:33.642 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.642 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.642 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.642 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:33.642 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:33.642 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:33.644 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-05-07T11:14:33.645 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:33.645 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: putting auxiliary files in '.'. 2024-05-07T11:14:33.646 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: copying file './config.guess' 2024-05-07T11:14:33.646 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: copying file './config.sub' 2024-05-07T11:14:33.646 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: copying file './install-sh' 2024-05-07T11:14:33.646 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: copying file './ltmain.sh' 2024-05-07T11:14:33.646 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:33.643+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:33.668 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-05-07T11:14:33.668 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-05-07T11:14:33.679 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-05-07T11:14:33.687 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-05-07T11:14:33.694 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-05-07T11:14:33.701 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-05-07T11:14:33.709 INFO:tasks.workunit.client.0.smithi062.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-05-07T11:14:33.710 INFO:tasks.workunit.client.0.smithi062.stdout:cp include/install-sh . 2024-05-07T11:14:33.718 INFO:tasks.workunit.client.0.smithi062.stdout:aclocal -I m4 2024-05-07T11:14:33.744 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:33.744+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:33.753 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:33.753 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:33.753 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:33.753 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:33.762 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:33.844 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:33.844+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:33.867 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:33.867 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:33.867 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:33.867 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:33.867 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:33.876 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:33.945 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:33.945+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5205035999999996, 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.024 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:34.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:34.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:34.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:34.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5163798580000005, 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.030 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:34.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:34.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.036 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.036 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:34.037 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5163310629999991, 2024-05-07T11:14:34.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:34.037 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.037 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.037 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.037 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.037 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.037 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5162977719999997, 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:34.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:34.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:34.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5158410040000003, 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.048 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5158059860000002, 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.054 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.059 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5157825989999996, 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:34.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:34.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:34.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:34.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:34.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5149874019999992, 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.065 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5140448640000006, 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5121504619999993, 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5110770280000008, 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5092772249999999, 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:34.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:34.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5083411949999999, 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:34.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.098 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5056152429999994, 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5047693720000002, 2024-05-07T11:14:34.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:34.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:34.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:34.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5039619870000003, 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.110 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:34.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.115 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5011693089999998, 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:34.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:34.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:34.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.4987182309999998, 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.121 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:34.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:34.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:34.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.4978198759999994, 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.4935200139999996, 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:34.132 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:34.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:34.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:34.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:34.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:34.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.138 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:34.138 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:34.138 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:34.139 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:34.140 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:34.139+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:34.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-05-07T11:14:34.242 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:34.242+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:34.245 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:34.245 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:34.246 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:34.246 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:34.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:34.343 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:34.343+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:34.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:34.398 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:34.398 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:34.407 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:34.444 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:34.444+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:34.514 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:34.514 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:34.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:34.514 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:34.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.514 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.514 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:34.514 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 10.006353722, 2024-05-07T11:14:34.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:34.514 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:34.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:34.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:34.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:34.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 10.006265640000001, 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.520 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:34.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:34.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9975025130000006, 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.525 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.530 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9931394660000006, 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9905066290000004, 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.536 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:34.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9862357270000004, 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9767375190000003, 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.547 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:34.552 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9740972499999998, 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:34.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:34.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9639177930000002, 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.558 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.563 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9501423219999996, 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.564 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:34.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:34.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:34.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9441172610000006, 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.570 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:34.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:34.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:34.575 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9432752719999993, 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:34.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9407109729999998, 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.581 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:34.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:34.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:34.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9398646240000001, 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:34.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:34.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:34.592 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9355691480000008, 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:34.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9327813490000008, 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.603 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9319639090000003, 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.604 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:34.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9301575189999998, 2024-05-07T11:14:34.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:34.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:34.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9231630729999996, 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.615 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:34.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:34.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 9.9100935719999992, 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.621 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:34.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:34.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:34.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:34.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:34.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:34.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:34.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:34.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:34.626 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.626 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.626 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.626 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:34.626 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:34.626 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:34.627 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:34.628 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:34.628 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:34.628 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:34.629 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:34.630 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:34.630 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:34.631 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:34.628+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:34.728 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:34.728+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:34.737 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:34.737 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:34.746 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:34.830 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:34.830+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:34.892 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:34.892 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:34.901 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:34.904 INFO:tasks.workunit.client.0.smithi062.stdout:autoheader 2024-05-07T11:14:34.930 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:34.930+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:35.030 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:35.030+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:35.046 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:35.046 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:35.056 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:35.132 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:35.131+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:35.186 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:35.186 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:35.195 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:35.233 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:35.233+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:35.250 INFO:tasks.workunit.client.0.smithi062.stdout:autoconf 2024-05-07T11:14:35.334 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:35.334+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:35.340 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:35.340 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:35.349 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:35.435 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:35.435+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:35.466 INFO:tasks.workunit.client.0.smithi062.stdout:./configure \ 2024-05-07T11:14:35.466 INFO:tasks.workunit.client.0.smithi062.stdout: --libexecdir=/usr/lib \ 2024-05-07T11:14:35.467 INFO:tasks.workunit.client.0.smithi062.stdout: --exec_prefix=/var/lib 2024-05-07T11:14:35.494 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:35.494 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:35.504 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:35.536 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:35.537+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:35.610 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:35.611 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:35.615 INFO:tasks.workunit.client.0.smithi062.stdout:checking build system type... x86_64-pc-linux-gnu 2024-05-07T11:14:35.615 INFO:tasks.workunit.client.0.smithi062.stdout:checking host system type... x86_64-pc-linux-gnu 2024-05-07T11:14:35.617 INFO:tasks.workunit.client.0.smithi062.stdout:checking how to print strings... printf 2024-05-07T11:14:35.618 INFO:tasks.workunit.client.0.smithi062.stdout:checking for gcc... gcc 2024-05-07T11:14:35.619 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:35.637 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:35.637+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:35.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:14:35.704 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether the C compiler works... yes 2024-05-07T11:14:35.705 INFO:tasks.workunit.client.0.smithi062.stdout:checking for C compiler default output file name... a.out 2024-05-07T11:14:35.724 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:35.724 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:35.732 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:35.739 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:35.739+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:35.752 INFO:tasks.workunit.client.0.smithi062.stdout:checking for suffix of executables... 2024-05-07T11:14:35.803 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether we are cross compiling... no 2024-05-07T11:14:35.833 INFO:tasks.workunit.client.0.smithi062.stdout:checking for suffix of object files... o 2024-05-07T11:14:35.838 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:35.838 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:35.839 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:35.839+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:35.847 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:35.860 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether we are using the GNU C compiler... yes 2024-05-07T11:14:35.886 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether gcc accepts -g... yes 2024-05-07T11:14:35.940 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:35.940+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:35.952 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:35.952 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:35.961 INFO:tasks.workunit.client.0.smithi062.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-07T11:14:35.961 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:35.965 INFO:tasks.workunit.client.0.smithi062.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-05-07T11:14:35.968 INFO:tasks.workunit.client.0.smithi062.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-07T11:14:35.969 INFO:tasks.workunit.client.0.smithi062.stdout:checking for egrep... /usr/bin/grep -E 2024-05-07T11:14:35.970 INFO:tasks.workunit.client.0.smithi062.stdout:checking for fgrep... /usr/bin/grep -F 2024-05-07T11:14:35.974 INFO:tasks.workunit.client.0.smithi062.stdout:checking for ld used by gcc... /usr/bin/ld 2024-05-07T11:14:35.977 INFO:tasks.workunit.client.0.smithi062.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-05-07T11:14:35.982 INFO:tasks.workunit.client.0.smithi062.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-05-07T11:14:36.041 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:36.042+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:36.074 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:36.142 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:36.142+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:36.179 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:36.179 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:36.188 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:36.244 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:36.244+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:36.292 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:36.292 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:36.301 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:36.345 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:36.345+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:36.405 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:36.405 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:36.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:36.445 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:36.446+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:36.547 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:36.547+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:36.558 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:36.558 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:36.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:36.576 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:14:36.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:36.647 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:36.648+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:36.674 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:36.674 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:36.683 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:36.748 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:36.748+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:36.772 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:36.772 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:36.788 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:36.788 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:36.788 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:36.789 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:36.789 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:36.790 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:36.793 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:36.794 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:36.797 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:36.827 INFO:tasks.workunit.client.0.smithi062.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-05-07T11:14:36.827 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether ln -s works... yes 2024-05-07T11:14:36.833 INFO:tasks.workunit.client.0.smithi062.stdout:checking the maximum length of command line arguments... 1572864 2024-05-07T11:14:36.836 INFO:tasks.workunit.client.0.smithi062.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-05-07T11:14:36.837 INFO:tasks.workunit.client.0.smithi062.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-05-07T11:14:36.837 INFO:tasks.workunit.client.0.smithi062.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-05-07T11:14:36.837 INFO:tasks.workunit.client.0.smithi062.stdout:checking for objdump... objdump 2024-05-07T11:14:36.838 INFO:tasks.workunit.client.0.smithi062.stdout:checking how to recognize dependent libraries... pass_all 2024-05-07T11:14:36.839 INFO:tasks.workunit.client.0.smithi062.stdout:checking for dlltool... no 2024-05-07T11:14:36.839 INFO:tasks.workunit.client.0.smithi062.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-05-07T11:14:36.840 INFO:tasks.workunit.client.0.smithi062.stdout:checking for ar... ar 2024-05-07T11:14:36.849 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:36.849+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:36.904 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:36.904 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:36.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:36.904 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:36.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.904 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.904 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:36.904 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.396599391000001, 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:36.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:36.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.396511308999999, 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:36.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:36.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.387748181999999, 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.383385134999999, 2024-05-07T11:14:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.380752298000001, 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.376481396000001, 2024-05-07T11:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:36.940 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.366983188000001, 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:36.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:36.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:36.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:36.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:36.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.364342919, 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:36.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:36.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:36.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.354163462000001, 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.952 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.340387991, 2024-05-07T11:14:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:36.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:36.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:36.969 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.969 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.334362929999999, 2024-05-07T11:14:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:36.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.972 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:36.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:36.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:36.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:36.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:36.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:36.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:36.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:36.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:36.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:36.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:36.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:36.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:36.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:36.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:36.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:36.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:36.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:36.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:36.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:36.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:36.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:36.982 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.982 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.982 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.983 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.983 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:36.983 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.333520941, 2024-05-07T11:14:36.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:36.983 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.983 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.984 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.984 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.984 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.984 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.984 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:36.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.985 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:36.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:36.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:36.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:36.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:36.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:36.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:36.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:36.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:36.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:36.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:36.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:36.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:36.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:36.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:36.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.330956642, 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:36.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:36.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:36.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:36.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.330110293000001, 2024-05-07T11:14:36.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:36.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:36.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.002 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.325814816999999, 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:37.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:37.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:37.008 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.323027017999999, 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:37.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:37.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.322209578000001, 2024-05-07T11:14:37.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:37.015 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.015 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.015 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.015 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.015 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.015 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.015 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:37.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.015 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:37.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:37.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:37.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:37.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.320403188, 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:37.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:37.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:37.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:37.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:37.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.313408742, 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.027 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:37.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:37.032 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 12.300339241, 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:37.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:37.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:37.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:37.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.038 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.038 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:37.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:37.038 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.038 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.038 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.038 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.038 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.038 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:37.040 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:37.041 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:37.040+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:37.041 INFO:tasks.workunit.client.0.smithi062.stdout:checking for archiver @FILE support... @ 2024-05-07T11:14:37.041 INFO:tasks.workunit.client.0.smithi062.stdout:checking for strip... strip 2024-05-07T11:14:37.041 INFO:tasks.workunit.client.0.smithi062.stdout:checking for ranlib... ranlib 2024-05-07T11:14:37.041 INFO:tasks.workunit.client.0.smithi062.stdout:checking for gawk... gawk 2024-05-07T11:14:37.041 INFO:tasks.workunit.client.0.smithi062.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-05-07T11:14:37.042 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sysroot... no 2024-05-07T11:14:37.051 INFO:tasks.workunit.client.0.smithi062.stdout:checking for a working dd... /usr/bin/dd 2024-05-07T11:14:37.059 INFO:tasks.workunit.client.0.smithi062.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-05-07T11:14:37.082 INFO:tasks.workunit.client.0.smithi062.stdout:checking for mt... no 2024-05-07T11:14:37.089 INFO:tasks.workunit.client.0.smithi062.stdout:checking if : is a manifest tool... no 2024-05-07T11:14:37.141 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:37.140+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:37.148 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:37.148 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:37.157 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:37.159 INFO:tasks.workunit.client.0.smithi062.stdout:checking how to run the C preprocessor... gcc -E 2024-05-07T11:14:37.241 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:37.242+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:37.302 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:37.302 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:37.302 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:37.302 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:37.302 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:37.311 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:37.345 INFO:tasks.workunit.client.0.smithi062.stdout:checking for ANSI C header files... yes 2024-05-07T11:14:37.354 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:37.354+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:37.378 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/types.h... yes 2024-05-07T11:14:37.418 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/stat.h... yes 2024-05-07T11:14:37.420 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.917474329000001, 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.421 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:37.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:37.426 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.913350587, 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:37.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:37.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.431 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.913301792, 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:37.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:37.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.913268500999999, 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:37.437 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:37.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:37.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.912811733, 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.443 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:37.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:37.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:37.448 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.912776715, 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.453 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.912753328000001, 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.454 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:37.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:37.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:37.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:37.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.911958131, 2024-05-07T11:14:37.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:37.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:37.466 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.911015593, 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:37.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:37.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:37.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:37.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:37.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:37.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:37.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:37.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:37.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.909121191000001, 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.473 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:37.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:37.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:37.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:37.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:37.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:37.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:37.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:37.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:37.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:37.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:37.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:37.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:37.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:37.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:37.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:37.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:37.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:37.482 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.482 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.482 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.483 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.483 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:37.483 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.908047757, 2024-05-07T11:14:37.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:37.483 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.484 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.484 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.484 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.484 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.484 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.484 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:37.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.485 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:37.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:37.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:37.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:37.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:37.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:37.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.906247953999999, 2024-05-07T11:14:37.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:37.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.905311923999999, 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.498 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:37.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:37.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.503 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.902585972000001, 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:37.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:37.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:37.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:37.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:37.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:37.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:37.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:37.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:37.510 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.901740101, 2024-05-07T11:14:37.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:37.511 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.511 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.511 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.511 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.511 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.511 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.511 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:37.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:37.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.900932716, 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:37.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:37.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:37.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:37.522 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.522 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.522 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.522 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.522 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:37.523 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.898140037999999, 2024-05-07T11:14:37.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:37.523 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.523 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.523 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.523 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.523 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.523 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.523 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:37.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.895688959999999, 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:37.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:37.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.533 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.894790605000001, 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:37.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.890490743000001, 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.540 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:37.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:37.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:37.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:37.545 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:37.546 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:37.547 INFO:tasks.workunit.client.0.smithi062.stdout:checking for stdlib.h... yes 2024-05-07T11:14:37.548 INFO:tasks.workunit.client.0.smithi062.stdout:checking for string.h... yes 2024-05-07T11:14:37.548 INFO:tasks.workunit.client.0.smithi062.stdout:checking for memory.h... yes 2024-05-07T11:14:37.548 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:37.546+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:37.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:37.579 INFO:tasks.workunit.client.0.smithi062.stdout:checking for strings.h... yes 2024-05-07T11:14:37.621 INFO:tasks.workunit.client.0.smithi062.stdout:checking for inttypes.h... yes 2024-05-07T11:14:37.647 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:37.647+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:37.655 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:37.655 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:37.662 INFO:tasks.workunit.client.0.smithi062.stdout:checking for stdint.h... yes 2024-05-07T11:14:37.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:37.712 INFO:tasks.workunit.client.0.smithi062.stdout:checking for unistd.h... yes 2024-05-07T11:14:37.748 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:37.749+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:37.764 INFO:tasks.workunit.client.0.smithi062.stdout:checking for dlfcn.h... yes 2024-05-07T11:14:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:37.768 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:37.768 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:37.768 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:37.770 INFO:tasks.workunit.client.0.smithi062.stdout:checking for objdir... .libs 2024-05-07T11:14:37.777 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:37.848 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:37.848+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:37.877 INFO:tasks.workunit.client.0.smithi062.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-05-07T11:14:37.877 INFO:tasks.workunit.client.0.smithi062.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-05-07T11:14:37.882 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:37.882 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:37.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.375044815000001, 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.883 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:37.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.374956732999999, 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:37.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:37.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:37.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:37.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:37.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:37.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:37.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.366193606, 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.896 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:37.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:37.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.361830558999999, 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.901 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:37.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:37.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.359197721999999, 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.907 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.354926819999999, 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:37.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:37.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:37.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.918 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.921 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.921 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:37.921 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.345428611999999, 2024-05-07T11:14:37.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:37.921 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:37.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.342788343, 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.927 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:37.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:37.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:37.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.332608885999999, 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.933 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.318833415, 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.312808354, 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.944 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.311966365, 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.950 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:37.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:37.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:37.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:37.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.309402066000001, 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:37.955 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.308555717000001, 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:37.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:37.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:37.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.304260241, 2024-05-07T11:14:37.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:37.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:37.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.972 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.301472442, 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:37.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.300655001999999, 2024-05-07T11:14:37.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.298848612, 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.291854166, 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 13.278784665, 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.001 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.001 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.001 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:38.003 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:38.004 INFO:tasks.workunit.client.0.smithi062.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-05-07T11:14:38.004 INFO:tasks.workunit.client.0.smithi062.stdout:checking if gcc static flag -static works... no 2024-05-07T11:14:38.004 INFO:tasks.workunit.client.0.smithi062.stdout:checking if gcc supports -c -o file.o... yes 2024-05-07T11:14:38.004 INFO:tasks.workunit.client.0.smithi062.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-05-07T11:14:38.004 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-05-07T11:14:38.005 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:38.002+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:38.054 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether -lc should be explicitly linked in... no 2024-05-07T11:14:38.102 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:38.102+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3071 4.27 4:e60ee3a4:::10000001a5f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:38.110141+0000", 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.001860818, 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018832600000000001, 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:38.112 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110141+0000", 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110141+0000", 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110142+0000", 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.27e-07 2024-05-07T11:14:38.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110144+0000", 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9989999999999998e-06 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110150+0000", 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0129999999999999e-06 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110154+0000", 2024-05-07T11:14:38.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8779999999999997e-06 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110526+0000", 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00037164400000000002 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110646+0000", 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000119883 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3073 4.3f 4:ff91894e:::10000001a54.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:38.110162+0000", 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.001839951, 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019373210000000001, 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110162+0000", 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110162+0000", 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110162+0000", 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.84e-07 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110164+0000", 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1059999999999998e-06 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110170+0000", 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9939999999999997e-06 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110176+0000", 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0900000000000004e-06 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110809+0000", 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00063310700000000005 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110890+0000", 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1487000000000001e-05 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3078 4.32 4:4f29e173:::10000001a5a.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:38.110737+0000", 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0012645410000000001, 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014152850000000001, 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.119 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110737+0000", 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110737+0000", 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110738+0000", 2024-05-07T11:14:38.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0399999999999995e-07 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110742+0000", 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5410000000000001e-06 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110750+0000", 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110758+0000", 2024-05-07T11:14:38.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2389999999999996e-06 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110811+0000", 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3137999999999998e-05 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.110884+0000", 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3300000000000006e-05 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3079 4.20 4:05f7e212:::10000001a55.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:38.111171+0000", 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.00083116199999999998, 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010120750000000001, 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111171+0000", 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111171+0000", 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111171+0000", 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4799999999999998e-07 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111175+0000", 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.45e-06 2024-05-07T11:14:38.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111184+0000", 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4299999999999995e-06 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111192+0000", 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2880000000000004e-06 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111239+0000", 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7796000000000001e-05 2024-05-07T11:14:38.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111300+0000", 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0350000000000003e-05 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3081 4.1f 4:f9cc072c:::10000001a5c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:38.111208+0000", 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.00079376399999999997, 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010053760000000001, 2024-05-07T11:14:38.126 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.127 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.127 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:38.127 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111208+0000", 2024-05-07T11:14:38.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111208+0000", 2024-05-07T11:14:38.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111209+0000", 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5499999999999998e-07 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111211+0000", 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7300000000000001e-06 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111218+0000", 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1060000000000002e-06 2024-05-07T11:14:38.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111224+0000", 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.75e-06 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111267+0000", 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2985000000000003e-05 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111378+0000", 2024-05-07T11:14:38.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011103300000000001 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:3082 4.11 4:896294c2:::10000001a5d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:38.111234+0000", 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.00076746599999999996, 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001008257, 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111234+0000", 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111234+0000", 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111235+0000", 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6600000000000002e-07 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111237+0000", 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9819999999999998e-06 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111243+0000", 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6549999999999998e-06 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111249+0000", 2024-05-07T11:14:38.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6049999999999997e-06 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111298+0000", 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9270000000000001e-05 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:38.111366+0000", 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7867000000000006e-05 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-05-07T11:14:38.135 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 6 2024-05-07T11:14:38.136 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:38.138 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:38.139 INFO:tasks.workunit.client.0.smithi062.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-05-07T11:14:38.139 INFO:tasks.workunit.client.0.smithi062.stdout:checking how to hardcode library paths into programs... immediate 2024-05-07T11:14:38.139 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether stripping libraries is possible... yes 2024-05-07T11:14:38.139 INFO:tasks.workunit.client.0.smithi062.stdout:checking if libtool supports shared libraries... yes 2024-05-07T11:14:38.139 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether to build shared libraries... yes 2024-05-07T11:14:38.139 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether to build static libraries... yes 2024-05-07T11:14:38.141 INFO:tasks.workunit.client.0.smithi062.stdout:checking for gcc... (cached) gcc 2024-05-07T11:14:38.143 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-05-07T11:14:38.144 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:14:38.144 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-05-07T11:14:38.144 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-05-07T11:14:38.174 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-07T11:14:38.174 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-07T11:14:38.174 INFO:tasks.workunit.client.0.smithi062.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-07T11:14:38.175 INFO:tasks.workunit.client.0.smithi062.stdout:checking for gmake... /usr/bin/gmake 2024-05-07T11:14:38.175 INFO:tasks.workunit.client.0.smithi062.stderr:./configure: line 11968: test: $(SHELL): binary operator expected 2024-05-07T11:14:38.176 INFO:tasks.workunit.client.0.smithi062.stdout:checking for tar... /bin/tar 2024-05-07T11:14:38.176 INFO:tasks.workunit.client.0.smithi062.stdout:checking for gzip... /bin/gzip 2024-05-07T11:14:38.203 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether gcc -MM is supported... yes 2024-05-07T11:14:38.204 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:38.204+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:38.205 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sort... /bin/sort 2024-05-07T11:14:38.205 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether ln -s works... yes 2024-05-07T11:14:38.205 INFO:tasks.workunit.client.0.smithi062.stdout:checking for rpm... /bin/rpm 2024-05-07T11:14:38.209 INFO:tasks.workunit.client.0.smithi062.stdout:checking for rpmbuild... no 2024-05-07T11:14:38.210 INFO:tasks.workunit.client.0.smithi062.stdout:checking for ANSI C header files... (cached) yes 2024-05-07T11:14:38.258 INFO:tasks.workunit.client.0.smithi062.stdout:checking assert.h usability... yes 2024-05-07T11:14:38.273 INFO:tasks.workunit.client.0.smithi062.stdout:checking assert.h presence... yes 2024-05-07T11:14:38.273 INFO:tasks.workunit.client.0.smithi062.stdout:checking for assert.h... yes 2024-05-07T11:14:38.282 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:38.282 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:38.282 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:38.282 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:38.282 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:38.291 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:38.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-05-07T11:14:38.326 INFO:tasks.workunit.client.0.smithi062.stdout:checking bstring.h usability... no 2024-05-07T11:14:38.335 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:38.335+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:38.349 INFO:tasks.workunit.client.0.smithi062.stdout:checking bstring.h presence... no 2024-05-07T11:14:38.350 INFO:tasks.workunit.client.0.smithi062.stdout:checking for bstring.h... no 2024-05-07T11:14:38.390 INFO:tasks.workunit.client.0.smithi062.stdout:checking libgen.h usability... yes 2024-05-07T11:14:38.399 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.895939793, 2024-05-07T11:14:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.891816050999999, 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.891767256, 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:38.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.891733965, 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.416 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:38.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.891277197000001, 2024-05-07T11:14:38.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:38.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:38.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:38.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.891242179000001, 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.891218792, 2024-05-07T11:14:38.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.890423595, 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.438 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.889481056999999, 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:38.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.887586655, 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:38.454 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.886513221, 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.455 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.884713418, 2024-05-07T11:14:38.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:38.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:38.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:38.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:38.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.883777388, 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.466 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:38.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:38.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:38.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.881051436, 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:38.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:38.476 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.880205565000001, 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.477 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.482 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.879398180000001, 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.483 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:38.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.876605502, 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:38.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:38.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:38.494 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.874154424, 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:38.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:38.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.873256069, 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:38.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.868956207, 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:38.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:38.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:38.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:38.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:38.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:38.511 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.511 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.511 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.511 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:38.511 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:38.511 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:38.513 INFO:tasks.workunit.client.0.smithi062.stdout:checking libgen.h presence... yes 2024-05-07T11:14:38.513 INFO:tasks.workunit.client.0.smithi062.stdout:checking for libgen.h... yes 2024-05-07T11:14:38.513 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:38.512+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:38.514 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:38.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:38.515 INFO:tasks.thrashosds.thrasher:Failed to reset_purged_snaps_last, ignoring 2024-05-07T11:14:38.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-05-07T11:14:38.516 INFO:tasks.workunit.client.0.smithi062.stdout:checking dirent.h usability... yes 2024-05-07T11:14:38.516 INFO:tasks.workunit.client.0.smithi062.stdout:checking dirent.h presence... yes 2024-05-07T11:14:38.516 INFO:tasks.workunit.client.0.smithi062.stdout:checking for dirent.h... yes 2024-05-07T11:14:38.516 INFO:tasks.workunit.client.0.smithi062.stdout:checking errno.h usability... yes 2024-05-07T11:14:38.530 INFO:tasks.workunit.client.0.smithi062.stdout:checking errno.h presence... yes 2024-05-07T11:14:38.530 INFO:tasks.workunit.client.0.smithi062.stdout:checking for errno.h... yes 2024-05-07T11:14:38.577 INFO:tasks.workunit.client.0.smithi062.stdout:checking malloc.h usability... yes 2024-05-07T11:14:38.594 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T11:14:38.595 INFO:tasks.workunit.client.0.smithi062.stdout:checking malloc.h presence... yes 2024-05-07T11:14:38.595 INFO:tasks.workunit.client.0.smithi062.stdout:checking for malloc.h... yes 2024-05-07T11:14:38.613 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:38.612+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:38.622 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:38.622 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:38.622 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:38.623 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:38.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:38.650 INFO:tasks.workunit.client.0.smithi062.stdout:checking uuid.h usability... no 2024-05-07T11:14:38.675 INFO:tasks.workunit.client.0.smithi062.stdout:checking uuid.h presence... no 2024-05-07T11:14:38.675 INFO:tasks.workunit.client.0.smithi062.stdout:checking for uuid.h... no 2024-05-07T11:14:38.714 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:38.714+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:38.729 INFO:tasks.workunit.client.0.smithi062.stdout:checking uuid/uuid.h usability... yes 2024-05-07T11:14:38.745 INFO:tasks.workunit.client.0.smithi062.stdout:checking uuid/uuid.h presence... yes 2024-05-07T11:14:38.745 INFO:tasks.workunit.client.0.smithi062.stdout:checking for uuid/uuid.h... yes 2024-05-07T11:14:38.776 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:38.776 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:38.776 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:38.776 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:38.776 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:38.785 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:38.793 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/uuid.h usability... no 2024-05-07T11:14:38.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:38.814 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:38.814+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:38.832 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/uuid.h presence... no 2024-05-07T11:14:38.832 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/uuid.h... no 2024-05-07T11:14:38.887 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/file.h usability... yes 2024-05-07T11:14:38.894 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:38.894 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:38.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:38.894 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.386870460000001, 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:38.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:38.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:38.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.386782377999999, 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.901 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:38.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:38.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:38.906 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.378019251, 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:38.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:38.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:38.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.373656204, 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.912 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:38.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.917 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.371023366999999, 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.918 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:38.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.923 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.366752464999999, 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.357254256999999, 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.929 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:38.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:38.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.934 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.354613988000001, 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:38.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.344434530999999, 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:38.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:38.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:38.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:38.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:38.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:38.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.33065906, 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.947 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:38.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:38.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.324633999, 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:38.953 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:38.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:38.959 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.32379201, 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:38.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.321227711000001, 2024-05-07T11:14:38.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:38.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.320381361999999, 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.971 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:38.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:38.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:38.976 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.316085886, 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.977 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:38.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:38.982 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.313298087, 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.983 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:38.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:38.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.989 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.989 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:38.989 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.312480646999999, 2024-05-07T11:14:38.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:38.989 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.989 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.989 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.989 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.989 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:38.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:38.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.310674257000001, 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.995 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:38.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:38.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.303679811, 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 14.29061031, 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:39.012 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:39.014 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/file.h presence... yes 2024-05-07T11:14:39.014 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/file.h... yes 2024-05-07T11:14:39.014 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:39.015 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:39.015 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:39.013+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:39.016 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:39.016 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:39.017 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:39.018 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/fcntl.h usability... yes 2024-05-07T11:14:39.018 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/fcntl.h presence... yes 2024-05-07T11:14:39.018 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/fcntl.h... yes 2024-05-07T11:14:39.022 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/syssgi.h usability... no 2024-05-07T11:14:39.044 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/syssgi.h presence... no 2024-05-07T11:14:39.045 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/syssgi.h... no 2024-05-07T11:14:39.114 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:39.113+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:39.117 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/param.h usability... yes 2024-05-07T11:14:39.127 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:39.128 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:39.135 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/param.h presence... yes 2024-05-07T11:14:39.135 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/param.h... yes 2024-05-07T11:14:39.137 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:39.146 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/stat.h... (cached) yes 2024-05-07T11:14:39.189 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/statvfs.h usability... yes 2024-05-07T11:14:39.204 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/statvfs.h presence... yes 2024-05-07T11:14:39.204 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/statvfs.h... yes 2024-05-07T11:14:39.221 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:39.221+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:39.248 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/time.h usability... yes 2024-05-07T11:14:39.262 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/time.h presence... yes 2024-05-07T11:14:39.262 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/time.h... yes 2024-05-07T11:14:39.286 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:39.286 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:39.295 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:39.306 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/ioctl.h usability... yes 2024-05-07T11:14:39.315 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:39.314+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:39.320 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/ioctl.h presence... yes 2024-05-07T11:14:39.320 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/ioctl.h... yes 2024-05-07T11:14:39.373 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/wait.h usability... yes 2024-05-07T11:14:39.389 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/wait.h presence... yes 2024-05-07T11:14:39.389 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/wait.h... yes 2024-05-07T11:14:39.400 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/types.h... (cached) yes 2024-05-07T11:14:39.410 INFO:tasks.workunit.client.0.smithi062.stdout:checking for strings.h... (cached) yes 2024-05-07T11:14:39.415 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:39.415+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:39.442 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:39.442 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:39.451 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:39.453 INFO:tasks.workunit.client.0.smithi062.stdout:checking err.h usability... yes 2024-05-07T11:14:39.467 INFO:tasks.workunit.client.0.smithi062.stdout:checking err.h presence... yes 2024-05-07T11:14:39.467 INFO:tasks.workunit.client.0.smithi062.stdout:checking for err.h... yes 2024-05-07T11:14:39.510 INFO:tasks.workunit.client.0.smithi062.stdout:checking linux/falloc.h usability... yes 2024-05-07T11:14:39.516 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:39.516+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:39.523 INFO:tasks.workunit.client.0.smithi062.stdout:checking linux/falloc.h presence... yes 2024-05-07T11:14:39.524 INFO:tasks.workunit.client.0.smithi062.stdout:checking for linux/falloc.h... yes 2024-05-07T11:14:39.558 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:39.559 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:39.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:39.571 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-05-07T11:14:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-05-07T11:14:39.597 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-05-07T11:14:39.597 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/fs/xfs_fsops.h... no 2024-05-07T11:14:39.638 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/fs/xfs_itable.h usability... no 2024-05-07T11:14:39.652 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:39.652+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:39.661 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/fs/xfs_itable.h presence... no 2024-05-07T11:14:39.661 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/fs/xfs_itable.h... no 2024-05-07T11:14:39.702 INFO:tasks.workunit.client.0.smithi062.stdout:checking xfs/platform_defs.h usability... no 2024-05-07T11:14:39.713 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:39.713 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:39.717 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:39.717+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:39.722 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:39.724 INFO:tasks.workunit.client.0.smithi062.stdout:checking xfs/platform_defs.h presence... no 2024-05-07T11:14:39.724 INFO:tasks.workunit.client.0.smithi062.stdout:checking for xfs/platform_defs.h... no 2024-05-07T11:14:39.766 INFO:tasks.workunit.client.0.smithi062.stdout:checking btrfs/ioctl.h usability... no 2024-05-07T11:14:39.789 INFO:tasks.workunit.client.0.smithi062.stdout:checking btrfs/ioctl.h presence... no 2024-05-07T11:14:39.789 INFO:tasks.workunit.client.0.smithi062.stdout:checking for btrfs/ioctl.h... no 2024-05-07T11:14:39.818 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:39.818+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:39.830 INFO:tasks.workunit.client.0.smithi062.stdout:checking cifs/ioctl.h usability... no 2024-05-07T11:14:39.852 INFO:tasks.workunit.client.0.smithi062.stdout:checking cifs/ioctl.h presence... no 2024-05-07T11:14:39.852 INFO:tasks.workunit.client.0.smithi062.stdout:checking for cifs/ioctl.h... no 2024-05-07T11:14:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:39.877 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:39.897 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/mman.h usability... yes 2024-05-07T11:14:39.911 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/mman.h presence... yes 2024-05-07T11:14:39.911 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/mman.h... yes 2024-05-07T11:14:39.919 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:39.918+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:39.942 INFO:tasks.workunit.client.0.smithi062.stdout:checking for xfs/xfs_log_format.h... no 2024-05-07T11:14:39.983 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:39.984 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:39.992 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:40.000 INFO:tasks.workunit.client.0.smithi062.stdout:checking for uuid_compare... no 2024-05-07T11:14:40.036 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:40.037+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:40.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-05-07T11:14:40.049 INFO:tasks.workunit.client.0.smithi062.stdout:checking for uuid_compare in -luuid... yes 2024-05-07T11:14:40.098 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:40.098 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:40.104 INFO:tasks.workunit.client.0.smithi062.stdout:checking for xfs/xfs.h... yes 2024-05-07T11:14:40.107 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:40.130 INFO:tasks.workunit.client.0.smithi062.stdout:checking for xfs/libxfs.h... no 2024-05-07T11:14:40.149 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:40.149+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:40.158 INFO:tasks.workunit.client.0.smithi062.stdout:checking whether xlog_assign_lsn is declared... no 2024-05-07T11:14:40.197 INFO:tasks.workunit.client.0.smithi062.stdout:checking for xfs/xqm.h... yes 2024-05-07T11:14:40.222 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:40.222+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:40.254 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:40.254 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:40.262 INFO:tasks.workunit.client.0.smithi062.stdout:checking xfsctl from xfs/xfs.h... ok 2024-05-07T11:14:40.263 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:40.297 INFO:tasks.workunit.client.0.smithi062.stdout:checking xfs/handle.h usability... yes 2024-05-07T11:14:40.310 INFO:tasks.workunit.client.0.smithi062.stdout:checking xfs/handle.h presence... yes 2024-05-07T11:14:40.310 INFO:tasks.workunit.client.0.smithi062.stdout:checking for xfs/handle.h... yes 2024-05-07T11:14:40.323 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:40.323+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:40.368 INFO:tasks.workunit.client.0.smithi062.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-05-07T11:14:40.369 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:40.370 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:40.379 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:40.422 INFO:tasks.workunit.client.0.smithi062.stdout:checking attr/attributes.h usability... yes 2024-05-07T11:14:40.437 INFO:tasks.workunit.client.0.smithi062.stdout:checking attr/attributes.h presence... yes 2024-05-07T11:14:40.437 INFO:tasks.workunit.client.0.smithi062.stdout:checking for attr/attributes.h... yes 2024-05-07T11:14:40.462 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:40.462+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:40.483 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/attributes.h usability... no 2024-05-07T11:14:40.506 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/attributes.h presence... no 2024-05-07T11:14:40.506 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/attributes.h... no 2024-05-07T11:14:40.524 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:40.524 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:40.525 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:40.524+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:40.533 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:40.557 INFO:tasks.workunit.client.0.smithi062.stdout:checking for attr_list in -lattr... yes 2024-05-07T11:14:40.608 INFO:tasks.workunit.client.0.smithi062.stdout:checking for attr_set in -lattr... yes 2024-05-07T11:14:40.625 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:40.625+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:40.647 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/acl.h usability... yes 2024-05-07T11:14:40.662 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/acl.h presence... yes 2024-05-07T11:14:40.662 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/acl.h... yes 2024-05-07T11:14:40.679 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:40.679 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:40.688 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:40.696 INFO:tasks.workunit.client.0.smithi062.stdout:checking acl/libacl.h usability... yes 2024-05-07T11:14:40.712 INFO:tasks.workunit.client.0.smithi062.stdout:checking acl/libacl.h presence... yes 2024-05-07T11:14:40.712 INFO:tasks.workunit.client.0.smithi062.stdout:checking for acl/libacl.h... yes 2024-05-07T11:14:40.728 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:40.728+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:40.763 INFO:tasks.workunit.client.0.smithi062.stdout:checking for acl_init in -lacl... yes 2024-05-07T11:14:40.795 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:40.795 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:40.799 INFO:tasks.workunit.client.0.smithi062.stdout:checking gdbm-ndbm.h usability... no 2024-05-07T11:14:40.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:40.821 INFO:tasks.workunit.client.0.smithi062.stdout:checking gdbm-ndbm.h presence... no 2024-05-07T11:14:40.821 INFO:tasks.workunit.client.0.smithi062.stdout:checking for gdbm-ndbm.h... no 2024-05-07T11:14:40.827 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:40.827+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:40.857 INFO:tasks.workunit.client.0.smithi062.stdout:checking gdbm/ndbm.h usability... no 2024-05-07T11:14:40.878 INFO:tasks.workunit.client.0.smithi062.stdout:checking gdbm/ndbm.h presence... no 2024-05-07T11:14:40.879 INFO:tasks.workunit.client.0.smithi062.stdout:checking for gdbm/ndbm.h... no 2024-05-07T11:14:40.910 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:40.910 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:40.913 INFO:tasks.workunit.client.0.smithi062.stdout:checking ndbm.h usability... no 2024-05-07T11:14:40.919 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:40.935 INFO:tasks.workunit.client.0.smithi062.stdout:checking ndbm.h presence... no 2024-05-07T11:14:40.935 INFO:tasks.workunit.client.0.smithi062.stdout:checking for ndbm.h... no 2024-05-07T11:14:40.962 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:40.962+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:40.968 INFO:tasks.workunit.client.0.smithi062.stdout:checking libaio.h usability... yes 2024-05-07T11:14:40.986 INFO:tasks.workunit.client.0.smithi062.stdout:checking libaio.h presence... yes 2024-05-07T11:14:40.986 INFO:tasks.workunit.client.0.smithi062.stdout:checking for libaio.h... yes 2024-05-07T11:14:41.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:41.025 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:41.025 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:41.028 INFO:tasks.workunit.client.0.smithi062.stdout:checking for dm_make_handle in -ldm... no 2024-05-07T11:14:41.028 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-05-07T11:14:41.028 INFO:tasks.workunit.client.0.smithi062.stdout:WARNING: could not find a valid DMAPI base library. 2024-05-07T11:14:41.028 INFO:tasks.workunit.client.0.smithi062.stdout:If you want DMAPI support please install the data migration 2024-05-07T11:14:41.028 INFO:tasks.workunit.client.0.smithi062.stdout:API (dmapi) library package. Alternatively, run "make install" 2024-05-07T11:14:41.028 INFO:tasks.workunit.client.0.smithi062.stdout:from the dmapi source. 2024-05-07T11:14:41.028 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-05-07T11:14:41.029 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:41.029+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:41.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:41.064 INFO:tasks.workunit.client.0.smithi062.stdout:checking linux/fiemap.h usability... yes 2024-05-07T11:14:41.079 INFO:tasks.workunit.client.0.smithi062.stdout:checking linux/fiemap.h presence... yes 2024-05-07T11:14:41.079 INFO:tasks.workunit.client.0.smithi062.stdout:checking for linux/fiemap.h... yes 2024-05-07T11:14:41.130 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:41.130+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:41.134 INFO:tasks.workunit.client.0.smithi062.stdout:checking for fallocate... yes 2024-05-07T11:14:41.145 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:41.145 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:41.155 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:41.155 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:41.175 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:41.175 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:41.178 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:41.178 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:41.198 INFO:tasks.workunit.client.0.smithi062.stdout:checking for open_by_handle_at... yes 2024-05-07T11:14:41.232 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:41.231+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:41.234 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/prctl.h usability... yes 2024-05-07T11:14:41.248 INFO:tasks.workunit.client.0.smithi062.stdout:checking sys/prctl.h presence... yes 2024-05-07T11:14:41.248 INFO:tasks.workunit.client.0.smithi062.stdout:checking for sys/prctl.h... yes 2024-05-07T11:14:41.283 INFO:tasks.workunit.client.0.smithi062.stdout:checking linux/fs.h usability... yes 2024-05-07T11:14:41.296 INFO:tasks.workunit.client.0.smithi062.stdout:checking linux/fs.h presence... yes 2024-05-07T11:14:41.296 INFO:tasks.workunit.client.0.smithi062.stdout:checking for linux/fs.h... yes 2024-05-07T11:14:41.302 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:41.302 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:41.302 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:41.302 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:41.302 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:41.311 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:41.332 INFO:tasks.workunit.client.0.smithi062.stdout:checking btrfsutil.h usability... no 2024-05-07T11:14:41.333 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:41.332+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:41.354 INFO:tasks.workunit.client.0.smithi062.stdout:checking btrfsutil.h presence... no 2024-05-07T11:14:41.354 INFO:tasks.workunit.client.0.smithi062.stdout:checking for btrfsutil.h... no 2024-05-07T11:14:41.407 INFO:tasks.workunit.client.0.smithi062.stdout:checking for copy_file_range... yes 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.911959308, 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.420 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:41.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:41.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:41.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.426 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.911871225999999, 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:41.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:41.432 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.903108099000001, 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:41.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:41.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:41.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:41.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:41.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.898745051999999, 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.438 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.896112214999999, 2024-05-07T11:14:41.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.448 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.891841313, 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:41.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:41.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:41.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.882343105, 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.454 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:41.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:41.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.879702836, 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.460 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:41.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.869523379, 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.855747908000001, 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:41.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.849722846999999, 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.848880858000001, 2024-05-07T11:14:41.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:41.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:41.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:41.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.846316559000002, 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.488 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:41.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.845470209999998, 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:41.493 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:41.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:41.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.841174733999999, 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.499 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.504 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.838386934999999, 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.505 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.510 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.837569495, 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:41.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.835763105000002, 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.516 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:41.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.828768659000001, 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.522 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:41.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 16.815699158000001, 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:41.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:41.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:41.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:41.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:41.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:41.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:41.533 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.533 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.533 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.533 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:41.533 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:41.533 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:41.534 INFO:tasks.workunit.client.0.smithi062.stdout:checking for renameat2... yes 2024-05-07T11:14:41.534 INFO:tasks.workunit.client.0.smithi062.stdout:configure: creating ./config.status 2024-05-07T11:14:41.535 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:41.536 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:41.534+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:41.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T11:14:41.635 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:41.636+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:41.639 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:41.639 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:41.640 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:41.640 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:41.648 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:41.736 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:41.736+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:41.795 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:41.795 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:41.795 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:41.795 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:41.795 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:41.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:41.836 INFO:tasks.workunit.client.0.smithi062.stdout:config.status: creating include/builddefs 2024-05-07T11:14:41.837 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:41.836+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:41.852 INFO:tasks.workunit.client.0.smithi062.stdout:config.status: creating include/config.h 2024-05-07T11:14:41.866 INFO:tasks.workunit.client.0.smithi062.stdout:config.status: executing libtool commands 2024-05-07T11:14:41.912 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.409222745000001, 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:41.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:41.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.405099003, 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.405050207999999, 2024-05-07T11:14:41.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:41.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:41.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:41.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.405016917000001, 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.930 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:41.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:41.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.935 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.404560149000002, 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:41.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.404525131, 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.941 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.946 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.404501744000001, 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.947 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:41.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:41.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:41.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.403706546999999, 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:41.952 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:41.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:41.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.402764008999998, 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.400869607000001, 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:41.963 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:41.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:41.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.399796172999999, 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.969 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:41.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:41.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:41.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.974 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.397996370000001, 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.975 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:41.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:41.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.397060339999999, 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:41.980 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:41.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:41.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:41.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:41.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:41.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:41.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.394334388000001, 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.987 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:41.992 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.393488517000002, 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:41.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:41.997 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.392681132, 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:41.998 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:41.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:42.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.389888454000001, 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:42.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.009 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.387437376000001, 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.010 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.386539021000001, 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.016 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:42.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.382239159000001, 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:42.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:42.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.027 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.028 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:42.029 INFO:tasks.workunit.client.0.smithi062.stdout:Building include 2024-05-07T11:14:42.029 INFO:tasks.workunit.client.0.smithi062.stdout:Building lib 2024-05-07T11:14:42.029 INFO:tasks.workunit.client.0.smithi062.stdout:Building tests 2024-05-07T11:14:42.029 INFO:tasks.workunit.client.0.smithi062.stdout: [LTDEP] 2024-05-07T11:14:42.030 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:42.029+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:42.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:42.130 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:42.131+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:42.139 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:42.139 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:42.148 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:42.231 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:42.231+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:42.254 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:42.254 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:42.255 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:42.255 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:42.255 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:42.263 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:42.292 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] dataascii.lo 2024-05-07T11:14:42.292 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] databin.lo 2024-05-07T11:14:42.293 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] datapid.lo 2024-05-07T11:14:42.293 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] file_lock.lo 2024-05-07T11:14:42.332 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:42.332+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:42.410 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:42.410 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:42.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:42.410 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:42.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.410 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.410 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:42.411 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.902551850000002, 2024-05-07T11:14:42.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:42.411 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.411 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.411 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.411 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.411 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.411 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.411 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:42.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.413 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:42.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:42.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:42.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.418 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.902463768, 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:42.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:42.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.424 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.893700640999999, 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.425 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:42.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.889337594000001, 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.431 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.886704757, 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.882433854999999, 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.872935646999998, 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.870295378000002, 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.860115920999998, 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.84634045, 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.840315389000001, 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:42.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:42.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.839473399999999, 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:42.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:42.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:42.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:42.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.484 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.836909101, 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.485 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:42.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.836062752, 2024-05-07T11:14:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:42.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.831767276000001, 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.497 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:42.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.828979477000001, 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.503 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.828162036999998, 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.826355647, 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.819361201, 2024-05-07T11:14:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 17.806291699999999, 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:42.525 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:42.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:42.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:42.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:42.531 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.531 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.531 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.531 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:42.531 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:42.531 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:42.532 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] forker.lo 2024-05-07T11:14:42.532 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] pattern.lo 2024-05-07T11:14:42.533 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:42.534 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:42.533+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:42.534 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] open_flags.lo 2024-05-07T11:14:42.549 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] random_range.lo 2024-05-07T11:14:42.609 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-05-07T11:14:42.633 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:42.632+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:42.650 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:42.650 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:42.650 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:42.650 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:42.653 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] string_to_tokens.lo 2024-05-07T11:14:42.659 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:42.682 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] str_to_bytes.lo 2024-05-07T11:14:42.734 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:42.734+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:42.764 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:42.764 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:42.764 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:42.764 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:42.764 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:42.766 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] tlibio.lo 2024-05-07T11:14:42.773 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:42.812 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] write_log.lo 2024-05-07T11:14:42.834 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:42.834+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:42.873 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] random.lo 2024-05-07T11:14:42.880 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.377313275999999, 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.881 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:42.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.373189534000002, 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.887 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:42.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.373140739, 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:42.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:42.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.373107447999999, 2024-05-07T11:14:42.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:42.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:42.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:42.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:42.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.37265068, 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:42.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:42.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:42.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.372615662000001, 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:42.915 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.372592274999999, 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:42.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.371797078, 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.921 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.37085454, 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.927 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:42.932 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.368960137999998, 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.933 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:42.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:42.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.367886704, 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:42.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:42.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.944 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.366086900999999, 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.365150871000001, 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.950 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.362424918999999, 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:42.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:42.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.361579047999999, 2024-05-07T11:14:42.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:42.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:42.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:42.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.360771663000001, 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.967 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:42.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.357978984999999, 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:42.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:42.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:42.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.355527906999999, 2024-05-07T11:14:42.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:42.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:42.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.354629551999999, 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.984 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:42.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:42.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.989 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.350329689999999, 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:42.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:42.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:42.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:42.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:42.995 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:42.997 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:42.997+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:42.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:43.097 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:43.097+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:43.102 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:43.102 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:43.103 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:43.103 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:43.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:43.130 INFO:tasks.workunit.client.0.smithi062.stdout: [LD] 2024-05-07T11:14:43.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:43.198 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:43.197+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:43.217 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:43.217 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:43.217 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:43.217 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:43.217 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:43.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:43.292 INFO:tasks.workunit.client.0.smithi062.stdout:Building ltp 2024-05-07T11:14:43.292 INFO:tasks.workunit.client.0.smithi062.stdout:Building src 2024-05-07T11:14:43.292 INFO:tasks.workunit.client.0.smithi062.stdout:Building m4 2024-05-07T11:14:43.292 INFO:tasks.workunit.client.0.smithi062.stdout:Building common 2024-05-07T11:14:43.310 INFO:tasks.workunit.client.0.smithi062.stdout: [DEP] 2024-05-07T11:14:43.310 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:43.310+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:43.323 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:43.324 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:43.324 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:43.327 INFO:tasks.workunit.client.0.smithi062.stdout: [DEP] 2024-05-07T11:14:43.347 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:43.347 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:43.351 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:43.351 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:43.372 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:43.372 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:43.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:43.421 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:43.421+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:43.484 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:43.485 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:43.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:43.499 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:43.499+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:43.597 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:43.598 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:43.600 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:43.601+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:43.606 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:43.672 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-05-07T11:14:43.672 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:14:43.673 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-05-07T11:14:43.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-05-07T11:14:43.701 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:43.702+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:43.752 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:43.752 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:43.760 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:43.804 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:43.804+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:43.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-05-07T11:14:43.849 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] doio 2024-05-07T11:14:43.849 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] fsstress 2024-05-07T11:14:43.849 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] fsx 2024-05-07T11:14:43.868 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:43.868 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:43.877 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:43.903 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:43.904+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:43.993 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:43.997 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:43.997 INFO:tasks.thrashosds.thrasher:Failed to reset_purged_snaps_last, ignoring 2024-05-07T11:14:43.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-05-07T11:14:44.004 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:44.004+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:44.022 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:44.022 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:44.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:44.105 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:44.105+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:44.153 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c: In function 'attr_list_path': 2024-05-07T11:14:44.153 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c:859:9: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2024-05-07T11:14:44.153 INFO:tasks.workunit.client.0.smithi062.stderr: 859 | rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2024-05-07T11:14:44.153 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~ 2024-05-07T11:14:44.153 INFO:tasks.workunit.client.0.smithi062.stderr:In file included from ../src/global.h:25, 2024-05-07T11:14:44.153 INFO:tasks.workunit.client.0.smithi062.stderr: from fsstress.c:12: 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr: 165 | extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~ 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c: In function 'attr_remove_path': 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c:878:9: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr: 878 | rval = attr_remove(name->path, attrname, flags); 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~ 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr:In file included from ../src/global.h:25, 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr: from fsstress.c:12: 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr: 152 | extern int attr_remove (const char *__path, const char *__attrname, 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~~~ 2024-05-07T11:14:44.154 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c: In function 'attr_set_path': 2024-05-07T11:14:44.155 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c:898:9: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2024-05-07T11:14:44.155 INFO:tasks.workunit.client.0.smithi062.stderr: 898 | rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2024-05-07T11:14:44.155 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~ 2024-05-07T11:14:44.155 INFO:tasks.workunit.client.0.smithi062.stderr:In file included from ../src/global.h:25, 2024-05-07T11:14:44.155 INFO:tasks.workunit.client.0.smithi062.stderr: from fsstress.c:12: 2024-05-07T11:14:44.155 INFO:tasks.workunit.client.0.smithi062.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2024-05-07T11:14:44.155 INFO:tasks.workunit.client.0.smithi062.stderr: 139 | extern int attr_set (const char *__path, const char *__attrname, 2024-05-07T11:14:44.155 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~ 2024-05-07T11:14:44.166 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c: In function 'allocsp_f': 2024-05-07T11:14:44.166 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c:2047:32: error: 'XFS_IOC_ALLOCSP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-05-07T11:14:44.166 INFO:tasks.workunit.client.0.smithi062.stderr: 2047 | e = xfsctl(f.path, fd, XFS_IOC_ALLOCSP64, &fl) < 0 ? errno : 0; 2024-05-07T11:14:44.166 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-07T11:14:44.166 INFO:tasks.workunit.client.0.smithi062.stderr: | XFS_IOC_RESVSP64 2024-05-07T11:14:44.166 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c:2047:32: note: each undeclared identifier is reported only once for each function it appears in 2024-05-07T11:14:44.177 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:44.177 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:44.185 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c: In function 'freesp_f': 2024-05-07T11:14:44.186 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:44.187 INFO:tasks.workunit.client.0.smithi062.stderr:fsstress.c:3640:32: error: 'XFS_IOC_FREESP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-05-07T11:14:44.187 INFO:tasks.workunit.client.0.smithi062.stderr: 3640 | e = xfsctl(f.path, fd, XFS_IOC_FREESP64, &fl) < 0 ? errno : 0; 2024-05-07T11:14:44.187 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-07T11:14:44.187 INFO:tasks.workunit.client.0.smithi062.stderr: | XFS_IOC_RESVSP64 2024-05-07T11:14:44.205 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:44.205+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:44.233 INFO:tasks.workunit.client.0.smithi062.stderr:gmake[3]: *** [Makefile:46: fsstress] Error 1 2024-05-07T11:14:44.233 INFO:tasks.workunit.client.0.smithi062.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-05-07T11:14:44.292 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:44.292 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:44.301 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:44.306 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:44.306+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:44.406 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:44.406 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:44.407 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:44.407+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:44.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:44.508 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:44.508+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:44.559 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:44.559 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:44.568 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:44.611 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:44.611+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:44.630 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T11:14:44.634 INFO:tasks.workunit.client.0.smithi062.stderr:doio.c: In function 'parse_cmdline': 2024-05-07T11:14:44.635 INFO:tasks.workunit.client.0.smithi062.stderr:doio.c:3113:33: warning: '%s' directive argument is null [-Wformat-overflow=] 2024-05-07T11:14:44.635 INFO:tasks.workunit.client.0.smithi062.stderr: 3113 | fprintf(stderr, 2024-05-07T11:14:44.635 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~~~~~~~ 2024-05-07T11:14:44.635 INFO:tasks.workunit.client.0.smithi062.stderr: 3114 | "%s%s: Illegal -C arg (%s). Must be one of: ", 2024-05-07T11:14:44.635 INFO:tasks.workunit.client.0.smithi062.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T11:14:44.635 INFO:tasks.workunit.client.0.smithi062.stderr: 3115 | Prog, TagName, tok); 2024-05-07T11:14:44.635 INFO:tasks.workunit.client.0.smithi062.stderr: | ~~~~~~~~~~~~~~~~~~~ 2024-05-07T11:14:44.640 INFO:tasks.workunit.client.0.smithi062.stderr:fsx.c: In function 'main': 2024-05-07T11:14:44.641 INFO:tasks.workunit.client.0.smithi062.stderr:fsx.c:2662:33: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2024-05-07T11:14:44.641 INFO:tasks.workunit.client.0.smithi062.stderr: 2662 | strncpy(opsfile, optarg, sizeof(opsfile)); 2024-05-07T11:14:44.641 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T11:14:44.641 INFO:tasks.workunit.client.0.smithi062.stderr:fsx.c:2632:25: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2024-05-07T11:14:44.641 INFO:tasks.workunit.client.0.smithi062.stderr: 2632 | strncpy(dname, optarg, sizeof(dname)); 2024-05-07T11:14:44.641 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T11:14:44.674 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:44.674 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:44.683 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:44.709 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:44.709+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:gmake[2]: *** [include/buildrules:30: ltp] Error 2 2024-05-07T11:14:44.787 INFO:tasks.workunit.client.0.smithi062.stderr:gmake[2]: *** Waiting for unfinished jobs.... 2024-05-07T11:14:44.810 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:44.809+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:44.828 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:44.828 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:44.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:44.911 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:44.910+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:44.941 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:44.941 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:44.949 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:45.011 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:45.010+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:45.055 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:45.055 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:45.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:45.112 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:45.111+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:45.209 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:45.209 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:45.212 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:45.212+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:45.218 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:45.313 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:45.312+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:45.323 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:45.323 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:45.332 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:45.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:45.414 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:45.413+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:45.438 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:45.439 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:45.447 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:45.496 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:45.496 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:45.496 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:45.516 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:45.516 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:45.520 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:45.520 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:45.533 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:45.533+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:45.594 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:45.594 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:45.595 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:45.595 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:45.595 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:45.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:45.617 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-05-07T11:14:45.644 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:45.644+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:45.716 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:45.716+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:45.751 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.243341031, 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.243252948999999, 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.234489822, 2024-05-07T11:14:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.230126774999999, 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.227493937999999, 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:45.780 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.223223036, 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:45.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.786 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.213724828, 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:45.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.792 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.211084559, 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.793 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:45.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:45.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.200905102, 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:45.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.805 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.187129631000001, 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:45.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.181104569999999, 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:45.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:45.817 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.180262581000001, 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:45.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.177698282000001, 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.176851932999998, 2024-05-07T11:14:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:45.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:45.835 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.172556456999999, 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:45.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:45.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:45.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.169768657999999, 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:45.841 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:45.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:45.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.168951218, 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:45.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.167144828000001, 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.853 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:45.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:45.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.160150382000001, 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.859 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:45.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.864 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 21.147080881000001, 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:45.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:45.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:45.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:45.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:45.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:45.870 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.870 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.870 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.870 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:45.870 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:45.870 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:45.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:45.872 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:45.871+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:45.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-05-07T11:14:45.972 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:45.972+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:45.981 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:45.981 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:45.982 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:45.982 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:45.991 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:46.073 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:46.073+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:46.136 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:46.136 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:46.136 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:46.136 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:46.136 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:46.145 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:46.174 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:46.174+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:46.251 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:46.251 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:46.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:46.251 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:46.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.251 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:46.251 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:46.251 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.747813400999998, 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:46.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.743689659000001, 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.257 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:46.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.743640864, 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.263 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:46.268 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.743607572999998, 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.269 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:46.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:46.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:46.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.274 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.743150804999999, 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:46.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:46.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.743115787000001, 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:46.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:46.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.743092399999998, 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:46.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.742297203, 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:46.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.298 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.741354664999999, 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.304 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.739460263000002, 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:46.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.738386829, 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.310 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.315 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.736587025999999, 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:46.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:46.321 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.735650996, 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:46.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:46.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.732925044000002, 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.327 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:46.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:46.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.332 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.732079172999999, 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:46.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:46.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.731271788000001, 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:46.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:46.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:46.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:46.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:46.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:46.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.728479109999999, 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:46.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:46.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:46.350 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.726028031999999, 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:46.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.725129676999998, 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.356 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.720829814999998, 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.362 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:46.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:46.368 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:46.368 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:46.369 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:46.370 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:46.368+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:46.470 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:46.470+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:46.476 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:46.477 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:46.485 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:46.571 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:46.570+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:46.590 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:46.590 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:46.590 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:46.590 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:46.590 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:46.599 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:46.682 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:46.682+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:46.746 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.238452193000001, 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.238364110999999, 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.229600984000001, 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.225237936999999, 2024-05-07T11:14:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.222605099999999, 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.218334198000001, 2024-05-07T11:14:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:46.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:46.779 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.208835990000001, 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.780 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.785 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.206195721, 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:46.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.196016264000001, 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.791 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.182240792999998, 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.797 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:46.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:46.802 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.176215731999999, 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.803 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.808 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.175373743000002, 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.172809443999999, 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.814 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.819 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.171963094999999, 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.820 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.167667618999999, 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.164879819999999, 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.164062380000001, 2024-05-07T11:14:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.162255989999998, 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.847 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.155261543999998, 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:46.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 22.142192043000001, 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:46.853 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:46.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:46.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:46.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:46.859 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:46.859 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:46.860 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:46.860 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:46.859+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:46.961 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:46.961+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:46.969 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:46.969 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:46.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:46.981 INFO:tasks.workunit.client.0.smithi062.stdout: [DEP] 2024-05-07T11:14:46.981 INFO:tasks.workunit.client.0.smithi062.stdout: [DEP] 2024-05-07T11:14:46.984 INFO:tasks.workunit.client.0.smithi062.stdout: [DEP] 2024-05-07T11:14:47.062 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:47.061+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:47.083 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:47.083 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:47.084 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:47.084 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:47.084 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:47.092 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:47.176 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:47.176+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:47.240 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.737428228999999, 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:47.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:47.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:47.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.733304487000002, 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:47.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:47.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.733255692, 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:47.252 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:47.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:47.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.733222400999999, 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:47.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:47.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.732765633, 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.264 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.732730615000001, 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:47.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.732707227999999, 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:47.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:47.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.731912031, 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:47.280 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.285 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.730969493, 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:47.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:47.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:47.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:47.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:47.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.729075090999999, 2024-05-07T11:14:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:47.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:47.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.728001657, 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.297 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:47.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.302 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.726201853999999, 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:47.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.725265824000001, 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.308 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:47.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:47.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:47.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.722539871999999, 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:47.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:47.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.721694000999999, 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.319 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.324 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.720886616000001, 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:47.330 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.718093937999999, 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:47.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:47.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.715642859999999, 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.336 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.714744504999999, 2024-05-07T11:14:47.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:47.346 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.710444642999999, 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:47.347 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:47.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:47.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:47.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:47.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:47.352 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:47.354 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:47.354 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:47.353+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:47.455 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:47.454+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:47.466 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:47.466 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:47.466 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:47.467 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:47.475 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:47.493 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] dirstress 2024-05-07T11:14:47.501 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] fill 2024-05-07T11:14:47.501 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] fill2 2024-05-07T11:14:47.504 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] getpagesize 2024-05-07T11:14:47.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:47.559 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:47.559+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:47.620 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:47.621 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:47.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:47.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:14:47.670 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:47.670+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:47.697 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:47.697 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:47.697 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:47.723 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:47.727 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:47.727 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:47.757 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] holes 2024-05-07T11:14:47.757 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:47.757+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:47.774 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:47.774 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:47.781 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] lstat64 2024-05-07T11:14:47.783 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:47.858 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:47.857+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:47.885 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] nametest 2024-05-07T11:14:47.890 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:47.891 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:47.899 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:47.921 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] permname 2024-05-07T11:14:47.959 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:47.958+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:48.044 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:48.045 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:48.053 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:48.059 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:48.059+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:48.092 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] randholes 2024-05-07T11:14:48.100 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] runas 2024-05-07T11:14:48.158 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:48.158 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:48.160 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:48.159+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:48.167 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:48.236 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] truncfile 2024-05-07T11:14:48.260 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:48.260+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:48.270 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] usemem 2024-05-07T11:14:48.272 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:48.273 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:48.281 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:48.361 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:48.360+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:48.378 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] mmapcat 2024-05-07T11:14:48.385 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:48.385 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:48.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:48.462 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:48.461+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:48.480 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] append_reader 2024-05-07T11:14:48.498 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:48.498 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:48.502 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] append_writer 2024-05-07T11:14:48.508 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:48.536 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] dirperf 2024-05-07T11:14:48.562 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:48.562+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:48.614 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] metaperf 2024-05-07T11:14:48.615 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:48.615 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:48.623 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:48.625 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:14:48.667 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:48.667+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:48.726 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] devzero 2024-05-07T11:14:48.730 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:48.730 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:48.739 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:48.747 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] feature 2024-05-07T11:14:48.765 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:48.765+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:48.866 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:48.866+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:48.886 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:48.887 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:48.896 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:48.907 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] alloc 2024-05-07T11:14:48.967 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:48.967+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:49.001 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:49.001 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:49.007 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] fault 2024-05-07T11:14:49.010 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:49.031 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] fstest 2024-05-07T11:14:49.060 INFO:tasks.workunit.client.0.smithi062.stdout: [CC] t_access_root 2024-05-07T11:14:49.068 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:49.068+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:49.114 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:49.114 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:49.119 INFO:tasks.workunit.client.0.smithi062.stderr:alloc.c: In function 'main': 2024-05-07T11:14:49.119 INFO:tasks.workunit.client.0.smithi062.stderr:alloc.c:154:1: error: 'bozo' undeclared (first use in this function) 2024-05-07T11:14:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: 154 | bozo! 2024-05-07T11:14:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~ 2024-05-07T11:14:49.120 INFO:tasks.workunit.client.0.smithi062.stderr:alloc.c:154:1: note: each undeclared identifier is reported only once for each function it appears in 2024-05-07T11:14:49.120 INFO:tasks.workunit.client.0.smithi062.stderr:alloc.c:154:5: error: expected ';' before '!' token 2024-05-07T11:14:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: 154 | bozo! 2024-05-07T11:14:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: | ^ 2024-05-07T11:14:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: | ; 2024-05-07T11:14:49.120 INFO:tasks.workunit.client.0.smithi062.stderr:alloc.c:184:25: error: 'rflag' undeclared (first use in this function); did you mean 'nflag'? 2024-05-07T11:14:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: 184 | rflag = 1; 2024-05-07T11:14:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~ 2024-05-07T11:14:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: | nflag 2024-05-07T11:14:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:alloc.c:320:5: error: expected ';' before '!' token 2024-05-07T11:14:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: 320 | bozo! 2024-05-07T11:14:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: | ^ 2024-05-07T11:14:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: | ; 2024-05-07T11:14:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:alloc.c:128:25: warning: variable 'f' set but not used [-Wunused-but-set-variable] 2024-05-07T11:14:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: 128 | struct flock64 f; 2024-05-07T11:14:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: | ^ 2024-05-07T11:14:49.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:49.125 INFO:tasks.workunit.client.0.smithi062.stderr:gmake[3]: *** [Makefile:83: alloc] Error 1 2024-05-07T11:14:49.125 INFO:tasks.workunit.client.0.smithi062.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-05-07T11:14:49.169 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:49.168+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:49.226 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:49.227 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:49.234 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-05-07T11:14:49.234 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:14:49.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:14:49.236 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:49.270 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:49.269+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:49.271 INFO:tasks.workunit.client.0.smithi062.stderr:fstest.c: In function 'run_child': 2024-05-07T11:14:49.271 INFO:tasks.workunit.client.0.smithi062.stderr:fstest.c:95:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-05-07T11:14:49.271 INFO:tasks.workunit.client.0.smithi062.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-05-07T11:14:49.271 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~ 2024-05-07T11:14:49.271 INFO:tasks.workunit.client.0.smithi062.stderr:fstest.c:95:24: note: directive argument in the range [0, 2147483647] 2024-05-07T11:14:49.271 INFO:tasks.workunit.client.0.smithi062.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-05-07T11:14:49.271 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~~~ 2024-05-07T11:14:49.271 INFO:tasks.workunit.client.0.smithi062.stderr:fstest.c:95:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr:fstest.c:166:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~ 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr:fstest.c:166:24: note: directive argument in the range [0, 2147483647] 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~~~ 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr:fstest.c:166:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-05-07T11:14:49.272 INFO:tasks.workunit.client.0.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T11:14:49.341 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:49.342 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:49.350 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:49.361 INFO:tasks.workunit.client.0.smithi062.stderr:gmake[2]: *** [include/buildrules:30: src] Error 2 2024-05-07T11:14:49.361 INFO:tasks.workunit.client.0.smithi062.stderr:make[1]: *** [Makefile:53: default] Error 2 2024-05-07T11:14:49.362 INFO:tasks.workunit.client.0.smithi062.stderr:make: *** [Makefile:51: default] Error 2 2024-05-07T11:14:49.363 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-07T11:14:49.363 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-05-07T11:14:49.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-07T11:14:49.371 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:49.370+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:49.455 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:49.455 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:49.465 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:49.471 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:49.471+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:49.563 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:14:49.565 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:14:49.569 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:49.569 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:49.572 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:49.572+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:49.575 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2024-05-07T11:14:48.961451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67924568,"num_objects":3459,"num_object_clones":0,"num_object_copies":6918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3128,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3459,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":10930,"num_write_kb":82799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10444,"ondisk_log_size":10444,"up":115,"acting":115,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":167324,"kb_used_data":43256,"kb_used_omap":4,"kb_used_meta":124027,"kb_avail":282948196,"statfs":{"total":289910292480,"available":289738952704,"internally_reserved":0,"allocated":44294144,"data_stored":73837128,"data_compressed":9068625,"data_compressed_allocated":10862592,"data_compressed_original":52051968,"omap_allocated":4785,"internal_metadata":127003983},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":890622,"num_objects":-94,"num_object_clones":0,"num_object_copies":-188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-93,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-94,"num_whiteouts":0,"num_read":8,"num_read_kb":24,"num_write":361,"num_write_kb":1891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.349387"},"pg_stats":[{"pgid":"4.3f","version":"60'155","reported_seq":266,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.623455+0000","last_change":"2024-05-07T11:14:25.513102+0000","last_active":"2024-05-07T11:14:45.623455+0000","last_peered":"2024-05-07T11:14:45.623455+0000","last_clean":"2024-05-07T11:14:24.364900+0000","last_became_active":"2024-05-07T11:14:25.513102+0000","last_became_peered":"2024-05-07T11:14:25.513102+0000","last_unstale":"2024-05-07T11:14:45.623455+0000","last_undegraded":"2024-05-07T11:14:25.506220+0000","last_fullsized":"2024-05-07T11:14:25.506154+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:57:23.835242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":54,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":54}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'151","reported_seq":257,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621846+0000","last_change":"2024-05-07T11:14:25.503547+0000","last_active":"2024-05-07T11:14:45.621846+0000","last_peered":"2024-05-07T11:14:45.621846+0000","last_clean":"2024-05-07T11:14:24.134085+0000","last_became_active":"2024-05-07T11:14:25.503547+0000","last_became_peered":"2024-05-07T11:14:25.503547+0000","last_unstale":"2024-05-07T11:14:45.621846+0000","last_undegraded":"2024-05-07T11:14:25.502456+0000","last_fullsized":"2024-05-07T11:14:25.502374+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:52.829734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":46,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":46}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"60'162","reported_seq":266,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622290+0000","last_change":"2024-05-07T11:14:25.510957+0000","last_active":"2024-05-07T11:14:45.622290+0000","last_peered":"2024-05-07T11:14:45.622290+0000","last_clean":"2024-05-07T11:14:24.486064+0000","last_became_active":"2024-05-07T11:14:25.510957+0000","last_became_peered":"2024-05-07T11:14:25.510957+0000","last_unstale":"2024-05-07T11:14:45.622290+0000","last_undegraded":"2024-05-07T11:14:25.503777+0000","last_fullsized":"2024-05-07T11:14:25.502948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:05:02.083165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":45,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'117","reported_seq":220,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-07T11:14:45.622249+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:14:45.622249+0000","last_peered":"2024-05-07T11:14:45.622249+0000","last_clean":"2024-05-07T11:14:45.622249+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:14:45.622249+0000","last_undegraded":"2024-05-07T11:14:45.622249+0000","last_fullsized":"2024-05-07T11:14:45.622249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222085,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'182","reported_seq":288,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621839+0000","last_change":"2024-05-07T11:14:25.504054+0000","last_active":"2024-05-07T11:14:45.621839+0000","last_peered":"2024-05-07T11:14:45.621839+0000","last_clean":"2024-05-07T11:14:24.413704+0000","last_became_active":"2024-05-07T11:14:25.504054+0000","last_became_peered":"2024-05-07T11:14:25.504054+0000","last_unstale":"2024-05-07T11:14:45.621839+0000","last_undegraded":"2024-05-07T11:14:25.502726+0000","last_fullsized":"2024-05-07T11:14:25.502557+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:26:17.805421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":61,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":61}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"60'170","reported_seq":209,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621998+0000","last_change":"2024-05-07T11:14:25.512714+0000","last_active":"2024-05-07T11:14:45.621998+0000","last_peered":"2024-05-07T11:14:45.621998+0000","last_clean":"2024-05-07T11:14:24.385916+0000","last_became_active":"2024-05-07T11:14:25.512714+0000","last_became_peered":"2024-05-07T11:14:25.512714+0000","last_unstale":"2024-05-07T11:14:45.621998+0000","last_undegraded":"2024-05-07T11:14:25.503319+0000","last_fullsized":"2024-05-07T11:14:25.503176+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:50:15.111621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":46,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":46}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'160","reported_seq":243,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-07T11:14:45.621695+0000","last_change":"2024-05-07T11:13:25.248071+0000","last_active":"2024-05-07T11:14:45.621695+0000","last_peered":"2024-05-07T11:14:45.621695+0000","last_clean":"2024-05-07T11:14:45.621695+0000","last_became_active":"2024-05-07T11:13:25.247861+0000","last_became_peered":"2024-05-07T11:13:25.247861+0000","last_unstale":"2024-05-07T11:14:45.621695+0000","last_undegraded":"2024-05-07T11:14:45.621695+0000","last_fullsized":"2024-05-07T11:14:45.621695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.057596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'123","reported_seq":232,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621389+0000","last_change":"2024-05-07T11:14:25.519863+0000","last_active":"2024-05-07T11:14:45.621389+0000","last_peered":"2024-05-07T11:14:45.621389+0000","last_clean":"2024-05-07T11:14:24.486823+0000","last_became_active":"2024-05-07T11:14:25.519863+0000","last_became_peered":"2024-05-07T11:14:25.519863+0000","last_unstale":"2024-05-07T11:14:45.621389+0000","last_undegraded":"2024-05-07T11:14:25.502726+0000","last_fullsized":"2024-05-07T11:14:25.502650+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":46,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":46}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'160","reported_seq":201,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624169+0000","last_change":"2024-05-07T11:14:25.515555+0000","last_active":"2024-05-07T11:14:45.624169+0000","last_peered":"2024-05-07T11:14:45.624169+0000","last_clean":"2024-05-07T11:14:24.451837+0000","last_became_active":"2024-05-07T11:14:25.515555+0000","last_became_peered":"2024-05-07T11:14:25.515555+0000","last_unstale":"2024-05-07T11:14:45.624169+0000","last_undegraded":"2024-05-07T11:14:25.507124+0000","last_fullsized":"2024-05-07T11:14:25.506744+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:39.870264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":55,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"60'139","reported_seq":250,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622617+0000","last_change":"2024-05-07T11:14:25.514182+0000","last_active":"2024-05-07T11:14:45.622617+0000","last_peered":"2024-05-07T11:14:45.622617+0000","last_clean":"2024-05-07T11:14:24.338417+0000","last_became_active":"2024-05-07T11:14:25.514182+0000","last_became_peered":"2024-05-07T11:14:25.514182+0000","last_unstale":"2024-05-07T11:14:45.622617+0000","last_undegraded":"2024-05-07T11:14:25.504114+0000","last_fullsized":"2024-05-07T11:14:25.503360+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:49:32.544624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91425,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":44,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":44}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'148","reported_seq":187,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622512+0000","last_change":"2024-05-07T11:14:25.510150+0000","last_active":"2024-05-07T11:14:45.622512+0000","last_peered":"2024-05-07T11:14:45.622512+0000","last_clean":"2024-05-07T11:14:24.389560+0000","last_became_active":"2024-05-07T11:14:25.510150+0000","last_became_peered":"2024-05-07T11:14:25.510150+0000","last_unstale":"2024-05-07T11:14:45.622512+0000","last_undegraded":"2024-05-07T11:14:25.503038+0000","last_fullsized":"2024-05-07T11:14:25.502962+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:15:48.467117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":59,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":59}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'133","reported_seq":239,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621868+0000","last_change":"2024-05-07T11:14:25.515165+0000","last_active":"2024-05-07T11:14:45.621868+0000","last_peered":"2024-05-07T11:14:45.621868+0000","last_clean":"2024-05-07T11:14:24.417671+0000","last_became_active":"2024-05-07T11:14:25.515165+0000","last_became_peered":"2024-05-07T11:14:25.515165+0000","last_unstale":"2024-05-07T11:14:45.621868+0000","last_undegraded":"2024-05-07T11:14:25.506521+0000","last_fullsized":"2024-05-07T11:14:25.506441+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:46.110526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":53,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":53}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'126","reported_seq":237,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622100+0000","last_change":"2024-05-07T11:14:25.518436+0000","last_active":"2024-05-07T11:14:45.622100+0000","last_peered":"2024-05-07T11:14:45.622100+0000","last_clean":"2024-05-07T11:14:24.474234+0000","last_became_active":"2024-05-07T11:14:25.518436+0000","last_became_peered":"2024-05-07T11:14:25.518436+0000","last_unstale":"2024-05-07T11:14:45.622100+0000","last_undegraded":"2024-05-07T11:14:25.506137+0000","last_fullsized":"2024-05-07T11:14:25.505682+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":51,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":51}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"59'168","reported_seq":272,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.623348+0000","last_change":"2024-05-07T11:14:25.513896+0000","last_active":"2024-05-07T11:14:45.623348+0000","last_peered":"2024-05-07T11:14:45.623348+0000","last_clean":"2024-05-07T11:14:24.470554+0000","last_became_active":"2024-05-07T11:14:25.513896+0000","last_became_peered":"2024-05-07T11:14:25.513896+0000","last_unstale":"2024-05-07T11:14:45.623348+0000","last_undegraded":"2024-05-07T11:14:25.503515+0000","last_fullsized":"2024-05-07T11:14:25.503430+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:07.031567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":47,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":47}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'164","reported_seq":268,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622108+0000","last_change":"2024-05-07T11:14:25.510226+0000","last_active":"2024-05-07T11:14:45.622108+0000","last_peered":"2024-05-07T11:14:45.622108+0000","last_clean":"2024-05-07T11:14:24.452805+0000","last_became_active":"2024-05-07T11:14:25.510226+0000","last_became_peered":"2024-05-07T11:14:25.510226+0000","last_unstale":"2024-05-07T11:14:45.622108+0000","last_undegraded":"2024-05-07T11:14:25.503085+0000","last_fullsized":"2024-05-07T11:14:25.502986+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:11:15.893233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":43,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'168","reported_seq":207,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621470+0000","last_change":"2024-05-07T11:14:25.520398+0000","last_active":"2024-05-07T11:14:45.621470+0000","last_peered":"2024-05-07T11:14:45.621470+0000","last_clean":"2024-05-07T11:14:24.378895+0000","last_became_active":"2024-05-07T11:14:25.520398+0000","last_became_peered":"2024-05-07T11:14:25.520398+0000","last_unstale":"2024-05-07T11:14:45.621470+0000","last_undegraded":"2024-05-07T11:14:25.503099+0000","last_fullsized":"2024-05-07T11:14:25.503013+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:19:28.465664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4321560,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":59,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":4470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":59}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'152","reported_seq":258,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621906+0000","last_change":"2024-05-07T11:14:25.506607+0000","last_active":"2024-05-07T11:14:45.621906+0000","last_peered":"2024-05-07T11:14:45.621906+0000","last_clean":"2024-05-07T11:14:24.492419+0000","last_became_active":"2024-05-07T11:14:25.506607+0000","last_became_peered":"2024-05-07T11:14:25.506607+0000","last_unstale":"2024-05-07T11:14:45.621906+0000","last_undegraded":"2024-05-07T11:14:25.502598+0000","last_fullsized":"2024-05-07T11:14:25.502493+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:33:00.458931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106279,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":48,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'138","reported_seq":244,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622108+0000","last_change":"2024-05-07T11:14:25.507438+0000","last_active":"2024-05-07T11:14:45.622108+0000","last_peered":"2024-05-07T11:14:45.622108+0000","last_clean":"2024-05-07T11:14:24.464623+0000","last_became_active":"2024-05-07T11:14:25.507438+0000","last_became_peered":"2024-05-07T11:14:25.507438+0000","last_unstale":"2024-05-07T11:14:45.622108+0000","last_undegraded":"2024-05-07T11:14:25.502776+0000","last_fullsized":"2024-05-07T11:14:25.502696+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:47:47.159358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":54,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":54}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"60'140","reported_seq":181,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621891+0000","last_change":"2024-05-07T11:14:25.507726+0000","last_active":"2024-05-07T11:14:45.621891+0000","last_peered":"2024-05-07T11:14:45.621891+0000","last_clean":"2024-05-07T11:14:24.418674+0000","last_became_active":"2024-05-07T11:14:25.507726+0000","last_became_peered":"2024-05-07T11:14:25.507726+0000","last_unstale":"2024-05-07T11:14:45.621891+0000","last_undegraded":"2024-05-07T11:14:25.502695+0000","last_fullsized":"2024-05-07T11:14:25.502614+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:30:35.257811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":54,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":54}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"60'177","reported_seq":286,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622311+0000","last_change":"2024-05-07T11:14:25.517125+0000","last_active":"2024-05-07T11:14:45.622311+0000","last_peered":"2024-05-07T11:14:45.622311+0000","last_clean":"2024-05-07T11:14:24.396282+0000","last_became_active":"2024-05-07T11:14:25.517125+0000","last_became_peered":"2024-05-07T11:14:25.517125+0000","last_unstale":"2024-05-07T11:14:45.622311+0000","last_undegraded":"2024-05-07T11:14:25.506522+0000","last_fullsized":"2024-05-07T11:14:25.506446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:05:36.971840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":50,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":50}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'146","reported_seq":248,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-07T11:14:45.621726+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:14:45.621726+0000","last_peered":"2024-05-07T11:14:45.621726+0000","last_clean":"2024-05-07T11:14:45.621726+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:14:45.621726+0000","last_undegraded":"2024-05-07T11:14:45.621726+0000","last_fullsized":"2024-05-07T11:14:45.621726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'154","reported_seq":260,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621231+0000","last_change":"2024-05-07T11:14:25.506426+0000","last_active":"2024-05-07T11:14:45.621231+0000","last_peered":"2024-05-07T11:14:45.621231+0000","last_clean":"2024-05-07T11:14:24.332238+0000","last_became_active":"2024-05-07T11:14:25.506426+0000","last_became_peered":"2024-05-07T11:14:25.506426+0000","last_unstale":"2024-05-07T11:14:45.621231+0000","last_undegraded":"2024-05-07T11:14:25.502470+0000","last_fullsized":"2024-05-07T11:14:25.502380+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:02:03.420986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111809,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":63,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":63}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":191,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621147+0000","last_change":"2024-05-07T11:14:25.505354+0000","last_active":"2024-05-07T11:14:45.621147+0000","last_peered":"2024-05-07T11:14:45.621147+0000","last_clean":"2024-05-07T11:14:24.409169+0000","last_became_active":"2024-05-07T11:14:25.505354+0000","last_became_peered":"2024-05-07T11:14:25.505354+0000","last_unstale":"2024-05-07T11:14:45.621147+0000","last_undegraded":"2024-05-07T11:14:25.502390+0000","last_fullsized":"2024-05-07T11:14:25.502308+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:11:20.323964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":51,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":51}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"60'162","reported_seq":268,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621690+0000","last_change":"2024-05-07T11:14:25.503384+0000","last_active":"2024-05-07T11:14:45.621690+0000","last_peered":"2024-05-07T11:14:45.621690+0000","last_clean":"2024-05-07T11:14:24.433639+0000","last_became_active":"2024-05-07T11:14:25.503384+0000","last_became_peered":"2024-05-07T11:14:25.503384+0000","last_unstale":"2024-05-07T11:14:45.621690+0000","last_undegraded":"2024-05-07T11:14:25.502084+0000","last_fullsized":"2024-05-07T11:14:25.502000+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:57.680470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84483,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":47,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":47}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"60'152","reported_seq":258,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.623098+0000","last_change":"2024-05-07T11:14:25.512804+0000","last_active":"2024-05-07T11:14:45.623098+0000","last_peered":"2024-05-07T11:14:45.623098+0000","last_clean":"2024-05-07T11:14:24.475528+0000","last_became_active":"2024-05-07T11:14:25.512804+0000","last_became_peered":"2024-05-07T11:14:25.512804+0000","last_unstale":"2024-05-07T11:14:45.623098+0000","last_undegraded":"2024-05-07T11:14:25.504616+0000","last_fullsized":"2024-05-07T11:14:25.504538+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:20.389178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":64,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":64}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'180","reported_seq":284,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-07T11:14:45.621870+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:14:45.621870+0000","last_peered":"2024-05-07T11:14:45.621870+0000","last_clean":"2024-05-07T11:14:45.621870+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:14:45.621870+0000","last_undegraded":"2024-05-07T11:14:45.621870+0000","last_fullsized":"2024-05-07T11:14:45.621870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'146","reported_seq":230,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.623496+0000","last_change":"2024-05-07T11:14:25.512023+0000","last_active":"2024-05-07T11:14:45.623496+0000","last_peered":"2024-05-07T11:14:45.623496+0000","last_clean":"2024-05-07T11:14:24.294325+0000","last_became_active":"2024-05-07T11:14:25.512023+0000","last_became_peered":"2024-05-07T11:14:25.512023+0000","last_unstale":"2024-05-07T11:14:45.623496+0000","last_undegraded":"2024-05-07T11:14:25.504285+0000","last_fullsized":"2024-05-07T11:14:25.503926+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:32:22.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":47,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":47}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'143","reported_seq":249,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622065+0000","last_change":"2024-05-07T11:14:25.514887+0000","last_active":"2024-05-07T11:14:45.622065+0000","last_peered":"2024-05-07T11:14:45.622065+0000","last_clean":"2024-05-07T11:14:24.430825+0000","last_became_active":"2024-05-07T11:14:25.514887+0000","last_became_peered":"2024-05-07T11:14:25.514887+0000","last_unstale":"2024-05-07T11:14:45.622065+0000","last_undegraded":"2024-05-07T11:14:25.505655+0000","last_fullsized":"2024-05-07T11:14:25.505574+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:39.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":48,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":48}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'156","reported_seq":197,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622303+0000","last_change":"2024-05-07T11:14:25.520645+0000","last_active":"2024-05-07T11:14:45.622303+0000","last_peered":"2024-05-07T11:14:45.622303+0000","last_clean":"2024-05-07T11:14:24.443460+0000","last_became_active":"2024-05-07T11:14:25.520645+0000","last_became_peered":"2024-05-07T11:14:25.520645+0000","last_unstale":"2024-05-07T11:14:45.622303+0000","last_undegraded":"2024-05-07T11:14:25.507463+0000","last_fullsized":"2024-05-07T11:14:25.506267+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:07.574111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":58,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":58}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"60'177","reported_seq":283,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621802+0000","last_change":"2024-05-07T11:14:25.510434+0000","last_active":"2024-05-07T11:14:45.621802+0000","last_peered":"2024-05-07T11:14:45.621802+0000","last_clean":"2024-05-07T11:14:24.440580+0000","last_became_active":"2024-05-07T11:14:25.510434+0000","last_became_peered":"2024-05-07T11:14:25.510434+0000","last_unstale":"2024-05-07T11:14:45.621802+0000","last_undegraded":"2024-05-07T11:14:25.503209+0000","last_fullsized":"2024-05-07T11:14:25.503102+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:51:37.818182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":68,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":68}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"60'180","reported_seq":286,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621712+0000","last_change":"2024-05-07T11:14:25.503419+0000","last_active":"2024-05-07T11:14:45.621712+0000","last_peered":"2024-05-07T11:14:45.621712+0000","last_clean":"2024-05-07T11:14:24.447224+0000","last_became_active":"2024-05-07T11:14:25.503419+0000","last_became_peered":"2024-05-07T11:14:25.503419+0000","last_unstale":"2024-05-07T11:14:45.621712+0000","last_undegraded":"2024-05-07T11:14:25.502132+0000","last_fullsized":"2024-05-07T11:14:25.502021+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:11:45.086420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":66,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":66}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'175","reported_seq":284,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621673+0000","last_change":"2024-05-07T11:14:25.520825+0000","last_active":"2024-05-07T11:14:45.621673+0000","last_peered":"2024-05-07T11:14:45.621673+0000","last_clean":"2024-05-07T11:14:24.357156+0000","last_became_active":"2024-05-07T11:14:25.520825+0000","last_became_peered":"2024-05-07T11:14:25.520825+0000","last_unstale":"2024-05-07T11:14:45.621673+0000","last_undegraded":"2024-05-07T11:14:25.503409+0000","last_fullsized":"2024-05-07T11:14:25.503330+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:05.259035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445907,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":55,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'145","reported_seq":256,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621443+0000","last_change":"2024-05-07T11:14:25.513962+0000","last_active":"2024-05-07T11:14:45.621443+0000","last_peered":"2024-05-07T11:14:45.621443+0000","last_clean":"2024-05-07T11:14:24.066710+0000","last_became_active":"2024-05-07T11:14:25.513962+0000","last_became_peered":"2024-05-07T11:14:25.513962+0000","last_unstale":"2024-05-07T11:14:45.621443+0000","last_undegraded":"2024-05-07T11:14:25.503808+0000","last_fullsized":"2024-05-07T11:14:25.503726+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:46.704087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":45,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'104","reported_seq":208,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-07T11:14:45.622247+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:14:45.622247+0000","last_peered":"2024-05-07T11:14:45.622247+0000","last_clean":"2024-05-07T11:14:45.622247+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:14:45.622247+0000","last_undegraded":"2024-05-07T11:14:45.622247+0000","last_fullsized":"2024-05-07T11:14:45.622247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158701,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":3142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'135","reported_seq":241,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621831+0000","last_change":"2024-05-07T11:14:25.503419+0000","last_active":"2024-05-07T11:14:45.621831+0000","last_peered":"2024-05-07T11:14:45.621831+0000","last_clean":"2024-05-07T11:14:24.385176+0000","last_became_active":"2024-05-07T11:14:25.503419+0000","last_became_peered":"2024-05-07T11:14:25.503419+0000","last_unstale":"2024-05-07T11:14:45.621831+0000","last_undegraded":"2024-05-07T11:14:25.502407+0000","last_fullsized":"2024-05-07T11:14:25.502302+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:35.908685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":45,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":45}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.624434+0000","last_change":"2024-05-07T11:14:25.515993+0000","last_active":"2024-05-07T11:14:45.624434+0000","last_peered":"2024-05-07T11:14:45.624434+0000","last_clean":"2024-05-07T11:14:21.981376+0000","last_became_active":"2024-05-07T11:14:25.515993+0000","last_became_peered":"2024-05-07T11:14:25.515993+0000","last_unstale":"2024-05-07T11:14:45.624434+0000","last_undegraded":"2024-05-07T11:14:45.624434+0000","last_fullsized":"2024-05-07T11:14:25.505257+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:25.078424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'168","reported_seq":208,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.623161+0000","last_change":"2024-05-07T11:14:25.513930+0000","last_active":"2024-05-07T11:14:45.623161+0000","last_peered":"2024-05-07T11:14:45.623161+0000","last_clean":"2024-05-07T11:14:24.489423+0000","last_became_active":"2024-05-07T11:14:25.513930+0000","last_became_peered":"2024-05-07T11:14:25.513930+0000","last_unstale":"2024-05-07T11:14:45.623161+0000","last_undegraded":"2024-05-07T11:14:25.504520+0000","last_fullsized":"2024-05-07T11:14:25.504427+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:11.760300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123647,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":58,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":58}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.621728+0000","last_change":"2024-05-07T11:14:25.510986+0000","last_active":"2024-05-07T11:14:45.621728+0000","last_peered":"2024-05-07T11:14:45.621728+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"2024-05-07T11:14:25.510986+0000","last_became_peered":"2024-05-07T11:14:25.510986+0000","last_unstale":"2024-05-07T11:14:45.621728+0000","last_undegraded":"2024-05-07T11:14:45.621728+0000","last_fullsized":"2024-05-07T11:14:25.502873+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:22.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"60'150","reported_seq":191,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622988+0000","last_change":"2024-05-07T11:14:25.512244+0000","last_active":"2024-05-07T11:14:45.622988+0000","last_peered":"2024-05-07T11:14:45.622988+0000","last_clean":"2024-05-07T11:14:24.481304+0000","last_became_active":"2024-05-07T11:14:25.512244+0000","last_became_peered":"2024-05-07T11:14:25.512244+0000","last_unstale":"2024-05-07T11:14:45.622988+0000","last_undegraded":"2024-05-07T11:14:25.504364+0000","last_fullsized":"2024-05-07T11:14:25.504290+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:47:55.734789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":49,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":49}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":114,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621871+0000","last_change":"2024-05-07T11:14:25.522748+0000","last_active":"2024-05-07T11:14:45.621871+0000","last_peered":"2024-05-07T11:14:45.621871+0000","last_clean":"2024-05-07T11:14:21.981162+0000","last_became_active":"2024-05-07T11:14:25.522748+0000","last_became_peered":"2024-05-07T11:14:25.522748+0000","last_unstale":"2024-05-07T11:14:45.621871+0000","last_undegraded":"2024-05-07T11:14:25.504470+0000","last_fullsized":"2024-05-07T11:14:25.504277+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:07.926814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":108,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624332+0000","last_change":"2024-05-07T11:14:25.514665+0000","last_active":"2024-05-07T11:14:45.624332+0000","last_peered":"2024-05-07T11:14:45.624332+0000","last_clean":"2024-05-07T11:14:21.982236+0000","last_became_active":"2024-05-07T11:14:25.514665+0000","last_became_peered":"2024-05-07T11:14:25.514665+0000","last_unstale":"2024-05-07T11:14:45.624332+0000","last_undegraded":"2024-05-07T11:14:25.507143+0000","last_fullsized":"2024-05-07T11:14:25.506761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'146","reported_seq":181,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621274+0000","last_change":"2024-05-07T11:14:25.522230+0000","last_active":"2024-05-07T11:14:45.621274+0000","last_peered":"2024-05-07T11:14:45.621274+0000","last_clean":"2024-05-07T11:14:24.400453+0000","last_became_active":"2024-05-07T11:14:25.522230+0000","last_became_peered":"2024-05-07T11:14:25.522230+0000","last_unstale":"2024-05-07T11:14:45.621274+0000","last_undegraded":"2024-05-07T11:14:25.503913+0000","last_fullsized":"2024-05-07T11:14:25.503833+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:32:41.740519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":57,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":57}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":33,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624360+0000","last_change":"2024-05-07T11:14:25.515587+0000","last_active":"2024-05-07T11:14:45.624360+0000","last_peered":"2024-05-07T11:14:45.624360+0000","last_clean":"2024-05-07T11:12:44.045725+0000","last_became_active":"2024-05-07T11:14:25.515587+0000","last_became_peered":"2024-05-07T11:14:25.515587+0000","last_unstale":"2024-05-07T11:14:45.624360+0000","last_undegraded":"2024-05-07T11:14:25.505604+0000","last_fullsized":"2024-05-07T11:14:25.505522+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'164","reported_seq":270,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622020+0000","last_change":"2024-05-07T11:14:25.505128+0000","last_active":"2024-05-07T11:14:45.622020+0000","last_peered":"2024-05-07T11:14:45.622020+0000","last_clean":"2024-05-07T11:14:24.204213+0000","last_became_active":"2024-05-07T11:14:25.505128+0000","last_became_peered":"2024-05-07T11:14:25.505128+0000","last_unstale":"2024-05-07T11:14:45.622020+0000","last_undegraded":"2024-05-07T11:14:25.502308+0000","last_fullsized":"2024-05-07T11:14:25.502185+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:46:11.792030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292703,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":53,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":53}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":51,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624647+0000","last_change":"2024-05-07T11:14:25.514098+0000","last_active":"2024-05-07T11:14:45.624647+0000","last_peered":"2024-05-07T11:14:45.624647+0000","last_clean":"2024-05-07T11:13:21.274760+0000","last_became_active":"2024-05-07T11:14:25.514098+0000","last_became_peered":"2024-05-07T11:14:25.514098+0000","last_unstale":"2024-05-07T11:14:45.624647+0000","last_undegraded":"2024-05-07T11:14:25.505768+0000","last_fullsized":"2024-05-07T11:14:25.505682+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:02:00.061768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'154","reported_seq":263,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624249+0000","last_change":"2024-05-07T11:14:25.513713+0000","last_active":"2024-05-07T11:14:45.624249+0000","last_peered":"2024-05-07T11:14:45.624249+0000","last_clean":"2024-05-07T11:14:24.352569+0000","last_became_active":"2024-05-07T11:14:25.513713+0000","last_became_peered":"2024-05-07T11:14:25.513713+0000","last_unstale":"2024-05-07T11:14:45.624249+0000","last_undegraded":"2024-05-07T11:14:25.504118+0000","last_fullsized":"2024-05-07T11:14:25.503845+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:04:22.228389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":50,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":50}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":51,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.622981+0000","last_change":"2024-05-07T11:14:25.521748+0000","last_active":"2024-05-07T11:14:45.622981+0000","last_peered":"2024-05-07T11:14:45.622981+0000","last_clean":"2024-05-07T11:14:06.399454+0000","last_became_active":"2024-05-07T11:14:25.521748+0000","last_became_peered":"2024-05-07T11:14:25.521748+0000","last_unstale":"2024-05-07T11:14:45.622981+0000","last_undegraded":"2024-05-07T11:14:45.622981+0000","last_fullsized":"2024-05-07T11:14:25.507636+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:15:54.493563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'156","reported_seq":260,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-07T11:14:45.621952+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:14:45.621952+0000","last_peered":"2024-05-07T11:14:45.621952+0000","last_clean":"2024-05-07T11:14:45.621952+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:14:45.621952+0000","last_undegraded":"2024-05-07T11:14:45.621952+0000","last_fullsized":"2024-05-07T11:14:45.621952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":69,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621811+0000","last_change":"2024-05-07T11:14:25.516904+0000","last_active":"2024-05-07T11:14:45.621811+0000","last_peered":"2024-05-07T11:14:45.621811+0000","last_clean":"2024-05-07T11:14:23.087394+0000","last_became_active":"2024-05-07T11:14:25.516904+0000","last_became_peered":"2024-05-07T11:14:25.516904+0000","last_unstale":"2024-05-07T11:14:45.621811+0000","last_undegraded":"2024-05-07T11:14:25.505585+0000","last_fullsized":"2024-05-07T11:14:25.505318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:12.489413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"60'166","reported_seq":275,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622346+0000","last_change":"2024-05-07T11:14:25.518670+0000","last_active":"2024-05-07T11:14:45.622346+0000","last_peered":"2024-05-07T11:14:45.622346+0000","last_clean":"2024-05-07T11:14:24.436962+0000","last_became_active":"2024-05-07T11:14:25.518670+0000","last_became_peered":"2024-05-07T11:14:25.518670+0000","last_unstale":"2024-05-07T11:14:45.622346+0000","last_undegraded":"2024-05-07T11:14:25.507244+0000","last_fullsized":"2024-05-07T11:14:25.506768+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":62,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":62}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-07T11:14:45.624587+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:14:45.624587+0000","last_peered":"2024-05-07T11:14:45.624587+0000","last_clean":"2024-05-07T11:14:45.624587+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:14:45.624587+0000","last_undegraded":"2024-05-07T11:14:45.624587+0000","last_fullsized":"2024-05-07T11:14:45.624587+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'155","reported_seq":259,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624303+0000","last_change":"2024-05-07T11:14:25.512893+0000","last_active":"2024-05-07T11:14:45.624303+0000","last_peered":"2024-05-07T11:14:45.624303+0000","last_clean":"2024-05-07T11:14:24.493593+0000","last_became_active":"2024-05-07T11:14:25.512893+0000","last_became_peered":"2024-05-07T11:14:25.512893+0000","last_unstale":"2024-05-07T11:14:45.624303+0000","last_undegraded":"2024-05-07T11:14:25.504583+0000","last_fullsized":"2024-05-07T11:14:25.504509+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:44.396541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101955,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":53,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":53}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.621153+0000","last_change":"2024-05-07T11:14:25.504454+0000","last_active":"2024-05-07T11:14:45.621153+0000","last_peered":"2024-05-07T11:14:45.621153+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"2024-05-07T11:14:25.504454+0000","last_became_peered":"2024-05-07T11:14:25.504454+0000","last_unstale":"2024-05-07T11:14:45.621153+0000","last_undegraded":"2024-05-07T11:14:45.621153+0000","last_fullsized":"2024-05-07T11:14:25.502308+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:38.496211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'129","reported_seq":233,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622911+0000","last_change":"2024-05-07T11:14:25.513640+0000","last_active":"2024-05-07T11:14:45.622911+0000","last_peered":"2024-05-07T11:14:45.622911+0000","last_clean":"2024-05-07T11:14:24.395523+0000","last_became_active":"2024-05-07T11:14:25.513640+0000","last_became_peered":"2024-05-07T11:14:25.513640+0000","last_unstale":"2024-05-07T11:14:45.622911+0000","last_undegraded":"2024-05-07T11:14:25.504229+0000","last_fullsized":"2024-05-07T11:14:25.504135+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:28.286903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98779,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":53,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":53}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":98,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.621072+0000","last_change":"2024-05-07T11:14:25.507351+0000","last_active":"2024-05-07T11:14:45.621072+0000","last_peered":"2024-05-07T11:14:45.621072+0000","last_clean":"2024-05-07T11:14:06.398801+0000","last_became_active":"2024-05-07T11:14:25.507351+0000","last_became_peered":"2024-05-07T11:14:25.507351+0000","last_unstale":"2024-05-07T11:14:45.621072+0000","last_undegraded":"2024-05-07T11:14:45.621072+0000","last_fullsized":"2024-05-07T11:14:25.502231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:02.972697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'132","reported_seq":238,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621859+0000","last_change":"2024-05-07T11:14:25.503412+0000","last_active":"2024-05-07T11:14:45.621859+0000","last_peered":"2024-05-07T11:14:45.621859+0000","last_clean":"2024-05-07T11:14:24.438875+0000","last_became_active":"2024-05-07T11:14:25.503412+0000","last_became_peered":"2024-05-07T11:14:25.503412+0000","last_unstale":"2024-05-07T11:14:45.621859+0000","last_undegraded":"2024-05-07T11:14:25.502418+0000","last_fullsized":"2024-05-07T11:14:25.502309+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:34:20.598799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":53,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":53}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":309,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.623004+0000","last_change":"2024-05-07T11:14:25.525383+0000","last_active":"2024-05-07T11:14:45.623004+0000","last_peered":"2024-05-07T11:14:45.623004+0000","last_clean":"2024-05-07T11:14:21.981363+0000","last_became_active":"2024-05-07T11:14:25.525383+0000","last_became_peered":"2024-05-07T11:14:25.525383+0000","last_unstale":"2024-05-07T11:14:45.623004+0000","last_undegraded":"2024-05-07T11:14:25.507191+0000","last_fullsized":"2024-05-07T11:14:25.507111+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:35.299191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":118,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.623378+0000","last_change":"2024-05-07T11:14:25.519745+0000","last_active":"2024-05-07T11:14:45.623378+0000","last_peered":"2024-05-07T11:14:45.623378+0000","last_clean":"2024-05-07T11:14:21.981691+0000","last_became_active":"2024-05-07T11:14:25.519745+0000","last_became_peered":"2024-05-07T11:14:25.519745+0000","last_unstale":"2024-05-07T11:14:45.623378+0000","last_undegraded":"2024-05-07T11:14:45.623378+0000","last_fullsized":"2024-05-07T11:14:25.507285+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:33.504612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":26,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.623355+0000","last_change":"2024-05-07T11:14:25.516072+0000","last_active":"2024-05-07T11:14:45.623355+0000","last_peered":"2024-05-07T11:14:45.623355+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"2024-05-07T11:14:25.516072+0000","last_became_peered":"2024-05-07T11:14:25.516072+0000","last_unstale":"2024-05-07T11:14:45.623355+0000","last_undegraded":"2024-05-07T11:14:45.623355+0000","last_fullsized":"2024-05-07T11:14:25.503514+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'143","reported_seq":227,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624506+0000","last_change":"2024-05-07T11:14:25.513744+0000","last_active":"2024-05-07T11:14:45.624506+0000","last_peered":"2024-05-07T11:14:45.624506+0000","last_clean":"2024-05-07T11:14:24.305202+0000","last_became_active":"2024-05-07T11:14:25.513744+0000","last_became_peered":"2024-05-07T11:14:25.513744+0000","last_unstale":"2024-05-07T11:14:45.624506+0000","last_undegraded":"2024-05-07T11:14:25.505486+0000","last_fullsized":"2024-05-07T11:14:25.505394+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:24:19.027729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":59,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":59}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.622421+0000","last_change":"2024-05-07T11:14:25.524605+0000","last_active":"2024-05-07T11:14:45.622421+0000","last_peered":"2024-05-07T11:14:45.622421+0000","last_clean":"2024-05-07T11:14:21.981288+0000","last_became_active":"2024-05-07T11:14:25.524605+0000","last_became_peered":"2024-05-07T11:14:25.524605+0000","last_unstale":"2024-05-07T11:14:45.622421+0000","last_undegraded":"2024-05-07T11:14:45.622421+0000","last_fullsized":"2024-05-07T11:14:25.506148+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:52:42.790800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":174,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-07T11:14:46.117371+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:14:46.117371+0000","last_peered":"2024-05-07T11:14:46.117371+0000","last_clean":"2024-05-07T11:14:46.117371+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:14:46.117371+0000","last_undegraded":"2024-05-07T11:14:46.117371+0000","last_fullsized":"2024-05-07T11:14:46.117371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'151","reported_seq":262,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622406+0000","last_change":"2024-05-07T11:14:25.509161+0000","last_active":"2024-05-07T11:14:45.622406+0000","last_peered":"2024-05-07T11:14:45.622406+0000","last_clean":"2024-05-07T11:14:24.444615+0000","last_became_active":"2024-05-07T11:14:25.509161+0000","last_became_peered":"2024-05-07T11:14:25.509161+0000","last_unstale":"2024-05-07T11:14:45.622406+0000","last_undegraded":"2024-05-07T11:14:25.503746+0000","last_fullsized":"2024-05-07T11:14:25.503676+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:40:06.497982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371216,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":54,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":54}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.622333+0000","last_change":"2024-05-07T11:14:25.506043+0000","last_active":"2024-05-07T11:14:45.622333+0000","last_peered":"2024-05-07T11:14:45.622333+0000","last_clean":"2024-05-07T11:14:21.487723+0000","last_became_active":"2024-05-07T11:14:25.506043+0000","last_became_peered":"2024-05-07T11:14:25.506043+0000","last_unstale":"2024-05-07T11:14:45.622333+0000","last_undegraded":"2024-05-07T11:14:45.622333+0000","last_fullsized":"2024-05-07T11:14:25.502814+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:44:27.621815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":78,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621818+0000","last_change":"2024-05-07T11:14:36.576013+0000","last_active":"2024-05-07T11:14:45.621818+0000","last_peered":"2024-05-07T11:14:45.621818+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"2024-05-07T11:14:25.523609+0000","last_became_peered":"2024-05-07T11:14:25.523609+0000","last_unstale":"2024-05-07T11:14:45.621818+0000","last_undegraded":"2024-05-07T11:14:36.003354+0000","last_fullsized":"2024-05-07T11:14:25.503696+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:49.836669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'164","reported_seq":205,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622526+0000","last_change":"2024-05-07T11:14:25.508314+0000","last_active":"2024-05-07T11:14:45.622526+0000","last_peered":"2024-05-07T11:14:45.622526+0000","last_clean":"2024-05-07T11:14:24.445283+0000","last_became_active":"2024-05-07T11:14:25.508314+0000","last_became_peered":"2024-05-07T11:14:25.508314+0000","last_unstale":"2024-05-07T11:14:45.622526+0000","last_undegraded":"2024-05-07T11:14:25.503310+0000","last_fullsized":"2024-05-07T11:14:25.503231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:37:50.673794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":56,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":56}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-07T11:14:45.624770+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:14:45.624770+0000","last_peered":"2024-05-07T11:14:45.624770+0000","last_clean":"2024-05-07T11:14:45.624770+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:14:45.624770+0000","last_undegraded":"2024-05-07T11:14:45.624770+0000","last_fullsized":"2024-05-07T11:14:45.624770+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":111,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.623009+0000","last_change":"2024-05-07T11:14:25.518760+0000","last_active":"2024-05-07T11:14:45.623009+0000","last_peered":"2024-05-07T11:14:45.623009+0000","last_clean":"2024-05-07T11:14:21.981639+0000","last_became_active":"2024-05-07T11:14:25.518760+0000","last_became_peered":"2024-05-07T11:14:25.518760+0000","last_unstale":"2024-05-07T11:14:45.623009+0000","last_undegraded":"2024-05-07T11:14:45.623009+0000","last_fullsized":"2024-05-07T11:14:25.506539+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:42:37.945761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'142","reported_seq":183,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621669+0000","last_change":"2024-05-07T11:14:25.512856+0000","last_active":"2024-05-07T11:14:45.621669+0000","last_peered":"2024-05-07T11:14:45.621669+0000","last_clean":"2024-05-07T11:14:24.363205+0000","last_became_active":"2024-05-07T11:14:25.512856+0000","last_became_peered":"2024-05-07T11:14:25.512856+0000","last_unstale":"2024-05-07T11:14:45.621669+0000","last_undegraded":"2024-05-07T11:14:25.504766+0000","last_fullsized":"2024-05-07T11:14:25.504685+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:51:57.408421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":61,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":61}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":51,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.624691+0000","last_change":"2024-05-07T11:14:25.514699+0000","last_active":"2024-05-07T11:14:45.624691+0000","last_peered":"2024-05-07T11:14:45.624691+0000","last_clean":"2024-05-07T11:14:06.399595+0000","last_became_active":"2024-05-07T11:14:25.514699+0000","last_became_peered":"2024-05-07T11:14:25.514699+0000","last_unstale":"2024-05-07T11:14:45.624691+0000","last_undegraded":"2024-05-07T11:14:45.624691+0000","last_fullsized":"2024-05-07T11:14:25.506098+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:28:07.373820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.622125+0000","last_change":"2024-05-07T11:14:25.503410+0000","last_active":"2024-05-07T11:14:45.622125+0000","last_peered":"2024-05-07T11:14:45.622125+0000","last_clean":"2024-05-07T11:14:21.487688+0000","last_became_active":"2024-05-07T11:14:25.503410+0000","last_became_peered":"2024-05-07T11:14:25.503410+0000","last_unstale":"2024-05-07T11:14:45.622125+0000","last_undegraded":"2024-05-07T11:14:45.622125+0000","last_fullsized":"2024-05-07T11:14:25.502280+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:12:51.719645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'150","reported_seq":256,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621239+0000","last_change":"2024-05-07T11:14:25.510438+0000","last_active":"2024-05-07T11:14:45.621239+0000","last_peered":"2024-05-07T11:14:45.621239+0000","last_clean":"2024-05-07T11:14:24.425940+0000","last_became_active":"2024-05-07T11:14:25.510438+0000","last_became_peered":"2024-05-07T11:14:25.510438+0000","last_unstale":"2024-05-07T11:14:45.621239+0000","last_undegraded":"2024-05-07T11:14:25.502466+0000","last_fullsized":"2024-05-07T11:14:25.502388+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:43.660590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":41,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":41}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.621460+0000","last_change":"2024-05-07T11:14:25.508388+0000","last_active":"2024-05-07T11:14:45.621460+0000","last_peered":"2024-05-07T11:14:45.621460+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"2024-05-07T11:14:25.508388+0000","last_became_peered":"2024-05-07T11:14:25.508388+0000","last_unstale":"2024-05-07T11:14:45.621460+0000","last_undegraded":"2024-05-07T11:14:45.621460+0000","last_fullsized":"2024-05-07T11:14:25.503573+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:44:43.648955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.623110+0000","last_change":"2024-05-07T11:14:25.510433+0000","last_active":"2024-05-07T11:14:45.623110+0000","last_peered":"2024-05-07T11:14:45.623110+0000","last_clean":"2024-05-07T11:14:06.399615+0000","last_became_active":"2024-05-07T11:14:25.510433+0000","last_became_peered":"2024-05-07T11:14:25.510433+0000","last_unstale":"2024-05-07T11:14:45.623110+0000","last_undegraded":"2024-05-07T11:14:45.623110+0000","last_fullsized":"2024-05-07T11:14:25.503553+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:41:31.604755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"60'171","reported_seq":277,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621320+0000","last_change":"2024-05-07T11:14:25.509053+0000","last_active":"2024-05-07T11:14:45.621320+0000","last_peered":"2024-05-07T11:14:45.621320+0000","last_clean":"2024-05-07T11:14:24.359964+0000","last_became_active":"2024-05-07T11:14:25.509053+0000","last_became_peered":"2024-05-07T11:14:25.509053+0000","last_unstale":"2024-05-07T11:14:45.621320+0000","last_undegraded":"2024-05-07T11:14:25.503232+0000","last_fullsized":"2024-05-07T11:14:25.503157+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:16:46.411202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115454,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":49,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":49}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":50,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622912+0000","last_change":"2024-05-07T11:14:25.509190+0000","last_active":"2024-05-07T11:14:45.622912+0000","last_peered":"2024-05-07T11:14:45.622912+0000","last_clean":"2024-05-07T11:14:21.981929+0000","last_became_active":"2024-05-07T11:14:25.509190+0000","last_became_peered":"2024-05-07T11:14:25.509190+0000","last_unstale":"2024-05-07T11:14:45.622912+0000","last_undegraded":"2024-05-07T11:14:25.503580+0000","last_fullsized":"2024-05-07T11:14:25.503505+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:18:50.438255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.622044+0000","last_change":"2024-05-07T11:14:25.508194+0000","last_active":"2024-05-07T11:14:45.622044+0000","last_peered":"2024-05-07T11:14:45.622044+0000","last_clean":"2024-05-07T11:12:37.690802+0000","last_became_active":"2024-05-07T11:14:25.508194+0000","last_became_peered":"2024-05-07T11:14:25.508194+0000","last_unstale":"2024-05-07T11:14:45.622044+0000","last_undegraded":"2024-05-07T11:14:45.622044+0000","last_fullsized":"2024-05-07T11:14:25.502663+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:09:38.235810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"60'167","reported_seq":263,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-07T11:14:45.621759+0000","last_change":"2024-05-07T11:13:25.248884+0000","last_active":"2024-05-07T11:14:45.621759+0000","last_peered":"2024-05-07T11:14:45.621759+0000","last_clean":"2024-05-07T11:14:45.621759+0000","last_became_active":"2024-05-07T11:13:25.248619+0000","last_became_peered":"2024-05-07T11:13:25.248619+0000","last_unstale":"2024-05-07T11:14:45.621759+0000","last_undegraded":"2024-05-07T11:14:45.621759+0000","last_fullsized":"2024-05-07T11:14:45.621759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:58.340411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'30","reported_seq":97,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624402+0000","last_change":"2024-05-07T11:14:25.514987+0000","last_active":"2024-05-07T11:14:45.624402+0000","last_peered":"2024-05-07T11:14:45.624402+0000","last_clean":"2024-05-07T11:14:24.058154+0000","last_became_active":"2024-05-07T11:14:25.514987+0000","last_became_peered":"2024-05-07T11:14:25.514987+0000","last_unstale":"2024-05-07T11:14:45.624402+0000","last_undegraded":"2024-05-07T11:14:25.505163+0000","last_fullsized":"2024-05-07T11:14:25.504747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:50:51.784350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.624341+0000","last_change":"2024-05-07T11:14:25.515728+0000","last_active":"2024-05-07T11:14:45.624341+0000","last_peered":"2024-05-07T11:14:45.624341+0000","last_clean":"2024-05-07T11:14:21.982219+0000","last_became_active":"2024-05-07T11:14:25.515728+0000","last_became_peered":"2024-05-07T11:14:25.515728+0000","last_unstale":"2024-05-07T11:14:45.624341+0000","last_undegraded":"2024-05-07T11:14:45.624341+0000","last_fullsized":"2024-05-07T11:14:25.507352+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:35:11.857210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'133","reported_seq":239,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621509+0000","last_change":"2024-05-07T11:14:25.510132+0000","last_active":"2024-05-07T11:14:45.621509+0000","last_peered":"2024-05-07T11:14:45.621509+0000","last_clean":"2024-05-07T11:14:24.398816+0000","last_became_active":"2024-05-07T11:14:25.510132+0000","last_became_peered":"2024-05-07T11:14:25.510132+0000","last_unstale":"2024-05-07T11:14:45.621509+0000","last_undegraded":"2024-05-07T11:14:25.502702+0000","last_fullsized":"2024-05-07T11:14:25.502614+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:57:18.554787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":52,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":52}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"61'149","reported_seq":253,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621703+0000","last_change":"2024-05-07T11:14:25.516582+0000","last_active":"2024-05-07T11:14:45.621703+0000","last_peered":"2024-05-07T11:14:45.621703+0000","last_clean":"2024-05-07T11:14:24.414305+0000","last_became_active":"2024-05-07T11:14:25.516582+0000","last_became_peered":"2024-05-07T11:14:25.516582+0000","last_unstale":"2024-05-07T11:14:45.621703+0000","last_undegraded":"2024-05-07T11:14:25.504539+0000","last_fullsized":"2024-05-07T11:14:25.504435+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":60,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":60}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"58'42","reported_seq":148,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622877+0000","last_change":"2024-05-07T11:14:25.521243+0000","last_active":"2024-05-07T11:14:45.622877+0000","last_peered":"2024-05-07T11:14:45.622877+0000","last_clean":"2024-05-07T11:14:23.915212+0000","last_became_active":"2024-05-07T11:14:25.521243+0000","last_became_peered":"2024-05-07T11:14:25.521243+0000","last_unstale":"2024-05-07T11:14:45.622877+0000","last_undegraded":"2024-05-07T11:14:25.507526+0000","last_fullsized":"2024-05-07T11:14:25.507449+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:00.513307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'137","reported_seq":178,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624533+0000","last_change":"2024-05-07T11:14:25.516698+0000","last_active":"2024-05-07T11:14:45.624533+0000","last_peered":"2024-05-07T11:14:45.624533+0000","last_clean":"2024-05-07T11:14:24.380609+0000","last_became_active":"2024-05-07T11:14:25.516698+0000","last_became_peered":"2024-05-07T11:14:25.516698+0000","last_unstale":"2024-05-07T11:14:45.624533+0000","last_undegraded":"2024-05-07T11:14:25.506145+0000","last_fullsized":"2024-05-07T11:14:25.505515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:36.408881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":52,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":52}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":130,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624540+0000","last_change":"2024-05-07T11:14:25.513296+0000","last_active":"2024-05-07T11:14:45.624540+0000","last_peered":"2024-05-07T11:14:45.624540+0000","last_clean":"2024-05-07T11:14:23.090016+0000","last_became_active":"2024-05-07T11:14:25.513296+0000","last_became_peered":"2024-05-07T11:14:25.513296+0000","last_unstale":"2024-05-07T11:14:45.624540+0000","last_undegraded":"2024-05-07T11:14:25.505224+0000","last_fullsized":"2024-05-07T11:14:25.505149+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:35.053793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":51,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.624550+0000","last_change":"2024-05-07T11:14:25.515179+0000","last_active":"2024-05-07T11:14:45.624550+0000","last_peered":"2024-05-07T11:14:45.624550+0000","last_clean":"2024-05-07T11:14:06.399779+0000","last_became_active":"2024-05-07T11:14:25.515179+0000","last_became_peered":"2024-05-07T11:14:25.515179+0000","last_unstale":"2024-05-07T11:14:45.624550+0000","last_undegraded":"2024-05-07T11:14:45.624550+0000","last_fullsized":"2024-05-07T11:14:25.505436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'166","reported_seq":207,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621351+0000","last_change":"2024-05-07T11:14:25.509535+0000","last_active":"2024-05-07T11:14:45.621351+0000","last_peered":"2024-05-07T11:14:45.621351+0000","last_clean":"2024-05-07T11:14:24.467820+0000","last_became_active":"2024-05-07T11:14:25.509535+0000","last_became_peered":"2024-05-07T11:14:25.509535+0000","last_unstale":"2024-05-07T11:14:45.621351+0000","last_undegraded":"2024-05-07T11:14:25.502677+0000","last_fullsized":"2024-05-07T11:14:25.502575+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:44.066277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":64,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":64}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.623579+0000","last_change":"2024-05-07T11:14:25.513907+0000","last_active":"2024-05-07T11:14:45.623579+0000","last_peered":"2024-05-07T11:14:45.623579+0000","last_clean":"2024-05-07T11:14:23.087320+0000","last_became_active":"2024-05-07T11:14:25.513907+0000","last_became_peered":"2024-05-07T11:14:25.513907+0000","last_unstale":"2024-05-07T11:14:45.623579+0000","last_undegraded":"2024-05-07T11:14:45.623579+0000","last_fullsized":"2024-05-07T11:14:25.506440+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:15:39.126277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"60'150","reported_seq":191,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621081+0000","last_change":"2024-05-07T11:14:25.507412+0000","last_active":"2024-05-07T11:14:45.621081+0000","last_peered":"2024-05-07T11:14:45.621081+0000","last_clean":"2024-05-07T11:14:24.381417+0000","last_became_active":"2024-05-07T11:14:25.507412+0000","last_became_peered":"2024-05-07T11:14:25.507412+0000","last_unstale":"2024-05-07T11:14:45.621081+0000","last_undegraded":"2024-05-07T11:14:25.502326+0000","last_fullsized":"2024-05-07T11:14:25.502235+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:32:48.350947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":52,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":52}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"60'169","reported_seq":275,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.623210+0000","last_change":"2024-05-07T11:14:25.512754+0000","last_active":"2024-05-07T11:14:45.623210+0000","last_peered":"2024-05-07T11:14:45.623210+0000","last_clean":"2024-05-07T11:14:24.468775+0000","last_became_active":"2024-05-07T11:14:25.512754+0000","last_became_peered":"2024-05-07T11:14:25.512754+0000","last_unstale":"2024-05-07T11:14:45.623210+0000","last_undegraded":"2024-05-07T11:14:25.505388+0000","last_fullsized":"2024-05-07T11:14:25.505250+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:22.252086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":47,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":47}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":25,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.622589+0000","last_change":"2024-05-07T11:14:25.524559+0000","last_active":"2024-05-07T11:14:45.622589+0000","last_peered":"2024-05-07T11:14:45.622589+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"2024-05-07T11:14:25.524559+0000","last_became_peered":"2024-05-07T11:14:25.524559+0000","last_unstale":"2024-05-07T11:14:45.622589+0000","last_undegraded":"2024-05-07T11:14:45.622589+0000","last_fullsized":"2024-05-07T11:14:25.506592+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:02:13.837731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"59'147","reported_seq":187,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.623563+0000","last_change":"2024-05-07T11:14:25.514695+0000","last_active":"2024-05-07T11:14:45.623563+0000","last_peered":"2024-05-07T11:14:45.623563+0000","last_clean":"2024-05-07T11:14:24.298846+0000","last_became_active":"2024-05-07T11:14:25.514695+0000","last_became_peered":"2024-05-07T11:14:25.514695+0000","last_unstale":"2024-05-07T11:14:45.623563+0000","last_undegraded":"2024-05-07T11:14:25.505141+0000","last_fullsized":"2024-05-07T11:14:25.504747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:51.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61007,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":47,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":47}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-05-07T11:14:45.622178+0000","last_change":"2024-05-07T11:14:25.510975+0000","last_active":"2024-05-07T11:14:45.622178+0000","last_peered":"2024-05-07T11:14:45.622178+0000","last_clean":"2024-05-07T11:14:21.981144+0000","last_became_active":"2024-05-07T11:14:25.510975+0000","last_became_peered":"2024-05-07T11:14:25.510975+0000","last_unstale":"2024-05-07T11:14:45.622178+0000","last_undegraded":"2024-05-07T11:14:45.622178+0000","last_fullsized":"2024-05-07T11:14:25.503298+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:01:12.167223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'190","reported_seq":296,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.623210+0000","last_change":"2024-05-07T11:14:25.509514+0000","last_active":"2024-05-07T11:14:45.623210+0000","last_peered":"2024-05-07T11:14:45.623210+0000","last_clean":"2024-05-07T11:14:24.334782+0000","last_became_active":"2024-05-07T11:14:25.509514+0000","last_became_peered":"2024-05-07T11:14:25.509514+0000","last_unstale":"2024-05-07T11:14:45.623210+0000","last_undegraded":"2024-05-07T11:14:25.502742+0000","last_fullsized":"2024-05-07T11:14:25.502662+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:54:06.094004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":56,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":56}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":101,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621461+0000","last_change":"2024-05-07T11:14:30.317496+0000","last_active":"2024-05-07T11:14:45.621461+0000","last_peered":"2024-05-07T11:14:45.621461+0000","last_clean":"2024-05-07T11:14:06.399246+0000","last_became_active":"2024-05-07T11:14:25.510154+0000","last_became_peered":"2024-05-07T11:14:25.510154+0000","last_unstale":"2024-05-07T11:14:45.621461+0000","last_undegraded":"2024-05-07T11:14:30.312410+0000","last_fullsized":"2024-05-07T11:14:25.502769+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:04:59.516759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"61'154","reported_seq":265,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621930+0000","last_change":"2024-05-07T11:14:25.512203+0000","last_active":"2024-05-07T11:14:45.621930+0000","last_peered":"2024-05-07T11:14:45.621930+0000","last_clean":"2024-05-07T11:14:24.449814+0000","last_became_active":"2024-05-07T11:14:25.512203+0000","last_became_peered":"2024-05-07T11:14:25.512203+0000","last_unstale":"2024-05-07T11:14:45.621930+0000","last_undegraded":"2024-05-07T11:14:25.504237+0000","last_fullsized":"2024-05-07T11:14:25.503903+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:08:09.481125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":61,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":61}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":26,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621988+0000","last_change":"2024-05-07T11:14:27.507937+0000","last_active":"2024-05-07T11:14:45.621988+0000","last_peered":"2024-05-07T11:14:45.621988+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"2024-05-07T11:14:25.516625+0000","last_became_peered":"2024-05-07T11:14:25.516625+0000","last_unstale":"2024-05-07T11:14:45.621988+0000","last_undegraded":"2024-05-07T11:14:27.407526+0000","last_fullsized":"2024-05-07T11:14:25.505408+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"60'158","reported_seq":267,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.621531+0000","last_change":"2024-05-07T11:14:25.515542+0000","last_active":"2024-05-07T11:14:45.621531+0000","last_peered":"2024-05-07T11:14:45.621531+0000","last_clean":"2024-05-07T11:14:24.420543+0000","last_became_active":"2024-05-07T11:14:25.515542+0000","last_became_peered":"2024-05-07T11:14:25.515542+0000","last_unstale":"2024-05-07T11:14:45.621531+0000","last_undegraded":"2024-05-07T11:14:25.503696+0000","last_fullsized":"2024-05-07T11:14:25.503624+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:41.621224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":49,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":49}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":117,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622507+0000","last_change":"2024-05-07T11:14:25.519475+0000","last_active":"2024-05-07T11:14:45.622507+0000","last_peered":"2024-05-07T11:14:45.622507+0000","last_clean":"2024-05-07T11:14:21.981776+0000","last_became_active":"2024-05-07T11:14:25.519475+0000","last_became_peered":"2024-05-07T11:14:25.519475+0000","last_unstale":"2024-05-07T11:14:45.622507+0000","last_undegraded":"2024-05-07T11:14:25.507115+0000","last_fullsized":"2024-05-07T11:14:25.506745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:53.458094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'151","reported_seq":260,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624358+0000","last_change":"2024-05-07T11:14:25.515640+0000","last_active":"2024-05-07T11:14:45.624358+0000","last_peered":"2024-05-07T11:14:45.624358+0000","last_clean":"2024-05-07T11:14:24.442642+0000","last_became_active":"2024-05-07T11:14:25.515640+0000","last_became_peered":"2024-05-07T11:14:25.515640+0000","last_unstale":"2024-05-07T11:14:45.624358+0000","last_undegraded":"2024-05-07T11:14:25.504375+0000","last_fullsized":"2024-05-07T11:14:25.504297+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:27.550943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":57,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":57}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":74,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.624263+0000","last_change":"2024-05-07T11:14:25.513238+0000","last_active":"2024-05-07T11:14:45.624263+0000","last_peered":"2024-05-07T11:14:45.624263+0000","last_clean":"2024-05-07T11:12:44.045893+0000","last_became_active":"2024-05-07T11:14:25.513238+0000","last_became_peered":"2024-05-07T11:14:25.513238+0000","last_unstale":"2024-05-07T11:14:45.624263+0000","last_undegraded":"2024-05-07T11:14:25.504546+0000","last_fullsized":"2024-05-07T11:14:25.504193+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:59:10.378635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":3}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"60'157","reported_seq":263,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622262+0000","last_change":"2024-05-07T11:14:25.505681+0000","last_active":"2024-05-07T11:14:45.622262+0000","last_peered":"2024-05-07T11:14:45.622262+0000","last_clean":"2024-05-07T11:14:24.421364+0000","last_became_active":"2024-05-07T11:14:25.505681+0000","last_became_peered":"2024-05-07T11:14:25.505681+0000","last_unstale":"2024-05-07T11:14:45.622262+0000","last_undegraded":"2024-05-07T11:14:25.502790+0000","last_fullsized":"2024-05-07T11:14:25.502711+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:24.640854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155325,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":62,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":62}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":25,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622208+0000","last_change":"2024-05-07T11:14:33.573120+0000","last_active":"2024-05-07T11:14:45.622208+0000","last_peered":"2024-05-07T11:14:45.622208+0000","last_clean":"2024-05-07T11:12:42.024701+0000","last_became_active":"2024-05-07T11:14:25.508483+0000","last_became_peered":"2024-05-07T11:14:25.508483+0000","last_unstale":"2024-05-07T11:14:45.622208+0000","last_undegraded":"2024-05-07T11:14:31.931521+0000","last_fullsized":"2024-05-07T11:14:25.503086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:16:31.376575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"59'188","reported_seq":297,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.622306+0000","last_change":"2024-05-07T11:14:25.524170+0000","last_active":"2024-05-07T11:14:45.622306+0000","last_peered":"2024-05-07T11:14:45.622306+0000","last_clean":"2024-05-07T11:14:24.451073+0000","last_became_active":"2024-05-07T11:14:25.524170+0000","last_became_peered":"2024-05-07T11:14:25.524170+0000","last_unstale":"2024-05-07T11:14:45.622306+0000","last_undegraded":"2024-05-07T11:14:25.506378+0000","last_fullsized":"2024-05-07T11:14:25.506297+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:11:56.118436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103079,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":59,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":59}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":60,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-05-07T11:14:45.623277+0000","last_change":"2024-05-07T11:14:25.513805+0000","last_active":"2024-05-07T11:14:45.623277+0000","last_peered":"2024-05-07T11:14:45.623277+0000","last_clean":"2024-05-07T11:14:21.982090+0000","last_became_active":"2024-05-07T11:14:25.513805+0000","last_became_peered":"2024-05-07T11:14:25.513805+0000","last_unstale":"2024-05-07T11:14:45.623277+0000","last_undegraded":"2024-05-07T11:14:25.506513+0000","last_fullsized":"2024-05-07T11:14:25.506435+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:39:05.058213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":3}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26097683,"num_objects":3425,"num_object_clones":0,"num_object_copies":6850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3098,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10306,"num_write_kb":38368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33406976,"data_stored":27354749,"data_compressed":2528944,"data_compressed_allocated":2961408,"data_compressed_original":7733248,"omap_allocated":0,"internal_metadata":0},"log_size":9892,"ondisk_log_size":9892,"up":70,"acting":70,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41236517,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":28,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":421,"num_write_kb":40971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9383936,"data_stored":44878569,"data_compressed":6559421,"data_compressed_allocated":7876608,"data_compressed_original":43433984,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":35,"acting":35,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":9,"acting":9,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738397,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88552,"kb_used_data":35164,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94283288,"statfs":{"total":96636764160,"available":96546086912,"internally_reserved":0,"allocated":36007936,"data_stored":64715352,"data_compressed":8006899,"data_compressed_allocated":9519104,"data_compressed_original":46784512,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738392,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":688128,"data_stored":972847,"data_compressed":28169,"data_compressed_allocated":61440,"data_compressed_original":675840,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46920,"kb_used_data":7420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324920,"statfs":{"total":96636764160,"available":96588718080,"internally_reserved":0,"allocated":7598080,"data_stored":8148929,"data_compressed":1033557,"data_compressed_allocated":1282048,"data_compressed_original":4591616,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1093632,"data_stored":3486345,"data_compressed":498533,"data_compressed_allocated":659456,"data_compressed_original":3059712,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":155707,"data_compressed":18186,"data_compressed_allocated":24576,"data_compressed_original":102400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8187904,"data_stored":41236517,"data_compressed":6042702,"data_compressed_allocated":7192576,"data_compressed_original":40271872,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6025216,"data_stored":4551709,"data_compressed":554877,"data_compressed_allocated":647168,"data_compressed_original":1662976,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":21786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27287552,"data_stored":22781254,"data_compressed":1974067,"data_compressed_allocated":2314240,"data_compressed_original":6070272,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:14:49.580 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-backfill 4.3d 4.36 4.35 4.34 4.33 4.32 4.30 4.2e 4.2c 4.2a 4.29 4.25 4.17 3.10 4.8 3.e 4.a 3.b 4.d 4.e 4.7 4.4 4.3 3.7 3.15 4.11 3.1a 4.1c 3.1b 3.1c 3.1d 4.19 3.1e 3.1f 2024-05-07T11:14:49.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:49.673 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:49.672+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:49.687 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:49.687 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:49.696 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:49.705 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_510b35d4b766757579df5fd9efd2f892309f09e1/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_510b35d4b766757579df5fd9efd2f892309f09e1/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_510b35d4b766757579df5fd9efd2f892309f09e1/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi062 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=510b35d4b766757579df5fd9efd2f892309f09e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-05-07T11:14:49.945 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=633fd6f6766e462bb3d1b595d9f1158a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_510b35d4b766757579df5fd9efd2f892309f09e1/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_510b35d4b766757579df5fd9efd2f892309f09e1/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_510b35d4b766757579df5fd9efd2f892309f09e1/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi062 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=510b35d4b766757579df5fd9efd2f892309f09e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-05-07T11:14:49.947 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-07T11:14:49.956 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-07T11:14:49.956 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:14:49.957 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-07T11:14:49.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:49.962 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:49.961+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:49.963 INFO:teuthology.orchestra.run.smithi062.stderr:instructing pg(s) [4.19,4.2e] on osd.0 to force-backfill; instructing pg(s) [3.7,3.b,3.e,3.10,3.15,3.1a,3.1b,3.1c,3.1d,3.1e,3.1f,4.3,4.4,4.7,4.8,4.a,4.d,4.e,4.11,4.17,4.1c,4.25,4.29,4.2a,4.2c,4.30,4.32,4.33,4.34,4.35,4.36,4.3d] on osd.2 to force-backfill; 2024-05-07T11:14:49.963 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-05-07T11:14:49.979 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:14:49.979 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-07T11:14:50.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:14:50.063 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:50.062+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:50.068 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:50.068 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:50.077 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:50.104 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:50.105 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:50.105 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:50.141 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:50.142 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:50.145 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:50.145 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:50.164 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:50.163+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:50.225 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:50.225 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:50.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:50.225 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:50.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.225 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.226 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:50.226 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.717150876000002, 2024-05-07T11:14:50.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:50.226 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.226 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.226 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.227 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.227 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.227 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.227 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:50.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.227 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:50.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:50.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:50.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:50.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:50.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:50.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:50.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:50.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:50.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:50.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:50.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:50.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:50.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:50.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:50.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:50.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:50.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:50.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:50.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:50.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:50.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:50.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:50.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:50.236 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.236 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.237 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.237 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.237 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:50.237 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.717062794, 2024-05-07T11:14:50.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:50.238 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.238 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.238 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.238 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.239 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.239 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.239 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:50.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.239 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:50.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:50.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.241 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.241 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:50.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:50.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:50.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:50.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:50.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:50.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:50.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:50.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:50.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:50.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:50.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:50.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:50.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:50.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:50.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:50.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:50.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:50.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:50.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:50.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:50.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:50.248 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.248 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.248 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.249 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.249 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:50.249 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.708299666999999, 2024-05-07T11:14:50.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:50.249 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.249 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.249 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.249 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.250 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.250 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.250 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:50.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.250 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:50.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:50.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:50.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:50.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:50.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:50.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:50.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:50.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:50.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:50.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:50.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:50.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:50.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:50.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:50.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:50.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:50.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:50.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:50.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:50.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:50.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:50.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:50.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:50.259 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.259 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.259 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.260 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.260 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:50.260 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.70393662, 2024-05-07T11:14:50.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:50.260 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.260 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.260 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.261 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.261 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.261 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.261 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:50.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.261 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:50.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:50.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:50.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:50.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:50.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:50.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:50.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:50.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:50.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:50.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:50.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:50.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:50.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:50.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:50.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:50.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:50.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:50.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:50.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:50.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:50.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:50.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.270 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.270 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:50.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:50.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.270 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.271 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.271 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:50.271 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.701303783, 2024-05-07T11:14:50.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:50.271 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.271 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.272 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.272 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.272 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.272 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.272 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:50.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.272 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:50.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:50.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:50.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:50.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:50.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:50.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:50.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:50.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:50.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:50.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:50.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:50.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:50.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:50.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:50.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:50.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:50.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:50.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:50.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:50.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:50.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:50.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:50.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:50.281 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.281 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.282 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.282 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.282 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:50.282 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.697032880999998, 2024-05-07T11:14:50.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:50.283 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.283 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.283 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.283 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.283 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.283 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.283 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:50.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.284 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:50.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:50.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:50.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:50.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:50.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:50.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:50.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:50.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:50.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:50.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:50.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:50.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:50.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:50.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:50.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:50.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:50.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:50.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:50.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:50.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:50.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:50.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:50.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:50.293 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.293 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.293 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.294 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.294 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:50.294 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.687534673000002, 2024-05-07T11:14:50.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:50.294 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.294 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.295 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.295 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.295 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.295 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.295 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:50.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.295 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:50.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:50.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:50.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:50.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:50.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:50.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:50.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:50.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:50.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:50.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:50.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:50.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:50.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:50.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:50.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:50.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:50.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:50.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:50.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:50.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:50.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:50.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:50.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:50.304 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.304 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.304 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.305 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.305 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:50.305 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.684894404000001, 2024-05-07T11:14:50.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:50.305 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.305 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.305 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.305 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.306 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.306 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.306 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:50.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.306 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:50.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:50.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:50.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:50.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:50.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:50.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:50.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:50.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:50.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:50.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:50.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:50.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:50.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:50.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:50.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:50.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:50.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:50.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:50.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:50.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:50.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:50.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:50.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:50.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.315 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.315 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.315 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.315 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:50.315 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.674714946999998, 2024-05-07T11:14:50.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:50.316 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.316 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.316 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.316 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.316 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.316 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.316 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:50.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.316 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:50.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:50.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:50.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:50.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:50.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:50.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:50.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:50.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:50.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:50.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:50.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:50.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:50.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:50.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:50.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:50.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:50.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:50.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:50.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:50.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:50.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:50.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:50.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:50.325 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.325 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.325 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.325 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.325 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:50.326 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.660939475999999, 2024-05-07T11:14:50.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:50.326 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.326 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.326 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.326 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.326 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.327 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.327 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:50.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.327 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:50.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:50.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:50.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:50.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:50.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:50.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:50.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:50.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:50.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:50.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:50.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:50.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:50.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:50.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:50.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:50.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:50.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:50.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:50.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:50.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:50.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:50.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:50.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:50.335 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.336 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.336 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.336 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.336 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:50.336 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.654914415, 2024-05-07T11:14:50.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:50.337 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.337 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.337 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.337 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.337 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.337 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.337 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:50.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.338 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:50.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:50.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:50.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:50.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:50.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:50.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:50.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:50.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:50.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:50.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:50.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:50.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:50.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:50.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:50.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:50.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:50.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:50.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:50.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:50.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:50.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:50.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:50.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:50.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.347 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.347 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.347 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:50.348 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.654072425999999, 2024-05-07T11:14:50.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:50.348 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.348 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.348 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.348 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.348 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.348 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.349 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:50.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.349 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:50.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:50.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:50.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:50.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:50.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:50.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:50.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:50.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:50.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:50.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:50.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:50.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:50.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:50.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:50.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:50.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:50.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:50.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:50.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:50.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:50.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:50.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:50.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:50.358 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.358 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.358 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.358 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.359 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:50.359 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.651508127, 2024-05-07T11:14:50.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:50.359 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.359 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.359 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.359 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.359 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.360 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.360 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:50.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.360 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:50.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:50.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:50.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:50.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:50.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:50.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:50.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:50.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:50.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:50.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:50.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:50.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:50.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:50.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:50.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:50.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:50.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:50.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:50.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:50.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:50.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:50.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:50.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:50.369 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.369 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.369 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.369 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.370 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:50.370 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.650661778, 2024-05-07T11:14:50.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:50.370 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.370 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.370 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.370 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.370 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.371 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.371 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:50.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.371 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:50.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:50.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:50.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:50.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:50.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:50.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:50.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:50.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:50.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:50.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:50.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:50.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:50.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:50.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:50.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:50.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:50.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:50.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:50.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:50.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:50.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:50.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:50.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:50.380 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.380 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.380 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.380 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.380 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:50.381 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.646366302000001, 2024-05-07T11:14:50.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:50.381 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.381 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.381 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.381 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.382 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.382 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.382 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:50.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.382 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:50.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:50.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:50.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:50.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:50.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:50.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:50.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:50.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.386 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:50.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:50.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:50.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:50.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:50.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:50.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:50.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:50.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:50.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:50.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:50.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:50.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:50.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:50.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:50.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:50.391 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.391 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.391 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.392 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.392 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:50.392 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.643578503000001, 2024-05-07T11:14:50.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:50.392 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.392 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.392 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.393 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.393 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.393 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.393 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:50.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.393 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:50.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:50.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:50.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:50.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:50.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:50.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:50.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:50.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:50.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:50.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:50.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:50.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:50.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:50.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:50.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:50.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:50.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:50.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:50.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:50.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:50.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:50.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:50.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:50.402 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.402 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.403 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.405 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:50.405 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.642761063000002, 2024-05-07T11:14:50.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:50.405 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.405 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.406 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.406 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.406 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.406 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.406 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:50.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.406 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:50.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:50.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:50.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:50.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:50.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:50.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:50.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:50.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:50.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:50.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:50.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:50.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:50.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:50.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:50.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:50.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:50.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:50.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:50.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:50.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:50.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:50.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:50.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:50.416 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.416 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.416 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.417 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.417 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:50.417 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.640954673, 2024-05-07T11:14:50.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:50.417 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.418 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.418 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.418 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.418 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.418 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.418 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:50.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.419 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:50.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:50.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:50.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:50.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:50.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:50.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:50.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:50.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:50.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:50.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:50.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:50.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:50.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:50.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:50.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:50.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:50.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:50.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:50.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:50.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:50.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:50.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:50.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:50.427 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.427 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.428 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.428 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.428 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:50.428 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.633960226999999, 2024-05-07T11:14:50.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:50.429 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.429 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.429 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.429 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.429 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.429 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.429 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:50.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.430 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:50.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:50.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:50.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:50.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:50.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:50.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:50.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:50.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:50.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:50.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:50.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:50.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:50.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:50.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:50.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:50.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:50.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:50.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:50.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:50.439 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.439 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.439 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.439 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.440 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:50.440 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 25.620890725999999, 2024-05-07T11:14:50.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:50.440 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:50.440 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:50.440 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.440 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:50.441 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:50.441 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.441 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:50.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.441 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:50.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:50.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:50.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:50.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:50.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:50.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.443 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:50.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:50.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:50.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:50.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:50.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:50.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:50.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:50.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:50.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:50.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:50.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:50.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:50.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:50.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:50.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:50.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:50.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:50.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:50.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:50.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:50.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:50.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:50.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:50.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:50.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:50.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:50.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:50.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:50.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:50.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:50.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:50.450 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.450 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.451 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.451 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:50.451 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:50.451 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:50.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:14:50.454 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":62,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:14:48.620066+0000","last_up_change":"2024-05-07T11:14:24.488601+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.9276275634765625,"average_primary_affinity":0.93000000715255737,"average_primary_affinity_weighted":0.93000000715255737}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.9276275634765625,"average_primary_affinity":0.93000000715255737,"average_primary_affinity_weighted":0.93000000715255737}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9000000953674316,"score_stable":2.9000000953674316,"optimal_score":0.67000001668930054,"raw_score_acting":1.940000057220459,"raw_score_stable":1.940000057220459,"primary_affinity_weighted":0.9276275634765625,"average_primary_affinity":0.93000000715255737,"average_primary_affinity_weighted":0.93000000715255737}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.3299999237060547,"score_stable":2.3299999237060547,"optimal_score":0.67000001668930054,"raw_score_acting":1.559999942779541,"raw_score_stable":1.559999942779541,"primary_affinity_weighted":0.9276275634765625,"average_primary_affinity":0.93000000715255737,"average_primary_affinity_weighted":0.93000000715255737}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":0.397735595703125,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":46,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":0.7828826904296875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.7","osds":[2,1]},{"pgid":"4.0","osds":[2,0]},{"pgid":"4.8","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:14:50.454 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:50.455 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:50.452+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:50.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-07T11:12:41.627365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.9000000953674316, 'score_stable': 2.9000000953674316, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.940000057220459, 'raw_score_stable': 1.940000057220459, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-05-07T11:12:42.384664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.3299999237060547, 'score_stable': 2.3299999237060547, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.559999942779541, 'raw_score_stable': 1.559999942779541, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}] 2024-05-07T11:14:50.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-07T11:14:50.554 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:50.553+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:50.573 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:50.573 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:50.573 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:50.573 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:50.582 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:50.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T11:14:50.654 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:50.654+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:50.728 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:50.728 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:50.729 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:50.729 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:50.729 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:50.737 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:50.755 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:50.755+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:50.764 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-05-07T11:14:50.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-05-07T11:14:50.843 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:50.843 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:50.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:50.843 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:50.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.843 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:50.843 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:50.844 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.338924072000001, 2024-05-07T11:14:50.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:50.844 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.844 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.844 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.844 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.844 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.844 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.844 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:50.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.845 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:50.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:50.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:50.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:50.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:50.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:50.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:50.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:50.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:50.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:50.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:50.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:50.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:50.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:50.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:50.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:50.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:50.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:50.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:50.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:50.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:50.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:50.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:50.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:50.852 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.852 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.853 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.853 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.853 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:50.854 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.33480033, 2024-05-07T11:14:50.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:50.854 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.854 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.854 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.854 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.854 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.855 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.855 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:50.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.855 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:50.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:50.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:50.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:50.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:50.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:50.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:50.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:50.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:50.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:50.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:50.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:50.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:50.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:50.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:50.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:50.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:50.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:50.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:50.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:50.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:50.863 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.863 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.863 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.863 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.864 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:50.864 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.334751534999999, 2024-05-07T11:14:50.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:50.864 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.864 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.864 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.864 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.864 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.865 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.865 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:50.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.865 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:50.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:50.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:50.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:50.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:50.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:50.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:50.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:50.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:50.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:50.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:50.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:50.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:50.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:50.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:50.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:50.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:50.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:50.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:50.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:50.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:50.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:50.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:50.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:50.873 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.873 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.873 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.874 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.874 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:50.874 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.334718244000001, 2024-05-07T11:14:50.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:50.874 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.874 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.874 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.875 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.875 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.875 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.875 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:50.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.875 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:50.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:50.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:50.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:50.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:50.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:50.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:50.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:50.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:50.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:50.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:50.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:50.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:50.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:50.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:50.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:50.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:50.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:50.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:50.886 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.886 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.886 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.887 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.887 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:50.887 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.334261476000002, 2024-05-07T11:14:50.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:50.887 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.887 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.887 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.888 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.888 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.888 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.888 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:50.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.888 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:50.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:50.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:50.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:50.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:50.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:50.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.334226458, 2024-05-07T11:14:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:50.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:50.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:50.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:50.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:50.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:50.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:50.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:50.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:50.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:50.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:50.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:50.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:50.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:50.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:50.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:50.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.910 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.910 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.910 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:50.910 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.334203071000001, 2024-05-07T11:14:50.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:50.911 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.911 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.911 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.911 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.911 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.911 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.911 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:50.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.912 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:50.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:50.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:50.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:50.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:50.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:50.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:50.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:50.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:50.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:50.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:50.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:50.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:50.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:50.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:50.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:50.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:50.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:50.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:50.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:50.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:50.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:50.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:50.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:50.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.920 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.921 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.921 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:50.921 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.333407873999999, 2024-05-07T11:14:50.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:50.921 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.921 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.921 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.922 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.922 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:50.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.922 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:50.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:50.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:50.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:50.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:50.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:50.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:50.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:50.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:50.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:50.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:50.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:50.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:50.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:50.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:50.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:50.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:50.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:50.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:50.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:50.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:50.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:50.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:50.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:50.930 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.930 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.930 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.931 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.931 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:50.931 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.332465335999999, 2024-05-07T11:14:50.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:50.931 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.932 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.932 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.932 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.932 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.932 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.932 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:50.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.933 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:50.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:50.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:50.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:50.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:50.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:50.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:50.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:50.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:50.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:50.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:50.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:50.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:50.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:50.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:50.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:50.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:50.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:50.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:50.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:50.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:50.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:50.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:50.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:50.941 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.941 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.941 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.941 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.942 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:50.942 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.330570934000001, 2024-05-07T11:14:50.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:50.942 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.942 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.942 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.942 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.942 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.943 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.943 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:50.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.943 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:50.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:50.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:50.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:50.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:50.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:50.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:50.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:50.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:50.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:50.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:50.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:50.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.329497499999999, 2024-05-07T11:14:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.963 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:50.963 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.327697697000001, 2024-05-07T11:14:50.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:50.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:50.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:50.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:50.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:50.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:50.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:50.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:50.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:50.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:50.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:50.976 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.976 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.976 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.976 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.976 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:50.976 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.326761667, 2024-05-07T11:14:50.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:50.977 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.977 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.977 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.977 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.977 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.977 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.977 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:50.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.977 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:50.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:50.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:50.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:50.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:50.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:50.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:50.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:50.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:50.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:50.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:50.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:50.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:50.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:50.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:50.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:50.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:50.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:50.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:50.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:50.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:50.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:50.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:50.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:50.986 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.986 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.987 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.987 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.987 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:50.987 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.324035715000001, 2024-05-07T11:14:50.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:50.988 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.988 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.988 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.988 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.988 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.988 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.988 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:50.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.989 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:50.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:50.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:50.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:50.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:50.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:50.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:50.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:50.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:50.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:50.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:50.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:50.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:50.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:50.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:50.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:50.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:50.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:50.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:50.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:50.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:50.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:50.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:50.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:50.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:50.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:50.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:50.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:50.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:50.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:50.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:50.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:50.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:50.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:50.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:50.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:50.997 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.997 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:50.997 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:50.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.998 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:50.998 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:50.998 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.323189844000002, 2024-05-07T11:14:50.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:50.998 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:50.998 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:50.998 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:50.999 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:50.999 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:50.999 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:50.999 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:50.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:50.999 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:50.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:50.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:50.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:51.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:51.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:51.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:51.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:51.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:51.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:51.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:51.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:51.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:51.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:51.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:51.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:51.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:51.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:51.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:51.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:51.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:51.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:51.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:51.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:51.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:51.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:51.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:51.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:51.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:51.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:51.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:51.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:51.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:51.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:51.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:51.008 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.009 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:51.009 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.009 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.009 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:51.009 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.322382459, 2024-05-07T11:14:51.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:51.010 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:51.010 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:51.010 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.010 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:51.010 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:51.010 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.010 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:51.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.011 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:51.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:51.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:51.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:51.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:51.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:51.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:51.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:51.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:51.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:51.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:51.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:51.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:51.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:51.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:51.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:51.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:51.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:51.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:51.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:51.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:51.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:51.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:51.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:51.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:51.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:51.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:51.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:51.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:51.020 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.020 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:51.020 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.021 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.021 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:51.021 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.319589781000001, 2024-05-07T11:14:51.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:51.021 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:51.021 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:51.021 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.022 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:51.022 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:51.022 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.022 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:51.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.022 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:51.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:51.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:51.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:51.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:51.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:51.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:51.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:51.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:51.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:51.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:51.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:51.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:51.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:51.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:51.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:51.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:51.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:51.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:51.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:51.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:51.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:51.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:51.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:51.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:51.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:51.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:51.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:51.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:51.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:51.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:51.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:51.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:51.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:51.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.031 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:51.032 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.032 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.032 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:51.032 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.317138703000001, 2024-05-07T11:14:51.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:51.032 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:51.033 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:51.033 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.033 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:51.033 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:51.033 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.033 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:51.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.033 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:51.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:51.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:51.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:51.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:51.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:51.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:51.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:51.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:51.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:51.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:51.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:51.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:51.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:51.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:51.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:51.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:51.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:51.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:51.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:51.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:51.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:51.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:51.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:51.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:51.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:51.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:51.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:51.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:51.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:51.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:51.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:51.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:51.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:51.041 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.041 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:51.041 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.042 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.042 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:51.042 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.316240348000001, 2024-05-07T11:14:51.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:51.042 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:51.042 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:51.042 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.042 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:51.042 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:51.043 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.043 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:51.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.043 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:51.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:51.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:51.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:51.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:51.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:51.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:51.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:51.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:51.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:51.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:51.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:51.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:51.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:51.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:51.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:51.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:51.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:51.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:51.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:51.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:51.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:51.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:51.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:51.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:51.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:51.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:51.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:51.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:51.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:51.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:51.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:51.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:51.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:51.051 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.051 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:51.051 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.051 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.051 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:51.051 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.311940486000001, 2024-05-07T11:14:51.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:51.052 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:51.052 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:51.052 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.052 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:51.052 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:51.052 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.052 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:51.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.053 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:51.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:51.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:51.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:51.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:51.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:51.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:51.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:51.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:51.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:51.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:51.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:51.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:51.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:51.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:51.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:51.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:51.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:51.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:51.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:51.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:51.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:51.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:51.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:51.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:51.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:51.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:51.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:51.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:51.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:51.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:51.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:51.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:51.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:51.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:51.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:51.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:51.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:51.060 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.060 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:51.060 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.061 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:51.061 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:51.061 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:51.062 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:51.063 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:51.061+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:51.081 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2024-05-07T11:14:51.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-07T11:14:51.163 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:51.163+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:51.182 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:51.182 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:51.182 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:51.183 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:51.192 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:51.264 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:51.264+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:51.296 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:51.297 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:51.297 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:51.297 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:51.297 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:51.305 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:51.389 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:51.389+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:51.396 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2024-05-07T11:14:51.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-07T11:14:51.451 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:51.452 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:51.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:51.452 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:51.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.452 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.452 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:51.452 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.944065491, 2024-05-07T11:14:51.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:51.453 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.453 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.453 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.453 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.453 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.453 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.453 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:51.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.454 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:51.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:51.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:51.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:51.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:51.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:51.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:51.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:51.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:51.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:51.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:51.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:51.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:51.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:51.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:51.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:51.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:51.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:51.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:51.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:51.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:51.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:51.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:51.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:51.462 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.462 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.462 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.463 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.463 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:51.463 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.943977408999999, 2024-05-07T11:14:51.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:51.463 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.463 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.463 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.463 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.463 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.464 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.464 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:51.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.464 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:51.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:51.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:51.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:51.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:51.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:51.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:51.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:51.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:51.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:51.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:51.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:51.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:51.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:51.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:51.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:51.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:51.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:51.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:51.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:51.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:51.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:51.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:51.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:51.473 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.473 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.474 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.474 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.474 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:51.474 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.935214282, 2024-05-07T11:14:51.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:51.474 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.474 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.475 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.475 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.475 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.475 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.475 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:51.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.475 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:51.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:51.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:51.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:51.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:51.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:51.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:51.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:51.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:51.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:51.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:51.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:51.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:51.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:51.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:51.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:51.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:51.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:51.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:51.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:51.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:51.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:51.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:51.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:51.489 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.489 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.489 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.490 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.490 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:51.490 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.930851234999999, 2024-05-07T11:14:51.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:51.491 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.491 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.491 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.491 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.491 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.492 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.492 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:51.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.492 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:51.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:51.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:51.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:51.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:51.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:51.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:51.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:51.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:51.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:51.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:51.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:51.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:51.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:51.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:51.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:51.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:51.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:51.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:51.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:51.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:51.503 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.503 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.504 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.504 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.504 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:51.505 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.928218397999999, 2024-05-07T11:14:51.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:51.505 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.505 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.505 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.506 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.506 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.506 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.506 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:51.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.506 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:51.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:51.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.508 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:51.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:51.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:51.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:51.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:51.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:51.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.510 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:51.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:51.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.510 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:51.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:51.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:51.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:51.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:51.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:51.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:51.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:51.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:51.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:51.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:51.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:51.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.514 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.514 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:51.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:51.514 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.514 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.514 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.515 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.515 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:51.515 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.923947496, 2024-05-07T11:14:51.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:51.515 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:51.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:51.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:51.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:51.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:51.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:51.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:51.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:51.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:51.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:51.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:51.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:51.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:51.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:51.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:51.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:51.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:51.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:51.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:51.528 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.528 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.528 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.528 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.528 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:51.528 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.914449288, 2024-05-07T11:14:51.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:51.529 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.529 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.529 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.529 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.529 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.529 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.529 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:51.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.530 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:51.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:51.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:51.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:51.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:51.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:51.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:51.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:51.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:51.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:51.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:51.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:51.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:51.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:51.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:51.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:51.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:51.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:51.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:51.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:51.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:51.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:51.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:51.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:51.538 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.538 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.538 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.539 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.539 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:51.539 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.911809019, 2024-05-07T11:14:51.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:51.539 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.539 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.539 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.539 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.540 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.540 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.540 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:51.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.540 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:51.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:51.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:51.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:51.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:51.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:51.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:51.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:51.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:51.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:51.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:51.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:51.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:51.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:51.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:51.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:51.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:51.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:51.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:51.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:51.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:51.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:51.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:51.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:51.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.549 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.549 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.550 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:51.550 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.901629562, 2024-05-07T11:14:51.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:51.550 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.550 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.550 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.550 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.550 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.550 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.551 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:51.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.551 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:51.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:51.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:51.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:51.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:51.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:51.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:51.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:51.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:51.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:51.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:51.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:51.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:51.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:51.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:51.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:51.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:51.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:51.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:51.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:51.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:51.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:51.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:51.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:51.560 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.561 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.561 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.561 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.561 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:51.561 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.887854091000001, 2024-05-07T11:14:51.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:51.561 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.562 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.562 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.562 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.562 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.562 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.562 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:51.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.563 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:51.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:51.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:51.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:51.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:51.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:51.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:51.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:51.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:51.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:51.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:51.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:51.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.881829029999999, 2024-05-07T11:14:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.880987041000001, 2024-05-07T11:14:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:51.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:51.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:51.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:51.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:51.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:51.594 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.594 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.595 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.595 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.596 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:51.596 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.878422742000001, 2024-05-07T11:14:51.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:51.596 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.597 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.597 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.597 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.597 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.598 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.598 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:51.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.598 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:51.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:51.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:51.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:51.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:51.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:51.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:51.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:51.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:51.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:51.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:51.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:51.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:51.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:51.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:51.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:51.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:51.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:51.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:51.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:51.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:51.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:51.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:51.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:51.608 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.608 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.608 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.609 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.609 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:51.609 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.877576392999998, 2024-05-07T11:14:51.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:51.609 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.609 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.609 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.609 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.609 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.610 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.610 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:51.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.610 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:51.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:51.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:51.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:51.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:51.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:51.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:51.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:51.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:51.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:51.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:51.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:51.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:51.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:51.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:51.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:51.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:51.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:51.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:51.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:51.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:51.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:51.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:51.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:51.618 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.618 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.618 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.619 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.619 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:51.619 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.873280916999999, 2024-05-07T11:14:51.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:51.619 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.619 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.619 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.619 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.620 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.620 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.620 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:51.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.620 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:51.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:51.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:51.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:51.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:51.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:51.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:51.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:51.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:51.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:51.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:51.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:51.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:51.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:51.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:51.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:51.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:51.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:51.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:51.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:51.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:51.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:51.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:51.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:51.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.628 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.629 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.629 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:51.629 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.870493117999999, 2024-05-07T11:14:51.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:51.629 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.630 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.630 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.630 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.630 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.630 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.630 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:51.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.631 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:51.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:51.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:51.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:51.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:51.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:51.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:51.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:51.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:51.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:51.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:51.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:51.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:51.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:51.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:51.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:51.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:51.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:51.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:51.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:51.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:51.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:51.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:51.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:51.640 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.640 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.640 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.641 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.641 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:51.641 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.869675678, 2024-05-07T11:14:51.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:51.641 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.641 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.641 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.642 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.642 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.642 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.642 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:51.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.642 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:51.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:51.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:51.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:51.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:51.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:51.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:51.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:51.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:51.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:51.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:51.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:51.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:51.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:51.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:51.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:51.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:51.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:51.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:51.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:51.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:51.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:51.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:51.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:51.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.650 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.651 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.651 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:51.651 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.867869288000001, 2024-05-07T11:14:51.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:51.651 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.651 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.652 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.652 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.652 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.652 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.652 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:51.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.652 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:51.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:51.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:51.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:51.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:51.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:51.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:51.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:51.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:51.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:51.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:51.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:51.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:51.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:51.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:51.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:51.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:51.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:51.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:51.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:51.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:51.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:51.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:51.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:51.660 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.660 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.660 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.660 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.660 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:51.661 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.860874842000001, 2024-05-07T11:14:51.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:51.661 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.661 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.661 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.661 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.661 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.661 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.661 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:51.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.662 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:51.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:51.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:51.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:51.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:51.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:51.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:51.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:51.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:51.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:51.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:51.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:51.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:51.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:51.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:51.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:51.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:51.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:51.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:51.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:51.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:51.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:51.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:51.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:51.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.670 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.670 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:51.670 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:51.670 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 26.847805341000001, 2024-05-07T11:14:51.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:51.671 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:51.671 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:51.671 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:51.671 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:51.671 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:51.671 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:51.671 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:51.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.672 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:51.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:51.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:51.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:51.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:51.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:51.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:51.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:51.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:51.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:51.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:51.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:51.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:51.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:51.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:51.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:51.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:51.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:51.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:51.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:51.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:51.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:51.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:51.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:51.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:51.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:51.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:51.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:51.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:51.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:51.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:51.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:51.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:51.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:51.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:51.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:51.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:51.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:51.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:51.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:51.679 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.679 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.680 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.680 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:51.680 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:51.680 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:51.682 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-05-07T11:14:51.683 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:51.683 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:51.681+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:51.715 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2024-05-07T11:14:51.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-07T11:14:51.782 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:51.782+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:51.797 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:51.797 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:51.798 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:51.798 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:51.806 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:51.883 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:51.883+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:51.951 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:51.951 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:51.951 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:51.951 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:51.952 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:51.959 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:51.984 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:51.984+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:52.067 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:52.067 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:52.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:52.068 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:52.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.068 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:52.068 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:52.068 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.563967812000001, 2024-05-07T11:14:52.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:52.068 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.068 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.068 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.069 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.069 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.069 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.069 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:52.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.069 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:52.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:52.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:52.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:52.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:52.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:52.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:52.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:52.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:52.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:52.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:52.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:52.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:52.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:52.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:52.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:52.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:52.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:52.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:52.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:52.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:52.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:52.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:52.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:52.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.082 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.082 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.083 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.083 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:52.083 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.55984407, 2024-05-07T11:14:52.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:52.083 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.083 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.083 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.083 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.084 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.084 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.084 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:52.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.084 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:52.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:52.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:52.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:52.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:52.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:52.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:52.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:52.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:52.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:52.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:52.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:52.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:52.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:52.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:52.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:52.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:52.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:52.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:52.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:52.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:52.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:52.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:52.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:52.095 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.095 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.095 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.095 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.095 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:52.095 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.559795274999999, 2024-05-07T11:14:52.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:52.096 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.096 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.096 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.096 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.096 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.096 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.096 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:52.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.097 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:52.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:52.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:52.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:52.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:52.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:52.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:52.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:52.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:52.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:52.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:52.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:52.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:52.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:52.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:52.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:52.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:52.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:52.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:52.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:52.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:52.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:52.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:52.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:52.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.105 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.105 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.105 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:52.105 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.559761984000001, 2024-05-07T11:14:52.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:52.106 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.106 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.106 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.106 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.106 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.106 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.106 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:52.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.107 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:52.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:52.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:52.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:52.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:52.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:52.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:52.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:52.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:52.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:52.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:52.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:52.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:52.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:52.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:52.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:52.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:52.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:52.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:52.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:52.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:52.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:52.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:52.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:52.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.115 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.116 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.116 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:52.116 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.559305215999998, 2024-05-07T11:14:52.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:52.116 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.116 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.116 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.116 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.117 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.117 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.117 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:52.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.117 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:52.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:52.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:52.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:52.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:52.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:52.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:52.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:52.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:52.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:52.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:52.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:52.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:52.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:52.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:52.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:52.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:52.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:52.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:52.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:52.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:52.124 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.125 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.125 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.125 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.125 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:52.125 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.559270198, 2024-05-07T11:14:52.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:52.126 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.126 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.126 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.126 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.126 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.126 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.126 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:52.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.126 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:52.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:52.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:52.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:52.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:52.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:52.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:52.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:52.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:52.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:52.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:52.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:52.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:52.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:52.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:52.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:52.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:52.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:52.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:52.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:52.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:52.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:52.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:52.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:52.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.135 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.135 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.135 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:52.135 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.559246811000001, 2024-05-07T11:14:52.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:52.136 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.136 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.136 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.136 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.136 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.136 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.136 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:52.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.136 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:52.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:52.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:52.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:52.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:52.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:52.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:52.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:52.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:52.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:52.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:52.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:52.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:52.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:52.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:52.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:52.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:52.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:52.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:52.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:52.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:52.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:52.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:52.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:52.144 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.144 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.144 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.144 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.145 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:52.145 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.558451613999999, 2024-05-07T11:14:52.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:52.145 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.145 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.145 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.145 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.145 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.146 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.146 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:52.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.146 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:52.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.557509075999999, 2024-05-07T11:14:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:52.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:52.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:52.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.555614674000001, 2024-05-07T11:14:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.554541239999999, 2024-05-07T11:14:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.552741437000002, 2024-05-07T11:14:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.551805407, 2024-05-07T11:14:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.549079455000001, 2024-05-07T11:14:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.548233583999998, 2024-05-07T11:14:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.547426199, 2024-05-07T11:14:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.544633521000002, 2024-05-07T11:14:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.542182443000002, 2024-05-07T11:14:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:52.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:52.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:52.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:52.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:52.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:52.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:52.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:52.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:52.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:52.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:52.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:52.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:52.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:52.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:52.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:52.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:52.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:52.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:52.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:52.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:52.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:52.251 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.541284088000001, 2024-05-07T11:14:52.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:52.251 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.251 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.251 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.251 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.251 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.251 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.251 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:52.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.252 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:52.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:52.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:52.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:52.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:52.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:52.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:52.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:52.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:52.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:52.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:52.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:52.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:52.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:52.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:52.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:52.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:52.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:52.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:52.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:52.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:52.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:52.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:52.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:52.259 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.259 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.259 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.260 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:52.260 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:52.260 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.536984226000001, 2024-05-07T11:14:52.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:52.260 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:52.260 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:52.261 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:52.261 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:52.261 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:52.261 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:52.261 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:52.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.261 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:52.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:52.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:52.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:52.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:52.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:52.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:52.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:52.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:52.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:52.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:52.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:52.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:52.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:52.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:52.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:52.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:52.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:52.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:52.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:52.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:52.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:52.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:52.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:52.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:52.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:52.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:52.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:52.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:52.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:52.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:52.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:52.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:52.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:52.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:52.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:52.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:52.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:52.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:52.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:52.269 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.269 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.269 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.269 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:52.269 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:52.269 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:52.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:52.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~24s 2024-05-07T11:14:52.272 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2024-05-07T11:14:52.273 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:52.270+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:52.273 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-07T11:14:52.273 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-07T11:14:52.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:52.330 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:14:52.371 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:52.371+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:52.380 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:52.381 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:52.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:52.441 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:52.442 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:52.442 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:52.461 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:52.461 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:52.464 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:52.464 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:52.471 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:52.471+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:52.494 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:52.494 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:52.504 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:52.587 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:52.587+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:52.648 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:52.649 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:52.658 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:52.677 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:14:52.678 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":63,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:14:51.631215+0000","last_up_change":"2024-05-07T11:14:24.488601+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.9276275634765625,"average_primary_affinity":0.93000000715255737,"average_primary_affinity_weighted":0.93000000715255737}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.9276275634765625,"average_primary_affinity":0.93000000715255737,"average_primary_affinity_weighted":0.93000000715255737}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9000000953674316,"score_stable":2.9000000953674316,"optimal_score":0.67000001668930054,"raw_score_acting":1.940000057220459,"raw_score_stable":1.940000057220459,"primary_affinity_weighted":0.9276275634765625,"average_primary_affinity":0.93000000715255737,"average_primary_affinity_weighted":0.93000000715255737}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.3299999237060547,"score_stable":2.3299999237060547,"optimal_score":0.67000001668930054,"raw_score_acting":1.559999942779541,"raw_score_stable":1.559999942779541,"primary_affinity_weighted":0.9276275634765625,"average_primary_affinity":0.93000000715255737,"average_primary_affinity_weighted":0.93000000715255737}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":0.397735595703125,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":46,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6801","nonce":3051775179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6803","nonce":3051775179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6807","nonce":3051775179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3051775179},{"type":"v1","addr":"172.21.15.149:6805","nonce":3051775179}]},"public_addr":"172.21.15.149:6801/3051775179","cluster_addr":"172.21.15.149:6803/3051775179","heartbeat_back_addr":"172.21.15.149:6807/3051775179","heartbeat_front_addr":"172.21.15.149:6805/3051775179","state":["exists"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":0.7828826904296875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.7","osds":[2,1]},{"pgid":"4.0","osds":[2,0]},{"pgid":"4.8","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:14:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T11:12:36.979175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T11:12:37.110970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-07T11:12:41.627365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.9000000953674316, 'score_stable': 2.9000000953674316, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.940000057220459, 'raw_score_stable': 1.940000057220459, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-05-07T11:12:42.384664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.3299999237060547, 'score_stable': 2.3299999237060547, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.559999942779541, 'raw_score_stable': 1.559999942779541, 'primary_affinity_weighted': 0.9276275634765625, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.9300000071525574}}] 2024-05-07T11:14:52.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-07T11:14:52.703 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:52.703+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:52.766 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:52.767 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:52.774 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:52.774+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:52.776 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:52.875 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:52.875+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:52.921 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:52.921 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:52.929 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:52.976 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:52.975+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:52.990 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-05-07T11:14:53.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-05-07T11:14:53.074 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:53.075 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:53.077 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:53.077+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:53.083 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:53.178 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:53.177+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:53.191 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:53.191 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:53.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:53.279 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:53.279+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:53.302 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2024-05-07T11:14:53.316 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-07T11:14:53.345 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:53.345 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:53.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:53.399 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:53.398+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:53.460 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:53.461 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:53.471 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:53.516 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:53.516+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:53.577 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:53.578 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:53.581 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:53.580+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:53.586 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:53.620 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2024-05-07T11:14:53.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-07T11:14:53.681 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:53.681+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:53.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T11:14:53.730 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:53.731 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:53.739 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:53.782 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:53.781+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:53.883 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:53.882+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:53.883 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:53.883 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:53.892 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:53.945 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2024-05-07T11:14:53.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-07T11:14:53.983 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:53.983+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:54.000 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:54.000 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:54.008 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:54.084 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:54.084+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:54.154 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:54.154 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:54.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:54.206 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:54.206+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:54.268 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:54.268 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:54.270 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2024-05-07T11:14:54.277 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:54.284 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi062.front.sepia.ceph.com... 2024-05-07T11:14:54.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:14:54.284 DEBUG:teuthology.orchestra.run.smithi062:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-07T11:14:54.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[32748]: fuse finished with error 0 and tester_r 0 2024-05-07T11:14:54.317 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:54.317+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:54.318 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T11:14:54.386 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:54.385+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:54.416 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:54.416 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:54.425 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:54.465 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:54.487 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:54.487+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:54.530 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:54.530 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:54.539 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:54.588 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:54.588+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:54.598 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:54.598 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:54.598 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:54.616 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:54.617 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:54.620 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:54.620 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:54.647 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:54.647 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:54.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:54.648 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:54.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.648 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:54.648 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:54.648 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.143882174000002, 2024-05-07T11:14:54.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:54.649 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.649 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.649 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.649 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.649 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.649 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.649 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:54.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.649 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:54.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:54.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:54.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:54.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:54.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:54.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:54.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:54.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:54.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:54.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:54.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:54.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:54.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:54.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:54.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:54.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:54.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:54.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:54.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:54.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:54.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:54.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:54.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:54.660 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.660 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.660 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.660 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.660 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:54.660 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.139758432000001, 2024-05-07T11:14:54.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:54.661 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.661 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.661 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.661 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.661 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.661 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.661 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:54.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.662 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:54.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:54.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:54.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:54.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:54.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:54.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:54.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:54.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:54.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:54.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:54.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:54.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:54.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:54.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:54.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:54.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:54.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:54.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:54.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:54.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:54.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:54.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:54.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:54.673 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.673 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.673 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.674 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.675 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:54.675 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.139709636999999, 2024-05-07T11:14:54.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:54.676 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.676 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.676 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.676 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.677 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.677 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.677 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:54.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.677 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:54.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:54.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:54.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:54.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:54.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:54.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:54.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:54.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:54.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:54.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:54.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:54.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:54.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:54.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:54.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:54.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:54.687 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.687 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.687 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.688 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.688 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:54.688 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.139676346000002, 2024-05-07T11:14:54.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:54.688 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.688 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.688 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.688 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.139219577999999, 2024-05-07T11:14:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:54.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:54.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:54.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:54.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:54.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:54.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:54.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:54.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:54.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:54.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:54.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:54.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:54.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:54.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:54.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:54.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:54.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:54.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:54.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:54.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:54.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:54.710 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.710 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.710 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.710 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.710 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:54.711 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.13918456, 2024-05-07T11:14:54.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:54.711 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.711 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.711 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.711 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.711 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.711 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.712 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:54.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.712 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:54.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:54.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:54.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:54.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:54.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:54.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:54.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:54.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:54.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:54.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:54.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:54.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:54.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:54.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:54.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:54.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:54.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:54.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:54.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:54.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:54.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:54.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:54.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:54.719 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.719 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.719 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.720 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.720 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:54.720 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.139161173000002, 2024-05-07T11:14:54.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:54.720 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.720 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.720 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.721 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.721 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.721 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.721 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:54.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.721 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:54.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:54.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:54.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:54.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:54.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:54.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:54.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:54.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:54.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:54.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:54.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.138365975999999, 2024-05-07T11:14:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.137423437999999, 2024-05-07T11:14:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.135529036000001, 2024-05-07T11:14:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:54.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:54.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:54.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:54.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:54.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:54.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:54.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:54.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:54.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:54.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:54.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:54.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:54.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:54.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:54.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:54.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:54.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:54.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:54.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:54.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:54.760 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.760 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.760 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.761 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.761 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:54.761 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.134455601999999, 2024-05-07T11:14:54.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:54.761 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.761 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.761 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.761 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.761 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.762 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.762 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:54.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.762 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:54.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:54.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:54.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:54.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:54.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:54.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:54.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:54.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:54.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:54.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:54.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:54.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:54.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:54.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:54.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:54.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:54.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:54.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:54.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:54.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:54.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:54.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:54.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:54.770 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.770 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.770 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.132655798999998, 2024-05-07T11:14:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.131719769, 2024-05-07T11:14:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.128993817000001, 2024-05-07T11:14:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.128147945999999, 2024-05-07T11:14:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.127340561, 2024-05-07T11:14:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:54.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:54.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:54.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:54.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:54.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:54.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:54.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:54.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:54.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:54.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:54.819 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.820 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.820 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.820 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.820 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:54.820 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.124547883000002, 2024-05-07T11:14:54.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:54.820 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.821 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.821 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.821 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.821 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.821 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.821 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:54.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.821 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:54.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:54.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:54.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:54.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:54.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:54.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:54.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:54.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:54.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:54.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:54.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:54.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:54.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:54.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:54.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:54.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:54.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:54.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:54.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:54.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:54.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:54.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:54.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:54.829 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.829 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.829 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.830 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.830 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:54.830 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.122096805000002, 2024-05-07T11:14:54.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:54.830 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.831 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.831 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.831 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.831 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.831 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.831 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:54.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.831 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:54.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:54.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:54.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:54.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:54.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:54.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:54.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:54.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:54.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:54.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:54.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:54.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:54.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:54.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:54.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:54.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:54.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:54.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:54.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:54.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:54.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:54.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:54.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:54.840 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.840 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.840 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.840 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.841 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:54.841 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.121198450000001, 2024-05-07T11:14:54.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:54.841 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.841 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.841 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.841 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.841 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.842 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.842 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:54.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.842 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:54.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:54.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:54.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:54.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:54.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:54.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:54.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:54.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:54.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:54.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:54.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:54.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:54.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:54.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:54.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:54.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:54.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:54.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:54.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:54.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:54.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:54.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:54.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:54.850 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.850 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.850 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.851 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:54.851 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:54.851 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.116898588000002, 2024-05-07T11:14:54.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:54.851 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:54.851 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:54.851 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:54.852 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:54.852 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:54.852 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:54.852 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:54.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.852 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:54.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:54.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:54.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:54.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:54.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:54.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:54.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:54.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:54.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:54.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:54.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:54.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:54.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:54.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:54.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:54.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:54.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:54.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:54.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:54.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:54.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:54.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:54.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:54.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:54.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:54.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:54.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:54.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:54.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:54.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:54.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:54.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:54.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:54.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:54.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:54.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:54.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:54.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:54.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:54.860 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.860 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.860 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.860 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:54.860 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:54.860 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:54.862 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-05-07T11:14:54.863 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:54.863 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:54.861+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:54.963 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:54.963+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:54.965 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-05-07T11:14:54.965 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:14:54.965 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-05-07T11:14:54.965 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-05-07T11:14:54.965 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-05-07T11:14:54.966 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-05-07T11:14:54.969 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:54.969 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:54.970 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:54.970 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:54.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:55.064 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:55.063+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:55.072 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:55.072 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "" 2024-05-07T11:14:55.072 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:55.125 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:55.125 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:55.126 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:55.126 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:55.126 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:55.134 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:55.178 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:55.178+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:55.241 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:55.241 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:55.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:55.242 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:55.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.242 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.242 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:55.242 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.733730204, 2024-05-07T11:14:55.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:55.242 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.243 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.243 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.243 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.243 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.243 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.243 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:55.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.243 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:55.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:55.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:55.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:55.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:55.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:55.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:55.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:55.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:55.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:55.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:55.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:55.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:55.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:55.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:55.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:55.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:55.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:55.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:55.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:55.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:55.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:55.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:55.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:55.251 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.251 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.251 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.252 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.252 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:55.252 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.733642121999999, 2024-05-07T11:14:55.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:55.252 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.252 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.252 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.252 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.252 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.253 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.253 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:55.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.253 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:55.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:55.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:55.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:55.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:55.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:55.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:55.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:55.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:55.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:55.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:55.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:55.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:55.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:55.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:55.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:55.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:55.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:55.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:55.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:55.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:55.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:55.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:55.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:55.260 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.261 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.261 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.261 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.261 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:55.261 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.724878995000001, 2024-05-07T11:14:55.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:55.262 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.262 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.262 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.262 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.262 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.262 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.262 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:55.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.262 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:55.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:55.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:55.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:55.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:55.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:55.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:55.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:55.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:55.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:55.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:55.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:55.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:55.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:55.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:55.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:55.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:55.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:55.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:55.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:55.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:55.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:55.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.270 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.270 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:55.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:55.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.270 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.271 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.271 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:55.271 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.720515947999999, 2024-05-07T11:14:55.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:55.271 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.271 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.271 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.271 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.272 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.272 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.272 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:55.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.272 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.272 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:55.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:55.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:55.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:55.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:55.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:55.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:55.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:55.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:55.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:55.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.276 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:55.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:55.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:55.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:55.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:55.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:55.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:55.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:55.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:55.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:55.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:55.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:55.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:55.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:55.280 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.280 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.281 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.281 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.282 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:55.282 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.717883110999999, 2024-05-07T11:14:55.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:55.282 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.282 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.282 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.282 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.282 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.283 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.283 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:55.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.283 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:55.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:55.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:55.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:55.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:55.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:55.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.713612209000001, 2024-05-07T11:14:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.704114001000001, 2024-05-07T11:14:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.701473732, 2024-05-07T11:14:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.691294275000001, 2024-05-07T11:14:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.677518804000002, 2024-05-07T11:14:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.671493742999999, 2024-05-07T11:14:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:55.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:55.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:55.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:55.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:55.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:55.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:55.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:55.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:55.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:55.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:55.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:55.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.349 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.350 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.350 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.350 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:55.350 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.670651754000001, 2024-05-07T11:14:55.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:55.350 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.351 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.351 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.351 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.351 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.351 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.351 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:55.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.351 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:55.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:55.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:55.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:55.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:55.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:55.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:55.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:55.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:55.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:55.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:55.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:55.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:55.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:55.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:55.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:55.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:55.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:55.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:55.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:55.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:55.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:55.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:55.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:55.359 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.359 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.359 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.360 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.360 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:55.360 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.668087454999998, 2024-05-07T11:14:55.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:55.360 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.360 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.361 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.361 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.361 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.361 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.361 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:55.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.361 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:55.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:55.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:55.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:55.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:55.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:55.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:55.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:55.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:55.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:55.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:55.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:55.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:55.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:55.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:55.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:55.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:55.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:55.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:55.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:55.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:55.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:55.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:55.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:55.369 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.369 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.369 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.369 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.370 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:55.370 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.667241105999999, 2024-05-07T11:14:55.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:55.370 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.370 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.370 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.370 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.370 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.370 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.371 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:55.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.371 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:55.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:55.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:55.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:55.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:55.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:55.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:55.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:55.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:55.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:55.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:55.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:55.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:55.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:55.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:55.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:55.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:55.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:55.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:55.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:55.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:55.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:55.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:55.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:55.379 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.379 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.379 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.379 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.379 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:55.379 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.662945629999999, 2024-05-07T11:14:55.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:55.380 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.380 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.380 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.380 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.380 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.380 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.380 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:55.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.381 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:55.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:55.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:55.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:55.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:55.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:55.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:55.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:55.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:55.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:55.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:55.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:55.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:55.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:55.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:55.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:55.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.386 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:55.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:55.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:55.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:55.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:55.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:55.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:55.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:55.388 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.388 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.388 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.389 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.389 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:55.389 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.660157830999999, 2024-05-07T11:14:55.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:55.389 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.389 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.390 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.390 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.390 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.390 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.390 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:55.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.390 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:55.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:55.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:55.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:55.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:55.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:55.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:55.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:55.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:55.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:55.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:55.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:55.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:55.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:55.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:55.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:55.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:55.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:55.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:55.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:55.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:55.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:55.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:55.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:55.398 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.398 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.398 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.399 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.399 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:55.399 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.659340391000001, 2024-05-07T11:14:55.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:55.399 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.399 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.399 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.399 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.400 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.400 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.400 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:55.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.400 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:55.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:55.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:55.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:55.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:55.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:55.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:55.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:55.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:55.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:55.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:55.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:55.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:55.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:55.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:55.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:55.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:55.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:55.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:55.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:55.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:55.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:55.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:55.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:55.408 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.408 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.408 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.408 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.409 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:55.409 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.657534000999998, 2024-05-07T11:14:55.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:55.409 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.409 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.409 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.409 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.409 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.410 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.410 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:55.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.410 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:55.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:55.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:55.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:55.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:55.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:55.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:55.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:55.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:55.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:55.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:55.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:55.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:55.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:55.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:55.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:55.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:55.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:55.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:55.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:55.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:55.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:55.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:55.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:55.418 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.418 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.418 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.418 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.418 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:55.419 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.650539555000002, 2024-05-07T11:14:55.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:55.419 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.419 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.419 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.419 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.419 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.419 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.419 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:55.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.420 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:55.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:55.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:55.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:55.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:55.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:55.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:55.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:55.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:55.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:55.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:55.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:55.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:55.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:55.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:55.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:55.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:55.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:55.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:55.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:55.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:55.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:55.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:55.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:55.427 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.427 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.428 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.428 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.428 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:55.428 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 30.637470054000001, 2024-05-07T11:14:55.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:55.428 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:55.429 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:55.429 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.429 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:55.429 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:55.429 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.429 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:55.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.429 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:55.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:55.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:55.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:55.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:55.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:55.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:55.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:55.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:55.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:55.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:55.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:55.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:55.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:55.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:55.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:55.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:55.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:55.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:55.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:55.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:55.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:55.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:55.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:55.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:55.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:55.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:55.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:55.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:55.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:55.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:55.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:55.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:55.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:55.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:55.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:55.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:55.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:55.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.437 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.438 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:55.438 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:55.438 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:55.439 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:55.440 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:55.439+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:55.540 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:55.540+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:55.550 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:55.550 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:55.550 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:55.550 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:55.559 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:55.642 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:55.641+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:55.664 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:55.665 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:55.674 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:55.742 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:55.742+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:55.781 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:55.781 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:55.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:55.781 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:55.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.782 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:55.782 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:55.782 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.277778594000001, 2024-05-07T11:14:55.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:55.782 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.782 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.782 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.783 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.783 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.783 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.783 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:55.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.783 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:55.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:55.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:55.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:55.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:55.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:55.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:55.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:55.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:55.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:55.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:55.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:55.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:55.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:55.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:55.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:55.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:55.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:55.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:55.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:55.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:55.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:55.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:55.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:55.792 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.792 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.792 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.792 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.792 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:55.792 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.273654852, 2024-05-07T11:14:55.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:55.793 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.793 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.793 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.793 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.793 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.793 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.793 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:55.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.794 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:55.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:55.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:55.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:55.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:55.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:55.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:55.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:55.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:55.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:55.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:55.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:55.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:55.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:55.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:55.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:55.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:55.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:55.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:55.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:55.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:55.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:55.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:55.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:55.802 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.802 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.802 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.802 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.802 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:55.803 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.273606056999999, 2024-05-07T11:14:55.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:55.803 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.803 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.803 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.803 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.803 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.803 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.803 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:55.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.804 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:55.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:55.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:55.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:55.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:55.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:55.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:55.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:55.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:55.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:55.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:55.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:55.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:55.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:55.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:55.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:55.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:55.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:55.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:55.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:55.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:55.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:55.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:55.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:55.812 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.812 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.812 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.812 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.812 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:55.813 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.273572766000001, 2024-05-07T11:14:55.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:55.813 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.813 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.813 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.813 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.813 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.814 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.814 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:55.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.814 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:55.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:55.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:55.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:55.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:55.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:55.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:55.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:55.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:55.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:55.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:55.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:55.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:55.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:55.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:55.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:55.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:55.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:55.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:55.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:55.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:55.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:55.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:55.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:55.821 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.822 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.822 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.822 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.822 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:55.822 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.273115998000002, 2024-05-07T11:14:55.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:55.822 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.823 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.823 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.823 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.823 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.823 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.823 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:55.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.823 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:55.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:55.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:55.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:55.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:55.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:55.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:55.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:55.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:55.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:55.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:55.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:55.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:55.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:55.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:55.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:55.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:55.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:55.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:55.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:55.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:55.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:55.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:55.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:55.831 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.831 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.831 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.831 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.832 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:55.832 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.27308098, 2024-05-07T11:14:55.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:55.832 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.832 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.832 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.832 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.832 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.832 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.833 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:55.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.833 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:55.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:55.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:55.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:55.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:55.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:55.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:55.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:55.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:55.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:55.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:55.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:55.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:55.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:55.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:55.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:55.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:55.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:55.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:55.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:55.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:55.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:55.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:55.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:55.841 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.841 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.841 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.841 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.841 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:55.841 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.273057593000001, 2024-05-07T11:14:55.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:55.842 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.842 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.842 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.842 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.842 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.842 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.842 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:55.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.843 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:55.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:55.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:55.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:55.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:55.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:55.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:55.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:55.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:55.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:55.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:55.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:55.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:55.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:55.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:55.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:55.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:55.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:55.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:55.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:55.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:55.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:55.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:55.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:55.850 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.850 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.850 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.850 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.850 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:55.851 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.272262395999999, 2024-05-07T11:14:55.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:55.851 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.851 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.851 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.851 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.851 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.851 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.851 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:55.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.852 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:55.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:55.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:55.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:55.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:55.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:55.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:55.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:55.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:55.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:55.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:55.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:55.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:55.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:55.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:55.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:55.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:55.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:55.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:55.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:55.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:55.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:55.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:55.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:55.860 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.860 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.860 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.860 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.860 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:55.861 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.271319857999998, 2024-05-07T11:14:55.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:55.861 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.861 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.861 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.861 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.861 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.861 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.862 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:55.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.862 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:55.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:55.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:55.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:55.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:55.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:55.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:55.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:55.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:55.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:55.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:55.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:55.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:55.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:55.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:55.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:55.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:55.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:55.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:55.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:55.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:55.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:55.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:55.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:55.869 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.869 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.870 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.870 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.870 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:55.870 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.269425456, 2024-05-07T11:14:55.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:55.871 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.871 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.871 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.871 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.871 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.871 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.871 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:55.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.871 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:55.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:55.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:55.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:55.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:55.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:55.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:55.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:55.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:55.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:55.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:55.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:55.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:55.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:55.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:55.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:55.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:55.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:55.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:55.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:55.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:55.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:55.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:55.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:55.879 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.879 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.879 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.880 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.880 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:55.880 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.268352021999998, 2024-05-07T11:14:55.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:55.880 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.880 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.881 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.881 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.881 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.881 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.881 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:55.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.881 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:55.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:55.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:55.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:55.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:55.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:55.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:55.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:55.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:55.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:55.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:55.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:55.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:55.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:55.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:55.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:55.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:55.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:55.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:55.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:55.889 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.889 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.889 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.889 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.889 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:55.890 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.266552219000001, 2024-05-07T11:14:55.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:55.890 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.890 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.890 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.890 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.890 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.890 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.890 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:55.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.891 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:55.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:55.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:55.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:55.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:55.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:55.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:55.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:55.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:55.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:55.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:55.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:55.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:55.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:55.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:55.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:55.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:55.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:55.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:55.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:55.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:55.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:55.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:55.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:55.899 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.899 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.899 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.899 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.899 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:55.899 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.265616188999999, 2024-05-07T11:14:55.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:55.900 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.900 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.900 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.900 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.900 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.900 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.900 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:55.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.901 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:55.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:55.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:55.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:55.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:55.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:55.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:55.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:55.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:55.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:55.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:55.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:55.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:55.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:55.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:55.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:55.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:55.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:55.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:55.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:55.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:55.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:55.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:55.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:55.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.909 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.909 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.909 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:55.909 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.262890237000001, 2024-05-07T11:14:55.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:55.910 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.910 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.910 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.910 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.910 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.910 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.910 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:55.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.911 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:55.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:55.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:55.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:55.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:55.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:55.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:55.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:55.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:55.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:55.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:55.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:55.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:55.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:55.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:55.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:55.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:55.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:55.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:55.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:55.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:55.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:55.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:55.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:55.919 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.919 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.919 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.919 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.919 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:55.919 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.262044366000001, 2024-05-07T11:14:55.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:55.920 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.920 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.920 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.920 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.920 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.920 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.920 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:55.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.921 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:55.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:55.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:55.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:55.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:55.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:55.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:55.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:55.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:55.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:55.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:55.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:55.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:55.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:55.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:55.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:55.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:55.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:55.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:55.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:55.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:55.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:55.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:55.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:55.931 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.931 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.932 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.932 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.932 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:55.932 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.261236981, 2024-05-07T11:14:55.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:55.932 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.932 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.933 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.933 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.933 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.933 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.933 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:55.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.933 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:55.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:55.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:55.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:55.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:55.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:55.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:55.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:55.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:55.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:55.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:55.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:55.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:55.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:55.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:55.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:55.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:55.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:55.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:55.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:55.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:55.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:55.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:55.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:55.941 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.941 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.941 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.942 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.942 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:55.942 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.258444303000001, 2024-05-07T11:14:55.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:55.942 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.942 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.942 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.943 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.943 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.943 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.943 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:55.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.943 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:55.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:55.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:55.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:55.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:55.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:55.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:55.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:55.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:55.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:55.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:55.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:55.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:55.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:55.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:55.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:55.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:55.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:55.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:55.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:55.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:55.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:55.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:55.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:55.951 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.951 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.951 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.952 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.952 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:55.952 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.255993225000001, 2024-05-07T11:14:55.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:55.952 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.952 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.953 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.953 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.953 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.953 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.953 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:55.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.953 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:55.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:55.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:55.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:55.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:55.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:55.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:55.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:55.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:55.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:55.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:55.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:55.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:55.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:55.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:55.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:55.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:55.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:55.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:55.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:55.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:55.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:55.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:55.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:55.961 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.961 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.961 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.961 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.961 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:55.962 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.255094870000001, 2024-05-07T11:14:55.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:55.962 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.962 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.962 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.962 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.962 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.962 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.963 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:55.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.963 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:55.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:55.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:55.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:55.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:55.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:55.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:55.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:55.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:55.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:55.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:55.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:55.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:55.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:55.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:55.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:55.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:55.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:55.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:55.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:55.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:55.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:55.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:55.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:55.971 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.971 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.971 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.971 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:55.971 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:55.972 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.250795008000001, 2024-05-07T11:14:55.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:55.972 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:55.972 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:55.972 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:55.972 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:55.972 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:55.972 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:55.972 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:55.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.973 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:55.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:55.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:55.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:55.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:55.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:55.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:55.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:55.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:55.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:55.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:55.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:55.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:55.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:55.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:55.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:55.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:55.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:55.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:55.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:55.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:55.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:55.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:55.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:55.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:55.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:55.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:55.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:55.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:55.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:55.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:55.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:55.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:55.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:55.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:55.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:55.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:55.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:55.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:55.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:55.981 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.981 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.981 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.981 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:55.981 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:55.981 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:55.983 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:55.982+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:55.983 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:56.083 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:56.083+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:56.094 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:56.094 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:56.094 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:56.094 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:56.102 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:56.184 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:56.183+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:56.207 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:56.208 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:56.216 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:56.301 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:56.301+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:56.362 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.854701297999998, 2024-05-07T11:14:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.854613216000001, 2024-05-07T11:14:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.845850088999999, 2024-05-07T11:14:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.841487042000001, 2024-05-07T11:14:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.838854205000001, 2024-05-07T11:14:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.834583302999999, 2024-05-07T11:14:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.825085094999999, 2024-05-07T11:14:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.822444826000002, 2024-05-07T11:14:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:56.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:56.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:56.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:56.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:56.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:56.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:56.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:56.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:56.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:56.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:56.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:56.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:56.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:56.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:56.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:56.442 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.442 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.442 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.442 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.442 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:56.443 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.812265368999999, 2024-05-07T11:14:56.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:56.443 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.443 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.443 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.443 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.443 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.443 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.443 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:56.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.444 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:56.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:56.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:56.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:56.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:56.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:56.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:56.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:56.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:56.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:56.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:56.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:56.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:56.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:56.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:56.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:56.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:56.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:56.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:56.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:56.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:56.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:56.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:56.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:56.451 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.451 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.452 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.452 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.452 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:56.452 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.798489898, 2024-05-07T11:14:56.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:56.452 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.452 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.453 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.453 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.453 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.453 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.453 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:56.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.453 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:56.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:56.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:56.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:56.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:56.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:56.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:56.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:56.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:56.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:56.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:56.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:56.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:56.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:56.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:56.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:56.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:56.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:56.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:56.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:56.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:56.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:56.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:56.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:56.463 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.463 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.463 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.463 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.463 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:56.463 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.792464837000001, 2024-05-07T11:14:56.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:56.464 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.464 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.464 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.464 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.464 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.464 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.464 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:56.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.465 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:56.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:56.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:56.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:56.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:56.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:56.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:56.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.791622847999999, 2024-05-07T11:14:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.789058549, 2024-05-07T11:14:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:56.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:56.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:56.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:56.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:56.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:56.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:56.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:56.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:56.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:56.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:56.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:56.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:56.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:56.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:56.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:56.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:56.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:56.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:56.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:56.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:56.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:56.495 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.495 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.495 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.496 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.496 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:56.496 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.7882122, 2024-05-07T11:14:56.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:56.496 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.496 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.496 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.496 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.497 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.497 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.497 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:56.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.497 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:56.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:56.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:56.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:56.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:56.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:56.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:56.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:56.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:56.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:56.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:56.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:56.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:56.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:56.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:56.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:56.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:56.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:56.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:56.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:56.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:56.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:56.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.508 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:56.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:56.508 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.508 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.509 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.509 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.510 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:56.510 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.783916724000001, 2024-05-07T11:14:56.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:56.510 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.511 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.511 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.511 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.512 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.512 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.512 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:56.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.513 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.513 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:56.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:56.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:56.516 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:56.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.516 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.516 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:56.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:56.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:56.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:56.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:56.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:56.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:56.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:56.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:56.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:56.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:56.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:56.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:56.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:56.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.523 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.523 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.523 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:56.523 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.781128925000001, 2024-05-07T11:14:56.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:56.523 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.523 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:14:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:14:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.780311484999999, 2024-05-07T11:14:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:14:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:14:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:14:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:14:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:14:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:14:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:14:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:14:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:14:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:14:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:14:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:14:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:14:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:14:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:14:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:14:56.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:14:56.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:14:56.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:14:56.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:14:56.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:14:56.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:14:56.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:14:56.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:14:56.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:14:56.547 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.547 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.547 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.548 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.548 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:56.549 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.778505095, 2024-05-07T11:14:56.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:14:56.549 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.549 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.550 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.550 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.550 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.550 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.551 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:14:56.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.551 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:56.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:56.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:14:56.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:14:56.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:14:56.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:14:56.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:14:56.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:14:56.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:14:56.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:14:56.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:14:56.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:14:56.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:14:56.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:14:56.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:14:56.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:14:56.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:14:56.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:14:56.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:14:56.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:14:56.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:14:56.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:14:56.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:14:56.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:14:56.568 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.568 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.568 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.569 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.569 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:56.569 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.771510649, 2024-05-07T11:14:56.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:14:56.570 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.570 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.570 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.571 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.571 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.571 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.571 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:14:56.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.572 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:56.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:14:56.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:14:56.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:14:56.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:14:56.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:14:56.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:14:56.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:14:56.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:14:56.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:14:56.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:14:56.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:14:56.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:14:56.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:14:56.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:14:56.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:14:56.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:14:56.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:14:56.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:14:56.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:14:56.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:14:56.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:14:56.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:14:56.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:14:56.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.582 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.583 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:56.583 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:56.583 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.758441147999999, 2024-05-07T11:14:56.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:14:56.583 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:56.583 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:56.583 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:14:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:14:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:14:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:14:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:14:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:14:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:56.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:14:56.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:14:56.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:56.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:14:56.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:14:56.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:14:56.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:14:56.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:56.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:14:56.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:14:56.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:56.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:14:56.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:14:56.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:56.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:14:56.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:14:56.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:56.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:14:56.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:14:56.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:56.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:14:56.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:14:56.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:56.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:56.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:56.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:14:56.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:14:56.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.592 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:56.592 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:56.594 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:56.594 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:56.593+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:56.623 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T11:14:56.694 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:56.694+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:56.711 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:56.711 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:56.711 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:56.711 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:56.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:56.764 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:56.783 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:56.786 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:56.787 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:56.795 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:56.795+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:56.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T11:14:56.866 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:56.866 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:56.876 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:56.920 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:56.920+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:56.980 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:56.980 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:56.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:57.032 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:57.032+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:57.098 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:57.097+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:57.101 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:57.101 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:57.110 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:57.199 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:57.198+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:57.257 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:57.257 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:57.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:57.307 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:57.306+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:57.401 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:57.400+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:57.411 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:57.411 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:57.420 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:57.502 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:57.502+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:57.529 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:57.529 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:57.537 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:57.603 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:57.603+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:57.641 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:57.641 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:57.650 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:57.704 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:57.704+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:57.754 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:57.755 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:57.765 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:57.802 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-05-07T11:14:57.809 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:57.809+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:57.872 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:57.872 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:57.881 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:57.923 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:57.922+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:58.007 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:58.007+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:58.026 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:58.027 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:58.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:58.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2024-05-07T11:14:58.108 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:58.108+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:58.139 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:58.139 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:58.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:58.209 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:58.208+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:58.256 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:58.256 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:58.265 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:58.309 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:58.309+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:58.368 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:58.368 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:58.376 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:58.420 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:58.420+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:58.480 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:58.480 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:58.488 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:58.529 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:58.529+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:58.594 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:58.595 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:58.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:58.611 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:58.611+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:58.708 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:58.708 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:58.712 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:58.712+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:58.717 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:58.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T11:14:58.814 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:58.813+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:58.862 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-05-07T11:14:58.862 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T11:14:58.870 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:14:58.914 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:58.914+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:58.926 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-05-07T11:14:58.926 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T11:14:58.926 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-05-07T11:14:58.945 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-05-07T11:14:58.945 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T11:14:58.948 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T11:14:58.949 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T11:14:58.977 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:58.978 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:14:58.978 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:58.986 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:14:59.027 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:59.027+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:59.117 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:59.116+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:59.132 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:59.132 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:14:59.132 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:14:59.132 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:14:59.132 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:59.141 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:14:59.225 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:59.225+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:59.288 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:14:59.288 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:14:59.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:14:59.288 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:14:59.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.289 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:14:59.289 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:59.289 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.784795680000002, 2024-05-07T11:14:59.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:14:59.289 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.289 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.289 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.290 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.290 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.290 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.290 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:14:59.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.290 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:59.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:59.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:14:59.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:14:59.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:14:59.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:14:59.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:14:59.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:14:59.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:14:59.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:14:59.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:14:59.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:14:59.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:14:59.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:14:59.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:14:59.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:14:59.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:14:59.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:14:59.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:14:59.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:14:59.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:14:59.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:14:59.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:14:59.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:14:59.298 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.298 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.298 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.298 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.298 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:59.298 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.780671937999998, 2024-05-07T11:14:59.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:14:59.299 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.299 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.299 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.299 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.299 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.299 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.299 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:14:59.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.300 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:59.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:14:59.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:14:59.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:14:59.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:14:59.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:59.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:14:59.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:14:59.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:14:59.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:14:59.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:14:59.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:14:59.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:14:59.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:14:59.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:14:59.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:14:59.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:14:59.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:14:59.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:14:59.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:14:59.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:14:59.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:14:59.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:14:59.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:14:59.307 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.307 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.307 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.308 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.308 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:59.308 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.780623143, 2024-05-07T11:14:59.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:14:59.308 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.308 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.308 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.309 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.309 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.309 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.309 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:14:59.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.309 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:59.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:14:59.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:14:59.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:14:59.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:14:59.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:14:59.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:14:59.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:14:59.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:14:59.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:14:59.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:14:59.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:14:59.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:14:59.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:14:59.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:14:59.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:14:59.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:14:59.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:14:59.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:14:59.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:14:59.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:14:59.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:14:59.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:14:59.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:14:59.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.317 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.317 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.318 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:59.318 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.780589851999999, 2024-05-07T11:14:59.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:14:59.318 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.318 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.318 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.318 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.318 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.318 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.319 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:14:59.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.319 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:59.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:14:59.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:14:59.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:14:59.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:14:59.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:14:59.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:14:59.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:14:59.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:14:59.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:14:59.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:14:59.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:14:59.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:14:59.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:14:59.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:14:59.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:14:59.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:14:59.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:14:59.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:14:59.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:14:59.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:14:59.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:14:59.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:14:59.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:14:59.326 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.327 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.327 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.327 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.327 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:59.327 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.780133083999999, 2024-05-07T11:14:59.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:14:59.328 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.328 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.328 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.328 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.328 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.328 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.328 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:14:59.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.328 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:59.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:14:59.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:14:59.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:14:59.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:14:59.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:14:59.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:14:59.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:14:59.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:14:59.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:14:59.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:14:59.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:14:59.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:14:59.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:14:59.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:14:59.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:14:59.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:14:59.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:14:59.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:14:59.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:14:59.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:14:59.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:14:59.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:14:59.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:14:59.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.336 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.336 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.337 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:59.337 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.780098066000001, 2024-05-07T11:14:59.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:14:59.337 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.337 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.337 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.337 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.337 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.337 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.338 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:14:59.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.338 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:59.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:14:59.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:14:59.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:14:59.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:14:59.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:14:59.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:14:59.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:14:59.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:14:59.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:14:59.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:14:59.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:14:59.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:14:59.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:14:59.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:14:59.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:14:59.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:14:59.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:14:59.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:14:59.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:14:59.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:14:59.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:14:59.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:14:59.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:14:59.345 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.345 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.346 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.346 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.346 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:59.346 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.780074679000002, 2024-05-07T11:14:59.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:14:59.346 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.347 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.347 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.347 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.347 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.347 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.347 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:14:59.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.347 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:59.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:59.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:14:59.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:14:59.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:14:59.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:14:59.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:14:59.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:14:59.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:14:59.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:14:59.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:14:59.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:14:59.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:14:59.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:14:59.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:14:59.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:14:59.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:14:59.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:14:59.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:14:59.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:14:59.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:14:59.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:14:59.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:14:59.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:14:59.355 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.355 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.355 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.356 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.356 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:59.356 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.779279482, 2024-05-07T11:14:59.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:14:59.356 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.356 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.356 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.356 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.356 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.357 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.357 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:14:59.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.357 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:59.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:59.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:14:59.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:14:59.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:14:59.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:14:59.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:14:59.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:14:59.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:14:59.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:14:59.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:14:59.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:14:59.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:14:59.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:14:59.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:14:59.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:14:59.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:14:59.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:14:59.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:14:59.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:14:59.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:14:59.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:14:59.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:14:59.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:14:59.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.365 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.365 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.365 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:59.365 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.778336944000003, 2024-05-07T11:14:59.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:14:59.366 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.366 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.366 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.366 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.366 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.366 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.366 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:14:59.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.367 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:59.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:14:59.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:14:59.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:14:59.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:14:59.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:14:59.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:14:59.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:14:59.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:14:59.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:14:59.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:14:59.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:14:59.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:14:59.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:14:59.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:14:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:14:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:14:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:14:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:14:59.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:14:59.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:14:59.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:14:59.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:14:59.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:14:59.374 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.374 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.374 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.375 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.375 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:59.375 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.776442541999998, 2024-05-07T11:14:59.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:14:59.375 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.375 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.376 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.376 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.376 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.376 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.376 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:14:59.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.376 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:59.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:59.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:14:59.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:14:59.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:14:59.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:59.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:14:59.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:14:59.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:14:59.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:14:59.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:14:59.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:14:59.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:14:59.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:14:59.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:14:59.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:14:59.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:14:59.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:14:59.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:14:59.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:14:59.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:14:59.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:14:59.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:14:59.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:14:59.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.384 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.384 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.385 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:59.385 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.775369108, 2024-05-07T11:14:59.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:14:59.385 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.385 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.385 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.385 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.385 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.385 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.386 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:14:59.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.386 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:59.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:14:59.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:14:59.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:14:59.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:14:59.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:14:59.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:14:59.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:14:59.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:14:59.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:14:59.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:14:59.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:14:59.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:14:59.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:14:59.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:14:59.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:14:59.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:14:59.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:14:59.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:14:59.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:14:59.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:14:59.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:14:59.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:14:59.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:14:59.393 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.393 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.393 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.394 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.394 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:59.394 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.773569305000002, 2024-05-07T11:14:59.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:14:59.394 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.394 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.394 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.395 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.395 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.395 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.395 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:14:59.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.395 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:59.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:14:59.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:14:59.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:14:59.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:14:59.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:14:59.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:14:59.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:14:59.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:14:59.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:14:59.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:14:59.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:14:59.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:14:59.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:14:59.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:14:59.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:14:59.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:14:59.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:14:59.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:14:59.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:14:59.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:14:59.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:14:59.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:14:59.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:14:59.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.404 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.405 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.405 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:59.405 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.772633274999997, 2024-05-07T11:14:59.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:14:59.405 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.405 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.405 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.406 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.406 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:14:59.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.406 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:59.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:14:59.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:14:59.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:14:59.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:14:59.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:14:59.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:14:59.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:14:59.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:14:59.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:14:59.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:14:59.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:14:59.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:14:59.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:59.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:14:59.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:14:59.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:14:59.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:14:59.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:14:59.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:14:59.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:14:59.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:14:59.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:14:59.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:14:59.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.413 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.414 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.414 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:59.414 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.769907322999998, 2024-05-07T11:14:59.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:14:59.414 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.415 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.415 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.415 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.415 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.415 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.415 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:14:59.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.415 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:59.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:14:59.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:14:59.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:14:59.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:14:59.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:14:59.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:14:59.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:14:59.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:14:59.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:14:59.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:14:59.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:14:59.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:14:59.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:14:59.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:14:59.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:14:59.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:14:59.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:14:59.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:14:59.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:14:59.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:14:59.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:14:59.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:14:59.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:14:59.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.423 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.423 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.424 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:59.424 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.769061452000003, 2024-05-07T11:14:59.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:14:59.424 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.424 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.424 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.424 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.424 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.425 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.425 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:14:59.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.425 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:59.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:14:59.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:14:59.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:14:59.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:14:59.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:14:59.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:14:59.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:14:59.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:14:59.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:14:59.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:14:59.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:14:59.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:14:59.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:14:59.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:14:59.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:14:59.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:14:59.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:14:59.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:14:59.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:14:59.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:14:59.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:14:59.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:14:59.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:14:59.433 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.433 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.433 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.433 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.433 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:59.434 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.768254067000001, 2024-05-07T11:14:59.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:14:59.434 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.434 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.434 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.434 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.434 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.434 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.434 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:14:59.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.435 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:59.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:14:59.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:14:59.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:14:59.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:14:59.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:14:59.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:14:59.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:14:59.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:14:59.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:14:59.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:14:59.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:14:59.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:14:59.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:59.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:14:59.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:14:59.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:14:59.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:14:59.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:14:59.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:14:59.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:14:59.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:14:59.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:14:59.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:14:59.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.442 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.443 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.443 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:59.443 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.765461389000002, 2024-05-07T11:14:59.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:14:59.443 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.443 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.443 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.444 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.444 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:14:59.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.444 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:59.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:14:59.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:14:59.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:14:59.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:14:59.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:14:59.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:14:59.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:14:59.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:14:59.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:14:59.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:14:59.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:14:59.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:14:59.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:14:59.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:14:59.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:14:59.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:14:59.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:14:59.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:14:59.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:14:59.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:14:59.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:14:59.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:14:59.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:14:59.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.452 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.452 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.452 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:59.452 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.763010311000002, 2024-05-07T11:14:59.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:14:59.453 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.453 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.453 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.453 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.453 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.453 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.453 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:14:59.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.454 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:59.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:59.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:14:59.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:14:59.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:14:59.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:14:59.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:14:59.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:14:59.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:14:59.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:14:59.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:14:59.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:14:59.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:14:59.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:14:59.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:14:59.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:14:59.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:14:59.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:14:59.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:14:59.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:14:59.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:14:59.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:14:59.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:14:59.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:14:59.461 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.461 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.461 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.462 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.462 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:59.462 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.762111955999998, 2024-05-07T11:14:59.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:14:59.462 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.462 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.462 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.463 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.463 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.463 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.463 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:14:59.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.463 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:59.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:14:59.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:14:59.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:14:59.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:14:59.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:14:59.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:14:59.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:14:59.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:14:59.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:14:59.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:14:59.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:14:59.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:14:59.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:14:59.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:14:59.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:14:59.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:14:59.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:14:59.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:14:59.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:14:59.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:14:59.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:14:59.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:14:59.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:14:59.471 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.471 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.471 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.471 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.471 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:59.472 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 34.757812094000002, 2024-05-07T11:14:59.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:14:59.472 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:14:59.472 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:14:59.472 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.472 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:14:59.472 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:14:59.472 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.472 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:14:59.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.473 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:14:59.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:14:59.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:59.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:14:59.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:14:59.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:14:59.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:14:59.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:14:59.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:14:59.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:14:59.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:14:59.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:14:59.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:14:59.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:14:59.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:14:59.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:14:59.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:14:59.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:14:59.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:14:59.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:14:59.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:14:59.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:14:59.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:14:59.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:14:59.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:14:59.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:14:59.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:14:59.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:14:59.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:14:59.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:14:59.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:14:59.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:14:59.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:14:59.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:14:59.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:14:59.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:14:59.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:14:59.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:14:59.480 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.480 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.480 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.481 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:14:59.481 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:14:59.481 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:14:59.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:14:59.483 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:59.482+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:59.583 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:59.583+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:59.596 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:59.597 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:59.597 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:14:59.597 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:59.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:14:59.684 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:14:59.684+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:14:59.712 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:59.712 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:14:59.712 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:14:59.712 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:14:59.712 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:14:59.720 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:14:59.785 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:14:59.784+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:14:59.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:14:59.837 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:14:59.837 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:14:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:14:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:14:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.319247191999999, 2024-05-07T11:14:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:14:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:14:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:14:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:14:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:14:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:14:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:14:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:14:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:14:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:14:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:14:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:14:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:14:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:14:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:14:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:14:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:14:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:14:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:14:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:14:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:14:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:14:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:14:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:14:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:14:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.319159110000001, 2024-05-07T11:14:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:14:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:14:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:14:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:14:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:14:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:14:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:14:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:14:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:14:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:14:59.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:14:59.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:14:59.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:14:59.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:14:59.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:14:59.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:14:59.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:14:59.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:14:59.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:14:59.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:14:59.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:14:59.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:14:59.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:14:59.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:14:59.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:14:59.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.858 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.859 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.859 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.859 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:59.859 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.310395982999999, 2024-05-07T11:14:59.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:14:59.859 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.860 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.860 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.860 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.860 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.860 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.860 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:14:59.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.860 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:59.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:14:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:14:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:14:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:14:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:14:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:14:59.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:14:59.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:14:59.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:14:59.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:14:59.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:14:59.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:14:59.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:14:59.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:14:59.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:14:59.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:14:59.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:14:59.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:14:59.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:14:59.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:14:59.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:14:59.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:14:59.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:14:59.869 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.869 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.870 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.870 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.870 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:59.870 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.306032936000001, 2024-05-07T11:14:59.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:14:59.870 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.871 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.871 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.871 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.871 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.871 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.871 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:14:59.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.871 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:59.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:14:59.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:14:59.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:14:59.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:14:59.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:59.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:14:59.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:14:59.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:14:59.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:14:59.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:14:59.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:14:59.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:14:59.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:14:59.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:14:59.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:14:59.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:14:59.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:14:59.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:14:59.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:14:59.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:14:59.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:14:59.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:14:59.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:14:59.879 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.879 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.879 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.880 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.880 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:59.880 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.303400099000001, 2024-05-07T11:14:59.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:14:59.880 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.880 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.880 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:14:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:14:59.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:14:59.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:14:59.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:14:59.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:14:59.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:14:59.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:14:59.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:14:59.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:14:59.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:14:59.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:14:59.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:14:59.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:14:59.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:14:59.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:14:59.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:14:59.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:14:59.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:14:59.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:14:59.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:14:59.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:14:59.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:14:59.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:14:59.889 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.889 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.889 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.889 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.889 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:59.890 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.299129196999999, 2024-05-07T11:14:59.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:14:59.890 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.890 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.890 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.890 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.890 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.891 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.891 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:14:59.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.891 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:59.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:14:59.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:14:59.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:14:59.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:14:59.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:14:59.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:14:59.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:14:59.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:14:59.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:14:59.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:14:59.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:14:59.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:14:59.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:14:59.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:14:59.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:14:59.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:14:59.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:14:59.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:14:59.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:14:59.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:14:59.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:14:59.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:14:59.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:14:59.899 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.899 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.899 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.899 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.900 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:59.900 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.289630989000003, 2024-05-07T11:14:59.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:14:59.900 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.900 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.900 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.900 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.900 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.900 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.901 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:14:59.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.901 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:59.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:59.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:14:59.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:14:59.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:14:59.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:14:59.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:14:59.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:14:59.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:14:59.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:14:59.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:14:59.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:14:59.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:14:59.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:14:59.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:14:59.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:14:59.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:14:59.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:14:59.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:14:59.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:14:59.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:14:59.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:14:59.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:14:59.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:14:59.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.909 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.909 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.909 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:59.910 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.286990719999999, 2024-05-07T11:14:59.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:14:59.910 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.910 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.910 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.910 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.910 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.910 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.911 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:14:59.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.911 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:59.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:14:59.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:14:59.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:14:59.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:14:59.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:14:59.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:14:59.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:14:59.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:14:59.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:14:59.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:14:59.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:14:59.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:14:59.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:14:59.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:14:59.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:14:59.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:14:59.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:14:59.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:14:59.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:14:59.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:14:59.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:14:59.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:14:59.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:14:59.919 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.919 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.919 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.919 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.919 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:59.919 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.276811262999999, 2024-05-07T11:14:59.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:14:59.920 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.920 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.920 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.920 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.920 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.920 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.920 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:14:59.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.921 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:59.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:14:59.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:14:59.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:14:59.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:14:59.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:14:59.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:14:59.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:14:59.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:14:59.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:14:59.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:14:59.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:14:59.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:14:59.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:14:59.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:14:59.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:14:59.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:14:59.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:14:59.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:14:59.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:14:59.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:14:59.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:14:59.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:14:59.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:14:59.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.929 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.929 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.929 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:59.930 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.263035791999997, 2024-05-07T11:14:59.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:14:59.930 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.930 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.930 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.930 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.930 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.931 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.931 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:14:59.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.931 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:59.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:14:59.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:14:59.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:14:59.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:14:59.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:14:59.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:14:59.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:14:59.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:14:59.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:14:59.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:14:59.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:14:59.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:14:59.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:14:59.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:14:59.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:14:59.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:14:59.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:14:59.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:14:59.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:14:59.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:14:59.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:14:59.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:14:59.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:14:59.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.940 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.940 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.941 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:59.941 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.257010731000001, 2024-05-07T11:14:59.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:14:59.941 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.941 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.941 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.942 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:14:59.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.942 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:59.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:14:59.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:14:59.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:14:59.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:14:59.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:14:59.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:14:59.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:14:59.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:14:59.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:14:59.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:14:59.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:14:59.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:14:59.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:14:59.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:14:59.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:14:59.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:14:59.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:14:59.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:14:59.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:14:59.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:14:59.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:14:59.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:14:59.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:14:59.950 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.950 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.950 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.951 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.951 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:59.951 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.256168742, 2024-05-07T11:14:59.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:14:59.951 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.951 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.951 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.951 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.951 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.952 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.952 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:14:59.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.952 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:59.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:59.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:14:59.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:14:59.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:14:59.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:14:59.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:14:59.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:14:59.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:14:59.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:14:59.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:14:59.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:14:59.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:14:59.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:14:59.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:14:59.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:14:59.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:14:59.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:14:59.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:14:59.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:14:59.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:14:59.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:14:59.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:14:59.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:14:59.960 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.960 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.960 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.960 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.960 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:59.961 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.253604443, 2024-05-07T11:14:59.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:14:59.961 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.961 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.961 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.961 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.961 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.961 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.961 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:14:59.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.962 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:59.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:14:59.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:14:59.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:14:59.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:14:59.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:14:59.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:14:59.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:14:59.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:14:59.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:14:59.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:14:59.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:14:59.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:14:59.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:14:59.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:14:59.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:14:59.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:14:59.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:14:59.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:14:59.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:14:59.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:14:59.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:14:59.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:14:59.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:14:59.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.970 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.970 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.971 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:59.971 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.252758094000001, 2024-05-07T11:14:59.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:14:59.971 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.971 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.971 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.971 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.971 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.972 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.972 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:14:59.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.972 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:59.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:14:59.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:14:59.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:14:59.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:14:59.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:14:59.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:14:59.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:14:59.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:14:59.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:14:59.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:14:59.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:14:59.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:14:59.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:14:59.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:14:59.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:14:59.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:14:59.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:14:59.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:14:59.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:14:59.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:14:59.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:14:59.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:14:59.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:14:59.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.980 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.981 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.981 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:59.981 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.248462617999998, 2024-05-07T11:14:59.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:14:59.981 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.981 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.981 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.981 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.982 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.982 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.982 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:14:59.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.982 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:59.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:14:59.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:14:59.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:14:59.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:14:59.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:14:59.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:14:59.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:14:59.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:14:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:14:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:14:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:14:59.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:14:59.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:14:59.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:14:59.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:14:59.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:14:59.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:14:59.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:14:59.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:14:59.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:14:59.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:14:59.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:14:59.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:14:59.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:14:59.990 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.990 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:14:59.990 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:14:59.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.991 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:14:59.991 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:59.991 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.245674819000001, 2024-05-07T11:14:59.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:14:59.991 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:14:59.991 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:14:59.992 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:14:59.992 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:14:59.992 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:14:59.992 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:14:59.992 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:14:59.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.992 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:14:59.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:14:59.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:59.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:14:59.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:14:59.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:14:59.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:14:59.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:14:59.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:14:59.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:14:59.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:14:59.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:14:59.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:14:59.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:14:59.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:14:59.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:14:59.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:14:59.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:14:59.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:14:59.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:14:59.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:14:59.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:14:59.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:14:59.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:14:59.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:14:59.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:14:59.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:14:59.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:14:59.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:14:59.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:14:59.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:14:59.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:14:59.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:14:59.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:14:59.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:14:59.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:14:59.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:14:59.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:00.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:15:00.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:15:00.000 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.000 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:00.000 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.001 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.001 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:15:00.001 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.244857379000003, 2024-05-07T11:15:00.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:15:00.001 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:00.001 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:00.001 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.001 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:00.002 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:00.002 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.002 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:15:00.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.002 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:00.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:00.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:15:00.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:00.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:00.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:15:00.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:00.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:00.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:15:00.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:15:00.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:00.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:15:00.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:15:00.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:00.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:15:00.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:15:00.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:15:00.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:15:00.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:00.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:15:00.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:15:00.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:15:00.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:15:00.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:00.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:15:00.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:15:00.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:00.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:15:00.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:15:00.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:00.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:15:00.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:15:00.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:00.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:15:00.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:15:00.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:00.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:15:00.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:15:00.010 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.010 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:00.010 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.011 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.011 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:15:00.011 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.243050988999997, 2024-05-07T11:15:00.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:15:00.011 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:00.012 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:00.012 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.012 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:00.012 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:00.012 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.012 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:15:00.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.012 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:00.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:00.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:15:00.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:00.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:00.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:15:00.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:00.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:00.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:15:00.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:15:00.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:00.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:15:00.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:15:00.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:00.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:15:00.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:15:00.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:15:00.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:15:00.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:00.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:15:00.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:15:00.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:15:00.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:15:00.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:00.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:15:00.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:15:00.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:00.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:15:00.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:15:00.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:00.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:15:00.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:15:00.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:00.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:15:00.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:15:00.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:00.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:15:00.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:15:00.020 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.020 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:00.020 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.022 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.022 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:15:00.022 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.236056542999997, 2024-05-07T11:15:00.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:15:00.022 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:00.022 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:00.022 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.023 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:00.023 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:00.023 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.023 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:15:00.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.023 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:00.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:00.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:15:00.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:00.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:00.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:15:00.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:00.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:00.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:15:00.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:15:00.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:00.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:15:00.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:15:00.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:00.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:15:00.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:15:00.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:15:00.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:15:00.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:00.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:15:00.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:15:00.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:15:00.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:15:00.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:00.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:15:00.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:15:00.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:00.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:15:00.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:15:00.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:15:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:15:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:15:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:15:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:15:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:15:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:15:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 35.222987042, 2024-05-07T11:15:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:15:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:15:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:15:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:15:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:15:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:15:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:15:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:15:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:15:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:15:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:15:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:15:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:15:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:15:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:15:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:15:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:15:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:15:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:15:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:15:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:15:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:15:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:15:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:15:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:15:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:15:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:00.042 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:15:00.042 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:15:00.044 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:15:00.043+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:15:00.082 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-05-07T11:15:00.082 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-05-07T11:15:00.083 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-05-07T11:15:00.083 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-05-07T11:15:00.083 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-05-07T11:15:00.083 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-05-07T11:15:00.145 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:15:00.144+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:15:00.151 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:15:00.152 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:15:00.152 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:15:00.152 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:15:00.160 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:15:00.188 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:15:00.189 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "" 2024-05-07T11:15:00.189 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:15:00.246 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:15:00.245+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:15:00.265 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:15:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:15:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:15:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:15:00.266 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:15:00.274 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:15:00.346 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:15:00.346+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:15:00.380 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:15:00.380 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:15:00.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:15:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:15:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:15:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:15:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.877084572999998, 2024-05-07T11:15:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:15:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:15:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:15:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:15:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:15:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:15:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:15:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:15:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:15:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:15:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:15:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:15:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:15:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:15:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:15:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:15:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:15:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:15:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:15:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:15:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:15:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:15:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:15:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:15:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:15:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:15:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:15:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.872960831, 2024-05-07T11:15:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:15:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:15:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:15:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:15:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:15:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:15:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:15:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:15:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:15:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:15:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:15:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:15:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:15:00.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:15:00.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:15:00.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:15:00.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:15:00.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:15:00.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:15:00.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:15:00.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:15:00.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:15:00.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:15:00.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:15:00.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:15:00.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:15:00.401 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.401 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.401 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.401 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.401 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:15:00.401 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.872912036000002, 2024-05-07T11:15:00.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:15:00.402 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.402 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.402 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.402 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.402 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.402 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.402 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:15:00.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.402 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:15:00.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:15:00.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:15:00.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:15:00.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:15:00.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:15:00.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:15:00.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:15:00.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:15:00.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:15:00.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:15:00.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:15:00.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:15:00.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:15:00.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:15:00.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:15:00.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:15:00.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:15:00.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:15:00.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:15:00.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:15:00.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:15:00.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:15:00.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:15:00.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.410 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.411 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.411 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:15:00.411 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.872878745000001, 2024-05-07T11:15:00.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:15:00.411 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.411 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.411 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.412 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.412 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.412 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.412 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:15:00.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.412 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:15:00.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:15:00.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:15:00.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:15:00.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:15:00.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:15:00.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:15:00.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:15:00.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:15:00.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:15:00.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:15:00.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:15:00.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:15:00.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:15:00.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:15:00.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:15:00.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:15:00.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:15:00.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:15:00.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:15:00.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:15:00.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:15:00.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:15:00.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:15:00.420 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.420 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.420 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.420 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.420 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:15:00.421 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.872421977000002, 2024-05-07T11:15:00.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:15:00.421 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.421 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.421 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.421 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.421 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.421 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.421 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:15:00.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.422 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:15:00.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:15:00.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:15:00.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:15:00.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:15:00.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:15:00.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:15:00.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:15:00.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:15:00.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:15:00.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:15:00.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:15:00.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:15:00.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:15:00.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:15:00.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:15:00.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:15:00.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:15:00.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:15:00.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:15:00.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:15:00.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:15:00.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:15:00.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:15:00.431 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.431 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.432 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.432 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.432 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:15:00.432 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.872386958999996, 2024-05-07T11:15:00.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:15:00.432 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.433 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.433 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.433 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:15:00.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.433 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:15:00.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:15:00.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:15:00.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:15:00.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:15:00.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:15:00.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:15:00.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:15:00.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:15:00.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:15:00.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:15:00.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:15:00.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:15:00.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:15:00.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:15:00.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:15:00.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:15:00.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:15:00.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:15:00.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:15:00.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:15:00.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:15:00.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:15:00.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:15:00.441 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.441 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.441 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.442 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.442 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:15:00.442 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.872363571999998, 2024-05-07T11:15:00.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:15:00.442 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.442 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.442 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.442 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:15:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:15:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:15:00.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:15:00.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:15:00.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:15:00.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:15:00.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:15:00.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:15:00.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:15:00.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:15:00.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:15:00.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:15:00.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:15:00.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:15:00.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:15:00.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:15:00.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:15:00.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:15:00.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:15:00.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:15:00.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:15:00.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:15:00.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:15:00.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:15:00.451 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.451 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.451 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.451 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.451 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:15:00.451 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.871568375000003, 2024-05-07T11:15:00.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:15:00.452 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.452 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.452 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.452 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.452 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.452 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.452 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:15:00.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.453 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:15:00.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:15:00.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:15:00.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:15:00.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:15:00.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:15:00.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:15:00.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:15:00.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:15:00.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:15:00.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:15:00.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:15:00.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:15:00.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:15:00.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:15:00.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:15:00.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:15:00.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:15:00.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:15:00.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:15:00.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:15:00.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:15:00.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:15:00.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:15:00.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.460 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.461 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.461 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:15:00.461 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.870625836999999, 2024-05-07T11:15:00.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:15:00.461 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.461 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.461 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:15:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:15:00.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:15:00.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:15:00.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:15:00.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:15:00.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:15:00.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:15:00.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:15:00.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:15:00.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:15:00.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:15:00.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:15:00.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:15:00.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:15:00.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:15:00.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:15:00.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:15:00.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:15:00.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:15:00.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:15:00.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:15:00.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:15:00.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:15:00.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:15:00.470 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.470 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.470 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.470 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.470 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:15:00.471 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.868731435000001, 2024-05-07T11:15:00.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:15:00.471 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.471 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.471 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.471 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.471 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.471 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.472 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:15:00.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.472 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:15:00.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:15:00.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:15:00.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:15:00.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:15:00.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:15:00.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:15:00.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:15:00.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:15:00.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:15:00.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:15:00.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:15:00.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:15:00.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:15:00.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:15:00.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:15:00.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:15:00.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:15:00.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:15:00.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:15:00.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:15:00.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:15:00.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:15:00.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:15:00.479 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.480 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.480 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.480 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.480 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:15:00.480 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.867658001000002, 2024-05-07T11:15:00.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:15:00.480 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.481 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.481 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.481 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.481 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.481 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.481 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:15:00.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.481 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:15:00.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:15:00.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:15:00.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:15:00.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:15:00.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:15:00.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:15:00.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:15:00.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:15:00.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:15:00.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:15:00.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:15:00.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:15:00.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:15:00.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:15:00.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:15:00.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:15:00.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:15:00.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:15:00.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:15:00.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:15:00.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:15:00.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:15:00.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:15:00.489 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.489 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.489 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.490 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.490 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:15:00.490 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.865858197999998, 2024-05-07T11:15:00.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:15:00.490 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.490 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.490 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.490 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.490 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.491 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.491 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:15:00.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.491 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:15:00.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:15:00.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:15:00.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:15:00.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:15:00.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:15:00.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:15:00.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:15:00.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:15:00.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:15:00.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:15:00.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:15:00.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:15:00.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:15:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:15:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:15:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:15:00.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:15:00.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:15:00.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:15:00.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:15:00.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:15:00.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:15:00.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:15:00.498 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.499 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.499 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.499 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.499 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:15:00.499 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.864922168, 2024-05-07T11:15:00.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:15:00.500 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.500 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.500 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.500 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.500 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.500 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.500 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:15:00.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.500 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:15:00.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:15:00.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:15:00.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:15:00.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:15:00.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:15:00.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:15:00.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:15:00.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:15:00.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:15:00.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:15:00.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:15:00.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:15:00.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:15:00.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:15:00.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:15:00.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:15:00.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:15:00.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:15:00.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:15:00.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:15:00.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:15:00.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:15:00.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:15:00.508 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.508 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.508 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.509 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.509 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:15:00.509 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.862196216000001, 2024-05-07T11:15:00.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:15:00.509 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.509 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.509 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.510 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.510 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.510 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.510 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:15:00.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.510 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:15:00.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:15:00.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:15:00.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:15:00.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:15:00.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:15:00.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:15:00.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:15:00.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:15:00.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:15:00.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:15:00.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:15:00.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:15:00.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:15:00.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:15:00.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:15:00.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:15:00.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:15:00.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:15:00.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:15:00.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:15:00.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:15:00.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:15:00.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:15:00.518 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.518 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.518 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.518 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.519 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:15:00.519 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.861350344999998, 2024-05-07T11:15:00.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:15:00.519 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.519 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.519 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.519 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.519 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.520 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.520 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:15:00.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.520 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:15:00.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:15:00.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:15:00.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:15:00.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:15:00.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:15:00.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:15:00.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:15:00.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:15:00.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:15:00.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:15:00.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:15:00.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:15:00.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:15:00.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:15:00.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:15:00.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:15:00.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:15:00.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:15:00.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:15:00.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:15:00.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:15:00.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:15:00.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:15:00.527 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.528 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.528 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.528 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.528 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:15:00.528 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.860542959999997, 2024-05-07T11:15:00.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:15:00.529 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.529 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.529 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.529 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.529 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.529 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.529 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:15:00.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.530 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:15:00.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:15:00.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:15:00.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:15:00.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:15:00.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:15:00.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:15:00.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:15:00.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:15:00.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:15:00.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:15:00.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:15:00.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:15:00.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:15:00.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:15:00.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:15:00.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:15:00.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:15:00.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:15:00.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:15:00.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:15:00.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:15:00.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:15:00.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:15:00.537 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.537 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.538 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.538 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.538 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:15:00.538 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.857750281999998, 2024-05-07T11:15:00.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:15:00.538 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.538 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.539 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.539 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.539 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.539 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.539 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:15:00.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.539 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:15:00.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:15:00.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:15:00.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:15:00.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:15:00.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:15:00.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:15:00.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:15:00.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:15:00.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:15:00.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:15:00.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:15:00.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:15:00.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:15:00.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:15:00.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:15:00.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:15:00.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:15:00.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:15:00.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:15:00.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:15:00.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:15:00.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:15:00.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:15:00.547 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.547 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.547 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.548 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.548 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:15:00.548 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.855299203999998, 2024-05-07T11:15:00.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:15:00.548 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.548 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.548 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.548 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.548 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.549 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.549 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:15:00.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.549 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:15:00.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:15:00.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:15:00.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:15:00.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:15:00.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:15:00.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:15:00.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:15:00.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:15:00.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:15:00.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:15:00.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:15:00.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:15:00.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:15:00.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:15:00.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:15:00.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:15:00.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:15:00.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:15:00.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:15:00.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:15:00.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:15:00.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:15:00.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:15:00.557 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.557 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.557 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.557 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.557 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:15:00.557 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.854400849000001, 2024-05-07T11:15:00.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:15:00.558 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.558 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.558 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.558 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.558 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.558 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.558 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:15:00.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.559 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:15:00.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:15:00.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:15:00.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:15:00.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:15:00.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:15:00.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:15:00.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:15:00.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:15:00.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:15:00.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:15:00.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:15:00.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:15:00.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:15:00.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:15:00.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:15:00.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:15:00.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:15:00.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:15:00.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:15:00.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:15:00.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:15:00.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:15:00.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:15:00.566 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.566 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.566 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.567 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.567 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:15:00.567 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.850100986999998, 2024-05-07T11:15:00.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:15:00.567 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:00.567 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:00.567 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.568 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:00.568 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:00.568 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.568 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:15:00.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.568 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:00.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:00.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:15:00.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:00.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:15:00.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:00.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:00.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:15:00.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:15:00.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:00.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:15:00.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:15:00.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:00.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:15:00.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:15:00.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:00.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:15:00.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:15:00.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:15:00.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:15:00.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:00.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:15:00.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:15:00.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:00.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:15:00.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:15:00.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:00.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:15:00.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:15:00.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:00.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:15:00.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:15:00.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:00.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:15:00.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:15:00.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:00.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:00.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:00.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:15:00.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:15:00.576 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.576 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.576 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.576 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:00.576 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:00.577 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:15:00.577 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-05-07T11:15:00.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:15:00.578 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-07T11:15:00.579 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-05-07T11:15:00.577+0000 7fa385b21640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29694) UID: 0 2024-05-07T11:15:00.579 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T11:15:00.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:15:00.596 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-05-07T11:15:00.653 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-07T11:15:00.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:15:00.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-07T11:15:00.679 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:15:00.678+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:15:00.688 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:15:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:15:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-05-07T11:15:00.688 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:15:00.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T11:15:00.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-07T11:15:00.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-05-07T11:15:00.782 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-05-07T11:15:00.782+0000 7f657c6b2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29475) UID: 0 2024-05-07T11:15:00.809 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-05-07T11:15:00.819 INFO:tasks.thrashosds:joining thrashosds 2024-05-07T11:15:00.820 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:15:00.843 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:15:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-05-07T11:15:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-05-07T11:15:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-05-07T11:15:00.844 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:15:00.852 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T11:15:00.997 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-07T11:15:00.998 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-05-07T11:15:00.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-05-07T11:15:00.998 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-05-07T11:15:00.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:00.998 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:694 4.9 4:9100a19b:::100000004d1.00000000:head [write 0~3138] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:00.998 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:15:00.998 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.489812211, 2024-05-07T11:15:00.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0083847239999999, 2024-05-07T11:15:00.999 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:00.999 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:00.999 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:00.999 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:00.999 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:00.999 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:00.999 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 694 2024-05-07T11:15:00.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:00.999 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:15:01.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506116+0000", 2024-05-07T11:15:01.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506118+0000", 2024-05-07T11:15:01.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.996e-06 2024-05-07T11:15:01.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506129+0000", 2024-05-07T11:15:01.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0977e-05 2024-05-07T11:15:01.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506157+0000", 2024-05-07T11:15:01.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7495999999999999e-05 2024-05-07T11:15:01.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506173+0000", 2024-05-07T11:15:01.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6495999999999999e-05 2024-05-07T11:15:01.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506293+0000", 2024-05-07T11:15:01.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000119222 2024-05-07T11:15:01.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506301+0000", 2024-05-07T11:15:01.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4540000000000007e-06 2024-05-07T11:15:01.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508661+0000", 2024-05-07T11:15:01.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.00236006 2024-05-07T11:15:01.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508803+0000", 2024-05-07T11:15:01.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00014153700000000001 2024-05-07T11:15:01.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514397+0000", 2024-05-07T11:15:01.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0055947979999999998 2024-05-07T11:15:01.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514434+0000", 2024-05-07T11:15:01.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6566000000000002e-05 2024-05-07T11:15:01.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514501+0000", 2024-05-07T11:15:01.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7121999999999999e-05 2024-05-07T11:15:01.007 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.007 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.007 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.008 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:699 4.19 4:9a679205:::100000004d6.00000000:head [write 0~180] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.008 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:15:01.008 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.489724129000003, 2024-05-07T11:15:01.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.006535111, 2024-05-07T11:15:01.008 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.008 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.009 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.009 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.009 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.009 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.009 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 699 2024-05-07T11:15:01.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.009 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:15:01.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506204+0000", 2024-05-07T11:15:01.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506205+0000", 2024-05-07T11:15:01.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7000000000000004e-07 2024-05-07T11:15:01.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506210+0000", 2024-05-07T11:15:01.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.566e-06 2024-05-07T11:15:01.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506222+0000", 2024-05-07T11:15:01.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2646000000000001e-05 2024-05-07T11:15:01.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506230+0000", 2024-05-07T11:15:01.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9570000000000002e-06 2024-05-07T11:15:01.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506307+0000", 2024-05-07T11:15:01.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6321000000000003e-05 2024-05-07T11:15:01.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.506311+0000", 2024-05-07T11:15:01.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7659999999999998e-06 2024-05-07T11:15:01.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506281+0000", 2024-05-07T11:15:01.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99996968900000005 2024-05-07T11:15:01.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506418+0000", 2024-05-07T11:15:01.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000137288 2024-05-07T11:15:01.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512632+0000", 2024-05-07T11:15:01.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0062140529999999998 2024-05-07T11:15:01.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512680+0000", 2024-05-07T11:15:01.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7809000000000003e-05 2024-05-07T11:15:01.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512740+0000", 2024-05-07T11:15:01.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9246000000000002e-05 2024-05-07T11:15:01.018 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.018 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.018 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.018 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:711 4.3e 4:7f23b022:::100000004e2.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.019 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:15:01.019 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.480961002000001, 2024-05-07T11:15:01.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99254391200000003, 2024-05-07T11:15:01.019 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.019 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.019 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.019 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.019 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.020 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.020 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 711 2024-05-07T11:15:01.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.020 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:15:01.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514968+0000", 2024-05-07T11:15:01.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514969+0000", 2024-05-07T11:15:01.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.866e-06 2024-05-07T11:15:01.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.514979+0000", 2024-05-07T11:15:01.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4099999999999997e-06 2024-05-07T11:15:01.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515006+0000", 2024-05-07T11:15:01.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7042999999999998e-05 2024-05-07T11:15:01.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515024+0000", 2024-05-07T11:15:01.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8023e-05 2024-05-07T11:15:01.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515158+0000", 2024-05-07T11:15:01.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013443799999999999 2024-05-07T11:15:01.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.515174+0000", 2024-05-07T11:15:01.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5379e-05 2024-05-07T11:15:01.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504087+0000", 2024-05-07T11:15:01.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98891316900000004 2024-05-07T11:15:01.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504196+0000", 2024-05-07T11:15:01.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000109041 2024-05-07T11:15:01.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507379+0000", 2024-05-07T11:15:01.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0031830959999999998 2024-05-07T11:15:01.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507434+0000", 2024-05-07T11:15:01.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4973999999999999e-05 2024-05-07T11:15:01.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507511+0000", 2024-05-07T11:15:01.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7472999999999995e-05 2024-05-07T11:15:01.028 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.028 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.028 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.028 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:716 4.28 4:14d63113:::100000004e7.00000000:head [write 0~1510] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.028 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:15:01.029 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.476597955000003, 2024-05-07T11:15:01.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98718972599999999, 2024-05-07T11:15:01.029 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.029 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.029 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.029 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.029 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.029 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.030 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 716 2024-05-07T11:15:01.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.030 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:15:01.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519331+0000", 2024-05-07T11:15:01.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519332+0000", 2024-05-07T11:15:01.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.84e-06 2024-05-07T11:15:01.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519342+0000", 2024-05-07T11:15:01.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:15:01.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519370+0000", 2024-05-07T11:15:01.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7299000000000001e-05 2024-05-07T11:15:01.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519383+0000", 2024-05-07T11:15:01.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3526999999999999e-05 2024-05-07T11:15:01.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519484+0000", 2024-05-07T11:15:01.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010054499999999999 2024-05-07T11:15:01.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.519496+0000", 2024-05-07T11:15:01.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2585999999999999e-05 2024-05-07T11:15:01.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503988+0000", 2024-05-07T11:15:01.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98449131099999998 2024-05-07T11:15:01.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504132+0000", 2024-05-07T11:15:01.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000144542 2024-05-07T11:15:01.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506315+0000", 2024-05-07T11:15:01.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002182869 2024-05-07T11:15:01.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506431+0000", 2024-05-07T11:15:01.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000116366 2024-05-07T11:15:01.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.038 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.038 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506520+0000", 2024-05-07T11:15:01.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8831000000000004e-05 2024-05-07T11:15:01.038 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.038 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.038 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.039 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:719 4.2e 4:7499e2b4:::100000004ea.00000000:head [write 0~341] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.039 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:15:01.039 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.473965118000002, 2024-05-07T11:15:01.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.99005208600000005, 2024-05-07T11:15:01.039 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.041 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.041 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.041 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.041 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.041 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.041 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 719 2024-05-07T11:15:01.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.042 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.042 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:15:01.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.043 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521963+0000", 2024-05-07T11:15:01.043 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.043 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521965+0000", 2024-05-07T11:15:01.044 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9530000000000002e-06 2024-05-07T11:15:01.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.044 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.044 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.044 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.521977+0000", 2024-05-07T11:15:01.044 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1617000000000001e-05 2024-05-07T11:15:01.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.045 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.045 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522004+0000", 2024-05-07T11:15:01.045 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7325999999999999e-05 2024-05-07T11:15:01.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.045 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.046 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522018+0000", 2024-05-07T11:15:01.046 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3346000000000001e-05 2024-05-07T11:15:01.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.046 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.046 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522092+0000", 2024-05-07T11:15:01.046 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4713000000000001e-05 2024-05-07T11:15:01.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.047 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.047 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.047 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.522098+0000", 2024-05-07T11:15:01.047 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6690000000000003e-06 2024-05-07T11:15:01.047 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.047 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.047 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.048 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507889+0000", 2024-05-07T11:15:01.048 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.98579065899999996 2024-05-07T11:15:01.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.048 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.048 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.048 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507964+0000", 2024-05-07T11:15:01.048 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5050999999999997e-05 2024-05-07T11:15:01.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.049 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.049 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.049 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511854+0000", 2024-05-07T11:15:01.049 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0038906660000000001 2024-05-07T11:15:01.049 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.049 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.049 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.049 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511908+0000", 2024-05-07T11:15:01.050 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3696000000000002e-05 2024-05-07T11:15:01.050 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.050 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.050 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512016+0000", 2024-05-07T11:15:01.050 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010739 2024-05-07T11:15:01.050 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.050 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.051 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.051 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:724 4.15 4:aa8b0fbc:::100000004ef.00000000:head [write 0~1928] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.051 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:15:01.051 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.469694216000001, 2024-05-07T11:15:01.051 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.980867975, 2024-05-07T11:15:01.051 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.052 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.052 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.052 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.052 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.052 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.052 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 724 2024-05-07T11:15:01.052 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.053 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.053 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.053 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.053 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:15:01.053 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.053 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.053 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.054 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.054 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526234+0000", 2024-05-07T11:15:01.054 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.054 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.054 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.054 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.054 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526235+0000", 2024-05-07T11:15:01.054 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8800000000000002e-07 2024-05-07T11:15:01.055 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.055 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.055 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526239+0000", 2024-05-07T11:15:01.055 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:15:01.055 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.055 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.055 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526250+0000", 2024-05-07T11:15:01.056 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0441999999999999e-05 2024-05-07T11:15:01.056 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.056 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.056 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526255+0000", 2024-05-07T11:15:01.056 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:15:01.056 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.056 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.057 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526296+0000", 2024-05-07T11:15:01.057 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.1087000000000002e-05 2024-05-07T11:15:01.057 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.057 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.057 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.057 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.526301+0000", 2024-05-07T11:15:01.057 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.5199999999999997e-06 2024-05-07T11:15:01.057 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.058 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.058 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.058 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503852+0000", 2024-05-07T11:15:01.058 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.977550739 2024-05-07T11:15:01.058 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.058 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.058 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.058 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504009+0000", 2024-05-07T11:15:01.059 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015683799999999999 2024-05-07T11:15:01.059 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.059 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.059 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.059 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506941+0000", 2024-05-07T11:15:01.059 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029324870000000001 2024-05-07T11:15:01.059 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.059 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.059 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.060 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507008+0000", 2024-05-07T11:15:01.060 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6605000000000004e-05 2024-05-07T11:15:01.060 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.060 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.060 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.060 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507102+0000", 2024-05-07T11:15:01.060 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4300000000000002e-05 2024-05-07T11:15:01.061 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.061 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.061 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.061 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.061 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.061 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:735 4.15 4:a993b01f:::100000004fa.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.061 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:15:01.061 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.460196007999997, 2024-05-07T11:15:01.062 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.97152659500000005, 2024-05-07T11:15:01.062 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.062 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.062 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.062 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.062 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.062 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.062 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 735 2024-05-07T11:15:01.063 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.063 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.063 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.063 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.063 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:15:01.063 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.063 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.064 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.064 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.064 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:15:01.064 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.064 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.064 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.064 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.064 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535733+0000", 2024-05-07T11:15:01.064 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7000000000000003e-07 2024-05-07T11:15:01.065 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.065 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.065 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.065 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535738+0000", 2024-05-07T11:15:01.065 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2610000000000004e-06 2024-05-07T11:15:01.065 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.065 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.065 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535751+0000", 2024-05-07T11:15:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3390999999999999e-05 2024-05-07T11:15:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535760+0000", 2024-05-07T11:15:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7280000000000001e-06 2024-05-07T11:15:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535813+0000", 2024-05-07T11:15:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3069000000000003e-05 2024-05-07T11:15:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.535822+0000", 2024-05-07T11:15:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7190000000000007e-06 2024-05-07T11:15:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504748+0000", 2024-05-07T11:15:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.96892641499999999 2024-05-07T11:15:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504855+0000", 2024-05-07T11:15:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000106871 2024-05-07T11:15:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507135+0000", 2024-05-07T11:15:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002280603 2024-05-07T11:15:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507181+0000", 2024-05-07T11:15:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5068999999999998e-05 2024-05-07T11:15:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507259+0000", 2024-05-07T11:15:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.8598999999999997e-05 2024-05-07T11:15:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:738 4.2f 4:f72c9119:::100000004fd.00000000:head [write 0~6611] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:15:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.457555739, 2024-05-07T11:15:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.975553004, 2024-05-07T11:15:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 738 2024-05-07T11:15:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:15:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538373+0000", 2024-05-07T11:15:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538374+0000", 2024-05-07T11:15:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8000000000000004e-07 2024-05-07T11:15:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538381+0000", 2024-05-07T11:15:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.7689999999999996e-06 2024-05-07T11:15:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538392+0000", 2024-05-07T11:15:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0733e-05 2024-05-07T11:15:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538399+0000", 2024-05-07T11:15:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9609999999999999e-06 2024-05-07T11:15:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538489+0000", 2024-05-07T11:15:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.9367e-05 2024-05-07T11:15:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.538497+0000", 2024-05-07T11:15:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.6449999999999994e-06 2024-05-07T11:15:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507355+0000", 2024-05-07T11:15:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.968857462 2024-05-07T11:15:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507468+0000", 2024-05-07T11:15:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000112965 2024-05-07T11:15:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513804+0000", 2024-05-07T11:15:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0063363179999999996 2024-05-07T11:15:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513851+0000", 2024-05-07T11:15:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6915000000000001e-05 2024-05-07T11:15:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513926+0000", 2024-05-07T11:15:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4988999999999996e-05 2024-05-07T11:15:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:750 4.3b 4:dc5d08b1:::10000000509.00000000:head [write 0~1265] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:15:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.447376282, 2024-05-07T11:15:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95907421400000004, 2024-05-07T11:15:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 750 2024-05-07T11:15:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:15:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548552+0000", 2024-05-07T11:15:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548553+0000", 2024-05-07T11:15:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.048e-06 2024-05-07T11:15:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548559+0000", 2024-05-07T11:15:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.434e-06 2024-05-07T11:15:01.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.086 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.086 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.086 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548573+0000", 2024-05-07T11:15:01.086 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3949e-05 2024-05-07T11:15:01.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.086 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.086 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.087 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548580+0000", 2024-05-07T11:15:01.087 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3810000000000001e-06 2024-05-07T11:15:01.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.087 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.087 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548657+0000", 2024-05-07T11:15:01.087 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6882e-05 2024-05-07T11:15:01.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.088 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.088 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.548663+0000", 2024-05-07T11:15:01.088 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1229999999999997e-06 2024-05-07T11:15:01.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.088 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.089 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504333+0000", 2024-05-07T11:15:01.089 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.95566950399999995 2024-05-07T11:15:01.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.089 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.089 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.089 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504509+0000", 2024-05-07T11:15:01.089 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017621100000000001 2024-05-07T11:15:01.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.090 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.090 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.090 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507510+0000", 2024-05-07T11:15:01.090 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0030007060000000001 2024-05-07T11:15:01.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.090 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.090 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.090 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507546+0000", 2024-05-07T11:15:01.091 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.6956000000000003e-05 2024-05-07T11:15:01.091 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.091 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.091 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.091 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507626+0000", 2024-05-07T11:15:01.091 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0019999999999996e-05 2024-05-07T11:15:01.091 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.092 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.092 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.092 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:766 4.21 4:868aa60a:::10000000519.00000000:head [write 0~4053] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.092 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:15:01.092 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.433600810999998, 2024-05-07T11:15:01.093 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94487878700000005, 2024-05-07T11:15:01.093 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.093 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.093 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.093 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.093 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.093 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.094 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 766 2024-05-07T11:15:01.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.094 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.094 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.094 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.094 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:15:01.094 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.095 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.095 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562328+0000", 2024-05-07T11:15:01.095 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.095 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.095 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.095 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562329+0000", 2024-05-07T11:15:01.096 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7290000000000001e-06 2024-05-07T11:15:01.096 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.096 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.096 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.096 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562357+0000", 2024-05-07T11:15:01.096 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7809000000000001e-05 2024-05-07T11:15:01.096 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.096 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.097 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.097 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562375+0000", 2024-05-07T11:15:01.097 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7955999999999999e-05 2024-05-07T11:15:01.097 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.097 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.097 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.097 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562401+0000", 2024-05-07T11:15:01.097 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6052999999999999e-05 2024-05-07T11:15:01.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.098 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.098 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.098 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562473+0000", 2024-05-07T11:15:01.098 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1487000000000002e-05 2024-05-07T11:15:01.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.098 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.099 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.099 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.562483+0000", 2024-05-07T11:15:01.099 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0514e-05 2024-05-07T11:15:01.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.099 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.099 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.099 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504076+0000", 2024-05-07T11:15:01.099 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94159258000000001 2024-05-07T11:15:01.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.100 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.100 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.100 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504367+0000", 2024-05-07T11:15:01.100 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029070700000000002 2024-05-07T11:15:01.100 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.100 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.100 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.100 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506891+0000", 2024-05-07T11:15:01.101 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002524517 2024-05-07T11:15:01.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.101 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.101 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.101 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506948+0000", 2024-05-07T11:15:01.101 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7064000000000001e-05 2024-05-07T11:15:01.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.101 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.101 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.102 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507207+0000", 2024-05-07T11:15:01.102 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00025837100000000002 2024-05-07T11:15:01.102 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.102 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.102 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.102 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.102 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.103 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:773 4.f 4:f1ecd705:::10000000520.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.103 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:15:01.103 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.427575750000003, 2024-05-07T11:15:01.103 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93813150599999995, 2024-05-07T11:15:01.103 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.103 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.103 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.103 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.103 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.104 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.104 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 773 2024-05-07T11:15:01.104 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.104 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.104 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.104 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:15:01.104 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.105 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.105 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.105 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568353+0000", 2024-05-07T11:15:01.105 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.105 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.105 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.106 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568354+0000", 2024-05-07T11:15:01.106 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2500000000000004e-07 2024-05-07T11:15:01.106 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.106 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.106 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.106 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568358+0000", 2024-05-07T11:15:01.106 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5179999999999998e-06 2024-05-07T11:15:01.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.107 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.107 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.107 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568369+0000", 2024-05-07T11:15:01.107 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0812000000000001e-05 2024-05-07T11:15:01.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.107 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.107 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.108 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568376+0000", 2024-05-07T11:15:01.108 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.3980000000000002e-06 2024-05-07T11:15:01.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.108 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.108 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568423+0000", 2024-05-07T11:15:01.108 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.6567000000000003e-05 2024-05-07T11:15:01.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.109 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.109 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.109 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.568430+0000", 2024-05-07T11:15:01.109 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6830000000000002e-06 2024-05-07T11:15:01.109 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.109 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.109 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.109 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.503983+0000", 2024-05-07T11:15:01.110 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93555354400000001 2024-05-07T11:15:01.110 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.110 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.110 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.110 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504120+0000", 2024-05-07T11:15:01.110 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013731 2024-05-07T11:15:01.110 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.110 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.111 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.111 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506338+0000", 2024-05-07T11:15:01.111 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0022171389999999999 2024-05-07T11:15:01.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.111 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.111 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.111 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506404+0000", 2024-05-07T11:15:01.112 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6697000000000002e-05 2024-05-07T11:15:01.112 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.112 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.112 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.112 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.506484+0000", 2024-05-07T11:15:01.112 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0012999999999994e-05 2024-05-07T11:15:01.112 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.113 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.113 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.113 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.113 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:774 4.2f 4:f6088284:::10000000521.00000000:head [write 0~2224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.113 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:15:01.113 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.426733761000001, 2024-05-07T11:15:01.113 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94482959399999999, 2024-05-07T11:15:01.114 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.114 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.114 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.114 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.114 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.114 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.114 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 774 2024-05-07T11:15:01.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.115 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.115 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.115 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:15:01.115 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.115 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.115 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.116 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:15:01.116 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.116 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.116 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569195+0000", 2024-05-07T11:15:01.116 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5400000000000001e-07 2024-05-07T11:15:01.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.117 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.117 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569201+0000", 2024-05-07T11:15:01.117 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.135e-06 2024-05-07T11:15:01.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.117 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.118 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569208+0000", 2024-05-07T11:15:01.118 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4109999999999999e-06 2024-05-07T11:15:01.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.118 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.118 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569214+0000", 2024-05-07T11:15:01.118 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7980000000000002e-06 2024-05-07T11:15:01.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569247+0000", 2024-05-07T11:15:01.119 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3167999999999998e-05 2024-05-07T11:15:01.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.569251+0000", 2024-05-07T11:15:01.120 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.7720000000000001e-06 2024-05-07T11:15:01.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.120 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.120 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507963+0000", 2024-05-07T11:15:01.120 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93871246399999997 2024-05-07T11:15:01.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.121 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.121 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508096+0000", 2024-05-07T11:15:01.121 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000132387 2024-05-07T11:15:01.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.121 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513934+0000", 2024-05-07T11:15:01.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0058384099999999996 2024-05-07T11:15:01.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.122 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.513968+0000", 2024-05-07T11:15:01.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3609999999999998e-05 2024-05-07T11:15:01.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514024+0000", 2024-05-07T11:15:01.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6784999999999999e-05 2024-05-07T11:15:01.123 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.123 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.123 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.124 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:777 4.28 4:15c12ddb:::10000000524.00000000:head [write 0~654] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.124 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:15:01.124 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.424169462000002, 2024-05-07T11:15:01.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93549593600000003, 2024-05-07T11:15:01.124 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.124 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.124 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.125 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.125 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.125 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.125 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 777 2024-05-07T11:15:01.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.125 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.126 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:15:01.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.126 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.126 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571759+0000", 2024-05-07T11:15:01.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571760+0000", 2024-05-07T11:15:01.127 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9999999999999997e-07 2024-05-07T11:15:01.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571764+0000", 2024-05-07T11:15:01.128 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2400000000000001e-06 2024-05-07T11:15:01.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.128 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.128 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571774+0000", 2024-05-07T11:15:01.128 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-05-07T11:15:01.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571781+0000", 2024-05-07T11:15:01.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5509999999999996e-06 2024-05-07T11:15:01.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571863+0000", 2024-05-07T11:15:01.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1996999999999994e-05 2024-05-07T11:15:01.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.130 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.571872+0000", 2024-05-07T11:15:01.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8770000000000005e-06 2024-05-07T11:15:01.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.131 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504626+0000", 2024-05-07T11:15:01.131 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93275360100000004 2024-05-07T11:15:01.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.131 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504744+0000", 2024-05-07T11:15:01.131 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000117858 2024-05-07T11:15:01.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.132 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.132 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507125+0000", 2024-05-07T11:15:01.132 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0023808570000000001 2024-05-07T11:15:01.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.132 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.133 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507178+0000", 2024-05-07T11:15:01.133 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3647999999999999e-05 2024-05-07T11:15:01.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.133 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.133 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.507255+0000", 2024-05-07T11:15:01.133 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6596999999999999e-05 2024-05-07T11:15:01.133 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.134 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.134 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.134 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:778 4.9 4:93c40394:::10000000525.00000000:head [write 0~1523] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.134 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:15:01.134 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.423323113000002, 2024-05-07T11:15:01.135 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.94255473400000001, 2024-05-07T11:15:01.135 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.135 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.135 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.135 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.135 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.135 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.135 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 778 2024-05-07T11:15:01.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.136 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.136 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.136 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:15:01.136 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.137 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.137 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572605+0000", 2024-05-07T11:15:01.137 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.137 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.137 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572606+0000", 2024-05-07T11:15:01.137 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.37e-07 2024-05-07T11:15:01.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.138 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.138 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572611+0000", 2024-05-07T11:15:01.138 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.442e-06 2024-05-07T11:15:01.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.138 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.139 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572617+0000", 2024-05-07T11:15:01.139 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9689999999999997e-06 2024-05-07T11:15:01.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.139 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.139 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572623+0000", 2024-05-07T11:15:01.139 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2329999999999997e-06 2024-05-07T11:15:01.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.140 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572697+0000", 2024-05-07T11:15:01.140 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4153999999999995e-05 2024-05-07T11:15:01.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.140 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.572706+0000", 2024-05-07T11:15:01.140 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.0149999999999992e-06 2024-05-07T11:15:01.141 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.141 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.141 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511467+0000", 2024-05-07T11:15:01.141 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93876136399999999 2024-05-07T11:15:01.141 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.141 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.141 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.511618+0000", 2024-05-07T11:15:01.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015030299999999999 2024-05-07T11:15:01.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.142 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.142 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515075+0000", 2024-05-07T11:15:01.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034577229999999998 2024-05-07T11:15:01.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515106+0000", 2024-05-07T11:15:01.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.0542e-05 2024-05-07T11:15:01.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515160+0000", 2024-05-07T11:15:01.144 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4351999999999997e-05 2024-05-07T11:15:01.144 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.144 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.144 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.144 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:783 4.2f 4:f52bd9e6:::1000000052a.00000000:head [write 0~639] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.144 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:15:01.145 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.419027636999999, 2024-05-07T11:15:01.145 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93721458400000002, 2024-05-07T11:15:01.145 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.145 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.145 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.145 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.145 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.145 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.146 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 783 2024-05-07T11:15:01.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.146 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.146 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:15:01.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576901+0000", 2024-05-07T11:15:01.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576902+0000", 2024-05-07T11:15:01.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1900000000000002e-07 2024-05-07T11:15:01.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576908+0000", 2024-05-07T11:15:01.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.1210000000000003e-06 2024-05-07T11:15:01.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576918+0000", 2024-05-07T11:15:01.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0378e-05 2024-05-07T11:15:01.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576927+0000", 2024-05-07T11:15:01.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1730000000000001e-06 2024-05-07T11:15:01.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576975+0000", 2024-05-07T11:15:01.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7206999999999997e-05 2024-05-07T11:15:01.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.576980+0000", 2024-05-07T11:15:01.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6760000000000004e-06 2024-05-07T11:15:01.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508559+0000", 2024-05-07T11:15:01.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.931579029 2024-05-07T11:15:01.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508756+0000", 2024-05-07T11:15:01.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019671099999999999 2024-05-07T11:15:01.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514030+0000", 2024-05-07T11:15:01.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0052739040000000003 2024-05-07T11:15:01.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514076+0000", 2024-05-07T11:15:01.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5809000000000001e-05 2024-05-07T11:15:01.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514115+0000", 2024-05-07T11:15:01.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.9857000000000001e-05 2024-05-07T11:15:01.155 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.155 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.155 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.155 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:786 4.9 4:9228ebf7:::1000000052d.00000000:head [write 0~1282] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.155 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:15:01.155 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.416239838000003, 2024-05-07T11:15:01.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93556167099999998, 2024-05-07T11:15:01.156 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.156 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.156 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.156 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.156 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.156 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.156 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 786 2024-05-07T11:15:01.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.157 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:15:01.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579689+0000", 2024-05-07T11:15:01.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579690+0000", 2024-05-07T11:15:01.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5499999999999997e-07 2024-05-07T11:15:01.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579694+0000", 2024-05-07T11:15:01.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4859999999999999e-06 2024-05-07T11:15:01.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579704+0000", 2024-05-07T11:15:01.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0193999999999999e-05 2024-05-07T11:15:01.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579711+0000", 2024-05-07T11:15:01.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.7229999999999998e-06 2024-05-07T11:15:01.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579788+0000", 2024-05-07T11:15:01.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6598000000000001e-05 2024-05-07T11:15:01.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.579796+0000", 2024-05-07T11:15:01.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8459999999999997e-06 2024-05-07T11:15:01.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512119+0000", 2024-05-07T11:15:01.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.93232221900000001 2024-05-07T11:15:01.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512211+0000", 2024-05-07T11:15:01.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2567999999999999e-05 2024-05-07T11:15:01.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515167+0000", 2024-05-07T11:15:01.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0029553740000000002 2024-05-07T11:15:01.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515193+0000", 2024-05-07T11:15:01.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6420000000000001e-05 2024-05-07T11:15:01.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515250+0000", 2024-05-07T11:15:01.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.7388e-05 2024-05-07T11:15:01.164 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.164 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.164 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.165 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:787 4.f 4:f1af59e5:::1000000052e.00000000:head [write 0~149] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.165 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:15:01.165 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.415422397999997, 2024-05-07T11:15:01.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.928171725, 2024-05-07T11:15:01.165 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.165 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.165 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.166 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.166 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.166 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.166 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 787 2024-05-07T11:15:01.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.166 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:15:01.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580506+0000", 2024-05-07T11:15:01.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580507+0000", 2024-05-07T11:15:01.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.9400000000000005e-07 2024-05-07T11:15:01.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580511+0000", 2024-05-07T11:15:01.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0389999999999998e-06 2024-05-07T11:15:01.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580521+0000", 2024-05-07T11:15:01.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.8500000000000006e-06 2024-05-07T11:15:01.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580527+0000", 2024-05-07T11:15:01.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.6680000000000004e-06 2024-05-07T11:15:01.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580598+0000", 2024-05-07T11:15:01.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0858999999999994e-05 2024-05-07T11:15:01.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.580606+0000", 2024-05-07T11:15:01.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6490000000000008e-06 2024-05-07T11:15:01.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504656+0000", 2024-05-07T11:15:01.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92405038699999997 2024-05-07T11:15:01.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.504778+0000", 2024-05-07T11:15:01.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000121816 2024-05-07T11:15:01.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508536+0000", 2024-05-07T11:15:01.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0037581390000000002 2024-05-07T11:15:01.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508585+0000", 2024-05-07T11:15:01.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8581000000000001e-05 2024-05-07T11:15:01.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508678+0000", 2024-05-07T11:15:01.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3042999999999997e-05 2024-05-07T11:15:01.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.174 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.175 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:789 4.15 4:aa7a9bfe:::10000000530.00000000:head [write 0~1096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.175 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:15:01.175 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.413616007999998, 2024-05-07T11:15:01.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92632745100000002, 2024-05-07T11:15:01.175 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.175 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.175 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.175 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.175 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.176 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.176 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 789 2024-05-07T11:15:01.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.176 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:15:01.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:15:01.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582313+0000", 2024-05-07T11:15:01.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0999999999999997e-07 2024-05-07T11:15:01.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582318+0000", 2024-05-07T11:15:01.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.3069999999999996e-06 2024-05-07T11:15:01.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582344+0000", 2024-05-07T11:15:01.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6315000000000001e-05 2024-05-07T11:15:01.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582350+0000", 2024-05-07T11:15:01.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.472e-06 2024-05-07T11:15:01.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582427+0000", 2024-05-07T11:15:01.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.6278000000000004e-05 2024-05-07T11:15:01.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.582435+0000", 2024-05-07T11:15:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3129999999999999e-06 2024-05-07T11:15:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505531+0000", 2024-05-07T11:15:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.923095836 2024-05-07T11:15:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.505688+0000", 2024-05-07T11:15:01.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00015692200000000001 2024-05-07T11:15:01.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508486+0000", 2024-05-07T11:15:01.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0027985979999999998 2024-05-07T11:15:01.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508552+0000", 2024-05-07T11:15:01.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5611999999999995e-05 2024-05-07T11:15:01.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.508640+0000", 2024-05-07T11:15:01.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7987999999999999e-05 2024-05-07T11:15:01.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.183 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.184 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:797 4.2f 4:f7ae40ea:::10000000538.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.184 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:15:01.184 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.406621561999998, 2024-05-07T11:15:01.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.92489323700000003, 2024-05-07T11:15:01.184 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.185 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.185 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.185 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.185 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.185 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.185 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 797 2024-05-07T11:15:01.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.185 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:15:01.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589307+0000", 2024-05-07T11:15:01.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589308+0000", 2024-05-07T11:15:01.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0500000000000002e-07 2024-05-07T11:15:01.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589312+0000", 2024-05-07T11:15:01.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5360000000000003e-06 2024-05-07T11:15:01.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589323+0000", 2024-05-07T11:15:01.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0917999999999999e-05 2024-05-07T11:15:01.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589330+0000", 2024-05-07T11:15:01.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.815e-06 2024-05-07T11:15:01.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589428+0000", 2024-05-07T11:15:01.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7872000000000001e-05 2024-05-07T11:15:01.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.589437+0000", 2024-05-07T11:15:01.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4210000000000001e-06 2024-05-07T11:15:01.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509109+0000", 2024-05-07T11:15:01.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91967186499999998 2024-05-07T11:15:01.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.509194+0000", 2024-05-07T11:15:01.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.4927999999999997e-05 2024-05-07T11:15:01.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514126+0000", 2024-05-07T11:15:01.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049321490000000003 2024-05-07T11:15:01.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514152+0000", 2024-05-07T11:15:01.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.5758999999999999e-05 2024-05-07T11:15:01.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.514200+0000", 2024-05-07T11:15:01.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8168999999999999e-05 2024-05-07T11:15:01.194 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.194 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.194 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.194 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4549.0:812 4.9 4:901e62cf:::10000000547.00000000:head [write 0~3177] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.195 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:15:01.195 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.393552061000001, 2024-05-07T11:15:01.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91297066500000001, 2024-05-07T11:15:01.195 INFO:teuthology.orchestra.run.smithi088.stdout: "continuous": false, 2024-05-07T11:15:01.195 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-05-07T11:15:01.195 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.195 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-05-07T11:15:01.195 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4549", 2024-05-07T11:15:01.196 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.196 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 812 2024-05-07T11:15:01.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.196 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-05-07T11:15:01.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-05-07T11:15:01.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:15:01.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-05-07T11:15:01.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602376+0000", 2024-05-07T11:15:01.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-05-07T11:15:01.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-05-07T11:15:01.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602377+0000", 2024-05-07T11:15:01.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.4900000000000004e-07 2024-05-07T11:15:01.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-05-07T11:15:01.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602401+0000", 2024-05-07T11:15:01.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.3541e-05 2024-05-07T11:15:01.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-05-07T11:15:01.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602410+0000", 2024-05-07T11:15:01.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3000000000000007e-06 2024-05-07T11:15:01.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602416+0000", 2024-05-07T11:15:01.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.2320000000000001e-06 2024-05-07T11:15:01.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602472+0000", 2024-05-07T11:15:01.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6981999999999998e-05 2024-05-07T11:15:01.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:24.602482+0000", 2024-05-07T11:15:01.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.9799999999999993e-06 2024-05-07T11:15:01.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-05-07T11:15:01.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512654+0000", 2024-05-07T11:15:01.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.91017129299999999 2024-05-07T11:15:01.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-05-07T11:15:01.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.512771+0000", 2024-05-07T11:15:01.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00011699 2024-05-07T11:15:01.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-05-07T11:15:01.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515259+0000", 2024-05-07T11:15:01.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.002487937 2024-05-07T11:15:01.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-05-07T11:15:01.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515290+0000", 2024-05-07T11:15:01.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1775e-05 2024-05-07T11:15:01.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-07T11:15:01.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-07T11:15:01.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-05-07T11:15:01.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-05-07T11:14:25.515347+0000", 2024-05-07T11:15:01.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.6685999999999999e-05 2024-05-07T11:15:01.204 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.204 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.204 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.205 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-07T11:15:01.205 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-07T11:15:01.205 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-07T11:15:01.206 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T11:15:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:15:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:15:01.323 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-05-07T11:15:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:15:01.333 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T11:15:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:15:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-05-07T11:15:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-05-07T11:15:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-05-07T11:15:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:15:01.447 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T11:15:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-07T11:15:01.554 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-05-07T11:15:01.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-05-07T11:15:01.555 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-05-07T11:15:01.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.555 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:697 4.32 4:4c56ded7:::100000004d4.00000000:head [write 0~180] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-05-07T11:15:01.555 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:15:01.555 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.050776980999999, 2024-05-07T11:15:01.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0393658290000001, 2024-05-07T11:15:01.555 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.556 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.556 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.556 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.556 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.556 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.556 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 697 2024-05-07T11:15:01.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.557 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:15:01.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:15:01.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501883+0000", 2024-05-07T11:15:01.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0100000000000005e-07 2024-05-07T11:15:01.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.501887+0000", 2024-05-07T11:15:01.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7510000000000002e-06 2024-05-07T11:15:01.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503562+0000", 2024-05-07T11:15:01.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00167527 2024-05-07T11:15:01.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.503571+0000", 2024-05-07T11:15:01.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-05-07T11:15:01.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507722+0000", 2024-05-07T11:15:01.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00415103 2024-05-07T11:15:01.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507730+0000", 2024-05-07T11:15:01.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4000000000000003e-06 2024-05-07T11:15:01.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528334+0000", 2024-05-07T11:15:01.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.020603913 2024-05-07T11:15:01.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528448+0000", 2024-05-07T11:15:01.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114432 2024-05-07T11:15:01.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541143+0000", 2024-05-07T11:15:01.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012695074000000001 2024-05-07T11:15:01.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541181+0000", 2024-05-07T11:15:01.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7518000000000002e-05 2024-05-07T11:15:01.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541248+0000", 2024-05-07T11:15:01.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7675999999999994e-05 2024-05-07T11:15:01.566 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.566 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.567 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.567 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:692 4.1f 4:fa6e95f1:::100000004cf.00000000:head [write 0~4497] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.567 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:15:01.567 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.046653239000001, 2024-05-07T11:15:01.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0316219150000001, 2024-05-07T11:15:01.567 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.568 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.568 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.568 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.568 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.568 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.569 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 692 2024-05-07T11:15:01.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.569 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:15:01.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506006+0000", 2024-05-07T11:15:01.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506007+0000", 2024-05-07T11:15:01.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0999999999999997e-07 2024-05-07T11:15:01.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506019+0000", 2024-05-07T11:15:01.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:15:01.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506028+0000", 2024-05-07T11:15:01.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5289999999999997e-06 2024-05-07T11:15:01.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506035+0000", 2024-05-07T11:15:01.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8549999999999996e-06 2024-05-07T11:15:01.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507125+0000", 2024-05-07T11:15:01.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001089942 2024-05-07T11:15:01.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507133+0000", 2024-05-07T11:15:01.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9019999999999999e-06 2024-05-07T11:15:01.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528989+0000", 2024-05-07T11:15:01.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0218557159999999 2024-05-07T11:15:01.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529096+0000", 2024-05-07T11:15:01.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010751600000000001 2024-05-07T11:15:01.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537511+0000", 2024-05-07T11:15:01.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00841422 2024-05-07T11:15:01.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537559+0000", 2024-05-07T11:15:01.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427000000000002e-05 2024-05-07T11:15:01.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537628+0000", 2024-05-07T11:15:01.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9232000000000004e-05 2024-05-07T11:15:01.578 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.578 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.578 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.579 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:693 4.1d 4:b901b8a3:::100000004d0.00000000:head [write 0~109] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.579 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:15:01.579 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.046604444000003, 2024-05-07T11:15:01.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0376998319999999, 2024-05-07T11:15:01.579 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.579 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.579 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.579 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.580 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.580 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.580 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 693 2024-05-07T11:15:01.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.580 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:15:01.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506055+0000", 2024-05-07T11:15:01.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506056+0000", 2024-05-07T11:15:01.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3099999999999998e-07 2024-05-07T11:15:01.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506059+0000", 2024-05-07T11:15:01.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.393e-06 2024-05-07T11:15:01.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506066+0000", 2024-05-07T11:15:01.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8419999999999999e-06 2024-05-07T11:15:01.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506071+0000", 2024-05-07T11:15:01.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4480000000000002e-06 2024-05-07T11:15:01.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506520+0000", 2024-05-07T11:15:01.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00044878499999999999 2024-05-07T11:15:01.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506536+0000", 2024-05-07T11:15:01.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6058000000000001e-05 2024-05-07T11:15:01.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537758+0000", 2024-05-07T11:15:01.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031222273 2024-05-07T11:15:01.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538110+0000", 2024-05-07T11:15:01.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00035145 2024-05-07T11:15:01.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543693+0000", 2024-05-07T11:15:01.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055835650000000004 2024-05-07T11:15:01.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543720+0000", 2024-05-07T11:15:01.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6619e-05 2024-05-07T11:15:01.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543755+0000", 2024-05-07T11:15:01.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4867999999999999e-05 2024-05-07T11:15:01.588 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.588 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.588 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.589 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:695 4.16 4:6ae37727:::100000004d2.00000000:head [write 0~43] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.589 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:15:01.589 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.046571153000002, 2024-05-07T11:15:01.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0303643629999999, 2024-05-07T11:15:01.589 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.589 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.589 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.589 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.589 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.590 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.590 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 695 2024-05-07T11:15:01.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.590 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:15:01.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506088+0000", 2024-05-07T11:15:01.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506089+0000", 2024-05-07T11:15:01.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3799999999999998e-07 2024-05-07T11:15:01.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506092+0000", 2024-05-07T11:15:01.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8569999999999999e-06 2024-05-07T11:15:01.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506098+0000", 2024-05-07T11:15:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6449999999999999e-06 2024-05-07T11:15:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506105+0000", 2024-05-07T11:15:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7290000000000003e-06 2024-05-07T11:15:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506661+0000", 2024-05-07T11:15:01.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055569699999999996 2024-05-07T11:15:01.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506668+0000", 2024-05-07T11:15:01.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2400000000000001e-06 2024-05-07T11:15:01.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528750+0000", 2024-05-07T11:15:01.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0220815599999999 2024-05-07T11:15:01.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529077+0000", 2024-05-07T11:15:01.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032709599999999997 2024-05-07T11:15:01.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536335+0000", 2024-05-07T11:15:01.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072579539999999996 2024-05-07T11:15:01.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536380+0000", 2024-05-07T11:15:01.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5651e-05 2024-05-07T11:15:01.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.536453+0000", 2024-05-07T11:15:01.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2496000000000005e-05 2024-05-07T11:15:01.598 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.598 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.598 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.598 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:698 4.14 4:2890e941:::100000004d5.00000000:head [write 0~2769] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.598 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:15:01.598 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.046114385000003, 2024-05-07T11:15:01.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0327674550000001, 2024-05-07T11:15:01.599 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.599 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.599 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.599 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.599 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.599 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.599 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 698 2024-05-07T11:15:01.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.600 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:15:01.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506545+0000", 2024-05-07T11:15:01.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506546+0000", 2024-05-07T11:15:01.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9400000000000005e-07 2024-05-07T11:15:01.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506557+0000", 2024-05-07T11:15:01.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1666e-05 2024-05-07T11:15:01.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506565+0000", 2024-05-07T11:15:01.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7090000000000002e-06 2024-05-07T11:15:01.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506571+0000", 2024-05-07T11:15:01.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2179999999999996e-06 2024-05-07T11:15:01.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509072+0000", 2024-05-07T11:15:01.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002500787 2024-05-07T11:15:01.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.509079+0000", 2024-05-07T11:15:01.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-05-07T11:15:01.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534061+0000", 2024-05-07T11:15:01.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0249816759999999 2024-05-07T11:15:01.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534337+0000", 2024-05-07T11:15:01.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027564499999999998 2024-05-07T11:15:01.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539136+0000", 2024-05-07T11:15:01.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047988179999999998 2024-05-07T11:15:01.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539224+0000", 2024-05-07T11:15:01.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8111999999999999e-05 2024-05-07T11:15:01.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539313+0000", 2024-05-07T11:15:01.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8925000000000007e-05 2024-05-07T11:15:01.607 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.607 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.607 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.608 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:700 4.5 4:a154a9da:::100000004d7.00000000:head [write 0~2899] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.608 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:15:01.608 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.046079366999997, 2024-05-07T11:15:01.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023290043, 2024-05-07T11:15:01.608 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.608 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.608 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.608 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.609 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.609 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.609 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 700 2024-05-07T11:15:01.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.609 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:15:01.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506580+0000", 2024-05-07T11:15:01.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506581+0000", 2024-05-07T11:15:01.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.72e-07 2024-05-07T11:15:01.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506584+0000", 2024-05-07T11:15:01.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4249999999999998e-06 2024-05-07T11:15:01.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506590+0000", 2024-05-07T11:15:01.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1850000000000001e-06 2024-05-07T11:15:01.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506595+0000", 2024-05-07T11:15:01.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2340000000000002e-06 2024-05-07T11:15:01.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506629+0000", 2024-05-07T11:15:01.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3198000000000003e-05 2024-05-07T11:15:01.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506635+0000", 2024-05-07T11:15:01.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5729999999999996e-06 2024-05-07T11:15:01.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516060+0000", 2024-05-07T11:15:01.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0094245820000001 2024-05-07T11:15:01.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.516537+0000", 2024-05-07T11:15:01.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047760599999999999 2024-05-07T11:15:01.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529687+0000", 2024-05-07T11:15:01.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013149190999999999 2024-05-07T11:15:01.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529782+0000", 2024-05-07T11:15:01.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5859999999999994e-05 2024-05-07T11:15:01.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529870+0000", 2024-05-07T11:15:01.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7817000000000003e-05 2024-05-07T11:15:01.617 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.617 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.617 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.617 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:701 4.3 4:c3780500:::100000004d8.00000000:head [write 0~401] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.617 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:15:01.617 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.046055979999998, 2024-05-07T11:15:01.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.014548016, 2024-05-07T11:15:01.618 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.618 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.618 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.618 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.618 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.618 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.618 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 701 2024-05-07T11:15:01.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.619 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:15:01.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:15:01.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506604+0000", 2024-05-07T11:15:01.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0900000000000002e-07 2024-05-07T11:15:01.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506610+0000", 2024-05-07T11:15:01.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4640000000000003e-06 2024-05-07T11:15:01.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506617+0000", 2024-05-07T11:15:01.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.156e-06 2024-05-07T11:15:01.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.506622+0000", 2024-05-07T11:15:01.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090000000000003e-06 2024-05-07T11:15:01.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507717+0000", 2024-05-07T11:15:01.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010949340000000001 2024-05-07T11:15:01.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507724+0000", 2024-05-07T11:15:01.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3420000000000002e-06 2024-05-07T11:15:01.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510081+0000", 2024-05-07T11:15:01.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.002356939 2024-05-07T11:15:01.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.510187+0000", 2024-05-07T11:15:01.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105546 2024-05-07T11:15:01.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520376+0000", 2024-05-07T11:15:01.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010189363 2024-05-07T11:15:01.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.520866+0000", 2024-05-07T11:15:01.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049042200000000002 2024-05-07T11:15:01.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.521152+0000", 2024-05-07T11:15:01.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028513200000000001 2024-05-07T11:15:01.626 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.626 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.627 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.627 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:703 4.1d 4:bb3c397f:::100000004da.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.627 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:15:01.627 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.045260783000003, 2024-05-07T11:15:01.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0364360969999999, 2024-05-07T11:15:01.627 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.628 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.628 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.628 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.628 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.628 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.628 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 703 2024-05-07T11:15:01.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.628 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:15:01.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:15:01.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507399+0000", 2024-05-07T11:15:01.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3900000000000004e-07 2024-05-07T11:15:01.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507403+0000", 2024-05-07T11:15:01.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6739999999999999e-06 2024-05-07T11:15:01.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507442+0000", 2024-05-07T11:15:01.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9029000000000002e-05 2024-05-07T11:15:01.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507450+0000", 2024-05-07T11:15:01.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5490000000000001e-06 2024-05-07T11:15:01.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507516+0000", 2024-05-07T11:15:01.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6186999999999995e-05 2024-05-07T11:15:01.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.507524+0000", 2024-05-07T11:15:01.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.089e-06 2024-05-07T11:15:01.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539112+0000", 2024-05-07T11:15:01.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.031588272 2024-05-07T11:15:01.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539213+0000", 2024-05-07T11:15:01.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010114400000000001 2024-05-07T11:15:01.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543759+0000", 2024-05-07T11:15:01.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045452959999999999 2024-05-07T11:15:01.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543781+0000", 2024-05-07T11:15:01.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2654e-05 2024-05-07T11:15:01.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543835+0000", 2024-05-07T11:15:01.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3563999999999997e-05 2024-05-07T11:15:01.636 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.636 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.636 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.637 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:704 4.31 4:8fda2a12:::100000004db.00000000:head [write 0~1291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.637 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:15:01.637 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.044318244999999, 2024-05-07T11:15:01.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.015324031, 2024-05-07T11:15:01.637 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.637 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.637 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.638 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.638 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.638 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.638 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-05-07T11:15:01.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.638 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:15:01.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508341+0000", 2024-05-07T11:15:01.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508342+0000", 2024-05-07T11:15:01.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-05-07T11:15:01.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508346+0000", 2024-05-07T11:15:01.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8979999999999998e-06 2024-05-07T11:15:01.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508432+0000", 2024-05-07T11:15:01.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5970999999999994e-05 2024-05-07T11:15:01.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508441+0000", 2024-05-07T11:15:01.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8070000000000006e-06 2024-05-07T11:15:01.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508490+0000", 2024-05-07T11:15:01.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9746000000000001e-05 2024-05-07T11:15:01.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.508498+0000", 2024-05-07T11:15:01.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3069999999999997e-06 2024-05-07T11:15:01.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512221+0000", 2024-05-07T11:15:01.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0037235499999999 2024-05-07T11:15:01.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.512325+0000", 2024-05-07T11:15:01.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010419700000000001 2024-05-07T11:15:01.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523499+0000", 2024-05-07T11:15:01.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011173491000000001 2024-05-07T11:15:01.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523539+0000", 2024-05-07T11:15:01.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0207000000000003e-05 2024-05-07T11:15:01.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.523665+0000", 2024-05-07T11:15:01.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000126227 2024-05-07T11:15:01.646 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.646 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.646 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.646 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:706 4.33 4:cfe7d809:::100000004dd.00000000:head [write 0~1635] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.647 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:15:01.647 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.042423843000002, 2024-05-07T11:15:01.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025098705, 2024-05-07T11:15:01.647 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.647 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.647 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.647 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.647 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.647 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.648 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-05-07T11:15:01.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.648 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:15:01.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:15:01.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510236+0000", 2024-05-07T11:15:01.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2900000000000003e-07 2024-05-07T11:15:01.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510241+0000", 2024-05-07T11:15:01.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1860000000000002e-06 2024-05-07T11:15:01.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510251+0000", 2024-05-07T11:15:01.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0519e-05 2024-05-07T11:15:01.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510257+0000", 2024-05-07T11:15:01.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7540000000000003e-06 2024-05-07T11:15:01.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510288+0000", 2024-05-07T11:15:01.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0939999999999999e-05 2024-05-07T11:15:01.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.510292+0000", 2024-05-07T11:15:01.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8709999999999999e-06 2024-05-07T11:15:01.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526520+0000", 2024-05-07T11:15:01.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162282709999999 2024-05-07T11:15:01.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526924+0000", 2024-05-07T11:15:01.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00040356600000000001 2024-05-07T11:15:01.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535037+0000", 2024-05-07T11:15:01.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081130330000000004 2024-05-07T11:15:01.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535243+0000", 2024-05-07T11:15:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000206231 2024-05-07T11:15:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535334+0000", 2024-05-07T11:15:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1605000000000001e-05 2024-05-07T11:15:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:707 4.1f 4:f9c5e98a:::100000004de.00000000:head [write 0~167] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:15:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.041350409000003, 2024-05-07T11:15:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0267074679999999, 2024-05-07T11:15:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 707 2024-05-07T11:15:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:15:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511309+0000", 2024-05-07T11:15:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511311+0000", 2024-05-07T11:15:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-05-07T11:15:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511320+0000", 2024-05-07T11:15:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.55e-06 2024-05-07T11:15:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511347+0000", 2024-05-07T11:15:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6939000000000001e-05 2024-05-07T11:15:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511361+0000", 2024-05-07T11:15:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3517e-05 2024-05-07T11:15:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511444+0000", 2024-05-07T11:15:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3258999999999997e-05 2024-05-07T11:15:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.511456+0000", 2024-05-07T11:15:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1693e-05 2024-05-07T11:15:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530532+0000", 2024-05-07T11:15:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190759730000001 2024-05-07T11:15:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530656+0000", 2024-05-07T11:15:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000124602 2024-05-07T11:15:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537637+0000", 2024-05-07T11:15:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069806460000000001 2024-05-07T11:15:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.537697+0000", 2024-05-07T11:15:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.965e-05 2024-05-07T11:15:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538017+0000", 2024-05-07T11:15:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031985599999999998 2024-05-07T11:15:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:709 4.20 4:07c9e0c6:::100000004e0.00000000:head [write 0~228] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:15:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.039550605999999, 2024-05-07T11:15:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0250405359999999, 2024-05-07T11:15:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 709 2024-05-07T11:15:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:15:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513109+0000", 2024-05-07T11:15:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513110+0000", 2024-05-07T11:15:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9599999999999999e-07 2024-05-07T11:15:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513113+0000", 2024-05-07T11:15:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7440000000000001e-06 2024-05-07T11:15:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513124+0000", 2024-05-07T11:15:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-05-07T11:15:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513129+0000", 2024-05-07T11:15:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8670000000000002e-06 2024-05-07T11:15:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513169+0000", 2024-05-07T11:15:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0673000000000002e-05 2024-05-07T11:15:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.513175+0000", 2024-05-07T11:15:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8850000000000004e-06 2024-05-07T11:15:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531308+0000", 2024-05-07T11:15:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01813288 2024-05-07T11:15:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.531825+0000", 2024-05-07T11:15:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051728799999999997 2024-05-07T11:15:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538027+0000", 2024-05-07T11:15:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062020260000000002 2024-05-07T11:15:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538075+0000", 2024-05-07T11:15:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7822999999999999e-05 2024-05-07T11:15:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538149+0000", 2024-05-07T11:15:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4224e-05 2024-05-07T11:15:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:710 4.2c 4:341f65f3:::100000004e1.00000000:head [write 0~1858] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:15:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.038614576000001, 2024-05-07T11:15:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0189249300000001, 2024-05-07T11:15:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 710 2024-05-07T11:15:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:15:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514045+0000", 2024-05-07T11:15:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514046+0000", 2024-05-07T11:15:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1099999999999995e-07 2024-05-07T11:15:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514056+0000", 2024-05-07T11:15:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9890000000000004e-06 2024-05-07T11:15:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514066+0000", 2024-05-07T11:15:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0669000000000001e-05 2024-05-07T11:15:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514071+0000", 2024-05-07T11:15:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0440000000000003e-06 2024-05-07T11:15:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514144+0000", 2024-05-07T11:15:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2342999999999995e-05 2024-05-07T11:15:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.514149+0000", 2024-05-07T11:15:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9830000000000004e-06 2024-05-07T11:15:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526697+0000", 2024-05-07T11:15:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0125487419999999 2024-05-07T11:15:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.526801+0000", 2024-05-07T11:15:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103255 2024-05-07T11:15:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532860+0000", 2024-05-07T11:15:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060593050000000001 2024-05-07T11:15:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532901+0000", 2024-05-07T11:15:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1127000000000001e-05 2024-05-07T11:15:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.532970+0000", 2024-05-07T11:15:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8762000000000003e-05 2024-05-07T11:15:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:713 4.30 4:0deda1bb:::100000004e4.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:15:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.035888624000002, 2024-05-07T11:15:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.029021961, 2024-05-07T11:15:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 713 2024-05-07T11:15:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:15:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516771+0000", 2024-05-07T11:15:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516773+0000", 2024-05-07T11:15:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.773e-06 2024-05-07T11:15:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516783+0000", 2024-05-07T11:15:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0003000000000001e-05 2024-05-07T11:15:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516810+0000", 2024-05-07T11:15:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7025999999999998e-05 2024-05-07T11:15:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516823+0000", 2024-05-07T11:15:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.349e-05 2024-05-07T11:15:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516963+0000", 2024-05-07T11:15:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013989199999999999 2024-05-07T11:15:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.516976+0000", 2024-05-07T11:15:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3023000000000001e-05 2024-05-07T11:15:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542960+0000", 2024-05-07T11:15:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.025983847 2024-05-07T11:15:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.543076+0000", 2024-05-07T11:15:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115926 2024-05-07T11:15:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545679+0000", 2024-05-07T11:15:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026028660000000001 2024-05-07T11:15:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545723+0000", 2024-05-07T11:15:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4144999999999998e-05 2024-05-07T11:15:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.545793+0000", 2024-05-07T11:15:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9969999999999996e-05 2024-05-07T11:15:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:714 4.8 4:11045fd0:::100000004e5.00000000:head [write 0~1152] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:15:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.035042752999999, 2024-05-07T11:15:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017207508, 2024-05-07T11:15:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 714 2024-05-07T11:15:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:15:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517617+0000", 2024-05-07T11:15:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517619+0000", 2024-05-07T11:15:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8500000000000001e-06 2024-05-07T11:15:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517628+0000", 2024-05-07T11:15:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8230000000000006e-06 2024-05-07T11:15:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517655+0000", 2024-05-07T11:15:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7063000000000002e-05 2024-05-07T11:15:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517669+0000", 2024-05-07T11:15:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3373000000000001e-05 2024-05-07T11:15:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517767+0000", 2024-05-07T11:15:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7684999999999997e-05 2024-05-07T11:15:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.517780+0000", 2024-05-07T11:15:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-05-07T11:15:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530112+0000", 2024-05-07T11:15:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0123316520000001 2024-05-07T11:15:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.530216+0000", 2024-05-07T11:15:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010352 2024-05-07T11:15:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534327+0000", 2024-05-07T11:15:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041117109999999997 2024-05-07T11:15:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534746+0000", 2024-05-07T11:15:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041871699999999998 2024-05-07T11:15:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.534824+0000", 2024-05-07T11:15:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8300999999999995e-05 2024-05-07T11:15:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:715 4.5 4:a064f9e0:::100000004e6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:15:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.034235367999997, 2024-05-07T11:15:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.011571735, 2024-05-07T11:15:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 715 2024-05-07T11:15:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:15:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518424+0000", 2024-05-07T11:15:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518425+0000", 2024-05-07T11:15:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-06 2024-05-07T11:15:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518432+0000", 2024-05-07T11:15:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3799999999999999e-06 2024-05-07T11:15:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518448+0000", 2024-05-07T11:15:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6520000000000001e-05 2024-05-07T11:15:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518458+0000", 2024-05-07T11:15:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.023e-05 2024-05-07T11:15:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518552+0000", 2024-05-07T11:15:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4116000000000005e-05 2024-05-07T11:15:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.518559+0000", 2024-05-07T11:15:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:15:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518467+0000", 2024-05-07T11:15:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99990889000000005 2024-05-07T11:15:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.518566+0000", 2024-05-07T11:15:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8702999999999993e-05 2024-05-07T11:15:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529879+0000", 2024-05-07T11:15:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011313178 2024-05-07T11:15:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529925+0000", 2024-05-07T11:15:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5581999999999998e-05 2024-05-07T11:15:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529996+0000", 2024-05-07T11:15:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0983999999999997e-05 2024-05-07T11:15:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:718 4.14 4:2b3c11fc:::100000004e9.00000000:head [write 0~4607] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:15:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.031442689999999, 2024-05-07T11:15:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018966526, 2024-05-07T11:15:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 718 2024-05-07T11:15:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:15:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521217+0000", 2024-05-07T11:15:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521218+0000", 2024-05-07T11:15:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0100000000000004e-07 2024-05-07T11:15:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521231+0000", 2024-05-07T11:15:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3511e-05 2024-05-07T11:15:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521241+0000", 2024-05-07T11:15:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.009e-05 2024-05-07T11:15:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521246+0000", 2024-05-07T11:15:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7679999999999999e-06 2024-05-07T11:15:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521322+0000", 2024-05-07T11:15:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5609000000000001e-05 2024-05-07T11:15:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.521328+0000", 2024-05-07T11:15:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1090000000000003e-06 2024-05-07T11:15:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535347+0000", 2024-05-07T11:15:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0140196539999999 2024-05-07T11:15:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.535455+0000", 2024-05-07T11:15:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107967 2024-05-07T11:15:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.539991+0000", 2024-05-07T11:15:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045356470000000003 2024-05-07T11:15:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540111+0000", 2024-05-07T11:15:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120306 2024-05-07T11:15:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540183+0000", 2024-05-07T11:15:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2163999999999996e-05 2024-05-07T11:15:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:721 4.4 4:22e2046c:::100000004ec.00000000:head [write 0~541] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:15:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.028991611999999, 2024-05-07T11:15:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.018469157, 2024-05-07T11:15:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 721 2024-05-07T11:15:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:15:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:15:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523668+0000", 2024-05-07T11:15:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8500000000000001e-07 2024-05-07T11:15:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523672+0000", 2024-05-07T11:15:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8099999999999999e-06 2024-05-07T11:15:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523680+0000", 2024-05-07T11:15:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6009999999999997e-06 2024-05-07T11:15:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523685+0000", 2024-05-07T11:15:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8210000000000001e-06 2024-05-07T11:15:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523726+0000", 2024-05-07T11:15:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1489999999999997e-05 2024-05-07T11:15:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.523732+0000", 2024-05-07T11:15:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.322e-06 2024-05-07T11:15:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540011+0000", 2024-05-07T11:15:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0162798580000001 2024-05-07T11:15:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.540138+0000", 2024-05-07T11:15:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012710299999999999 2024-05-07T11:15:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541998+0000", 2024-05-07T11:15:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018595759999999999 2024-05-07T11:15:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542062+0000", 2024-05-07T11:15:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4405000000000004e-05 2024-05-07T11:15:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.542137+0000", 2024-05-07T11:15:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4585999999999994e-05 2024-05-07T11:15:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:722 4.1b 4:d822077b:::100000004ed.00000000:head [write 0~2291] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:15:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.028093257000002, 2024-05-07T11:15:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0139487410000001, 2024-05-07T11:15:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 722 2024-05-07T11:15:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:15:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524566+0000", 2024-05-07T11:15:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524567+0000", 2024-05-07T11:15:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-05-07T11:15:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524571+0000", 2024-05-07T11:15:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2339999999999996e-06 2024-05-07T11:15:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524582+0000", 2024-05-07T11:15:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0641e-05 2024-05-07T11:15:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524587+0000", 2024-05-07T11:15:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1699999999999996e-06 2024-05-07T11:15:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524632+0000", 2024-05-07T11:15:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916999999999997e-05 2024-05-07T11:15:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.524637+0000", 2024-05-07T11:15:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9819999999999999e-06 2024-05-07T11:15:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533786+0000", 2024-05-07T11:15:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0091495539999999 2024-05-07T11:15:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.533905+0000", 2024-05-07T11:15:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118318 2024-05-07T11:15:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538398+0000", 2024-05-07T11:15:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044935499999999998 2024-05-07T11:15:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538437+0000", 2024-05-07T11:15:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9069999999999997e-05 2024-05-07T11:15:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.538515+0000", 2024-05-07T11:15:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7618000000000001e-05 2024-05-07T11:15:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4549.0:727 4.32 4:4e56ffee:::100000004f2.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-05-07T11:15:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:15:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.023793394999998, 2024-05-07T11:15:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.012618123, 2024-05-07T11:15:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-05-07T11:15:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-05-07T11:15:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T11:15:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-05-07T11:15:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4549", 2024-05-07T11:15:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/2574162390", 2024-05-07T11:15:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 727 2024-05-07T11:15:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-05-07T11:15:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-05-07T11:15:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:15:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-05-07T11:15:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528866+0000", 2024-05-07T11:15:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-05-07T11:15:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-05-07T11:15:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528867+0000", 2024-05-07T11:15:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7199999999999998e-07 2024-05-07T11:15:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-05-07T11:15:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528870+0000", 2024-05-07T11:15:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7000000000000002e-06 2024-05-07T11:15:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-05-07T11:15:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528881+0000", 2024-05-07T11:15:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0121e-05 2024-05-07T11:15:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-05-07T11:15:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528885+0000", 2024-05-07T11:15:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6539999999999998e-06 2024-05-07T11:15:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528949+0000", 2024-05-07T11:15:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4202000000000006e-05 2024-05-07T11:15:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for peered", 2024-05-07T11:15:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:24.528954+0000", 2024-05-07T11:15:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8740000000000003e-06 2024-05-07T11:15:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-05-07T11:15:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.528880+0000", 2024-05-07T11:15:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.99992558300000001 2024-05-07T11:15:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-05-07T11:15:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.529010+0000", 2024-05-07T11:15:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013028900000000001 2024-05-07T11:15:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-05-07T11:15:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541362+0000", 2024-05-07T11:15:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012351499 2024-05-07T11:15:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-05-07T11:15:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541406+0000", 2024-05-07T11:15:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4620999999999999e-05 2024-05-07T11:15:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-07T11:15:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-05-07T11:15:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-05-07T11:15:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-05-07T11:14:25.541484+0000", 2024-05-07T11:15:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7908e-05 2024-05-07T11:15:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-07T11:15:01.756 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-07T11:15:01.756 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-07T11:15:02.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T11:15:03.884 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~36s 2024-05-07T11:15:04.022 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-05-07T11:15:04.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T11:15:05.026 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-05-07T11:15:05.198 INFO:tasks.thrashosds.thrasher:reviving osd 2024-05-07T11:15:05.199 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-05-07T11:15:05.199 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi149.front.sepia.ceph.com 2024-05-07T11:15:05.199 INFO:teuthology.orchestra.console.smithi149:Power on 2024-05-07T11:15:05.199 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-05-07T11:15:05.222 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On 2024-05-07T11:15:05.222 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:15:05.244 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-05-07T11:15:09.245 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:15:09.356 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-05-07T11:15:09.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-05-07T11:15:13.358 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:15:13.469 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-05-07T11:15:13.571 INFO:teuthology.orchestra.console.smithi149:Power on completed 2024-05-07T11:15:13.672 DEBUG:teuthology.orchestra.console.smithi149:Waiting for login prompt 2024-05-07T11:15:13.672 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi149 2024-05-07T11:15:15.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-05-07T11:15:21.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-05-07T11:15:27.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-05-07T11:15:32.924 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2024-05-07T11:15:38.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-05-07T11:15:44.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-05-07T11:15:50.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-05-07T11:15:56.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-05-07T11:16:01.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-05-07T11:16:07.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~99s 2024-05-07T11:16:13.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-05-07T11:16:19.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-05-07T11:16:25.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-05-07T11:16:31.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~123s 2024-05-07T11:16:36.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~129s 2024-05-07T11:16:42.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~134s 2024-05-07T11:16:48.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-05-07T11:16:54.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~146s 2024-05-07T11:17:00.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~152s 2024-05-07T11:17:05.844 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~158s 2024-05-07T11:17:09.504 DEBUG:teuthology.orchestra.console.smithi149:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.72 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 7D 57 GUID: 00000000 0000 0000 0000 0CC47ADA6BA4 DHCP./                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.149 MA : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.149 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:7d:57)... Configuring (net0 0c:c4:7a:88:7d:57).... Configuring (net0 0c:c4:7a:88:7d:57)..... Configuring (net0 0c:c4:7a:88:7d:57)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-444.el9.x86_64) 9  CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9              The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-444.el9.x86_64) 9   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9            Use the * and * keys to change the selection.  The selected entry will be started automatically in 4s.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-444.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Fri Apr 26 18:25:52 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-444.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000047fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.698 MHz processor [ 0.000398] last_pfn = 0x480000 max_arch_pfn = 0x400000000 [ 0.000402] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000403] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000736] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006382] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006391] Using GB pages for direct mapping [ 0.006504] RAMDISK: [mem 0x342c0000-0x36157fff] [ 0.006506] ACPI: Early table checksum verification disabled [ 0.006508] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006511] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006516] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006520] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006523] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006525] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006527] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006530] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006532] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006534] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006537] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006539] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006541] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006544] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006546] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006548] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006551] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006553] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006556] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006558] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006560] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006563] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006565] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006567] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006568] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006569] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006569] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006570] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006570] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006571] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006572] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006572] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006573] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006573] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006574] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006575] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006575] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006576] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006576] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006577] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006578] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006578] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006579] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006580] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006626] No NUMA configuration found [ 0.006626] Faking a node at [mem 0x0000000000000000-0x000000047fffffff] [ 0.006635] NODE_DATA(0) allocated [mem 0x47ffd5000-0x47fffffff] [ 0.006819] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 16270MB) [ 0.006842] Zone ranges: [ 0.006842] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006844] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006845] Normal [mem 0x0000000100000000-0x000000047fffffff] [ 0.006846] Device empty [ 0.006847] Movable zone start for each node [ 0.006849] Early memory node ranges [ 0.006850] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006851] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006852] node 0: [mem 0x0000000100000000-0x000000047fffffff] [ 0.006854] Initmem setup node 0 [mem 0x0000000000001000-0x000000047fffffff] [ 0.006859] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006900] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.012545] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.012656] ACPI: PM-Timer IO Port: 0x408 [ 0.012664] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012666] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012666] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012667] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012667] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012668] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012668] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012669] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012678] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012682] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012684] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012685] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012689] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012690] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012694] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012695] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012705] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012706] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.012707] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012708] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.012709] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.012709] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.012710] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.012710] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012711] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012711] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012712] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012713] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012714] Booting paravirtualized kernel on bare hardware [ 0.012716] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.017090] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.017338] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.017363] Fallback order for Node 0: 0 [ 0.017365] Built 1 zonelists, mobility grouping on. Total pages: 4099978 [ 0.017366] Policy zone: Normal [ 0.017367] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-444.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.017424] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-444.el9.x86_64", will be passed to user space. [ 0.017440] random: crng init done [ 0.018547] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.019149] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) [ 0.019404] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.019414] software IO TLB: area num 8. [ 0.047567] Memory: 1751988K/16660796K available (16384K kernel code, 5637K rwdata, 11892K rodata, 3932K init, 5872K bss, 700632K reserved, 0K cma-reserved) [ 0.047674] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.047682] Kernel/User page tables isolation: enabled [ 0.047707] ftrace: allocating 47201 entries in 185 pages [ 0.065935] ftrace: allocated 185 pages with 5 groups [ 0.066452] Dynamic Preempt: voluntary [ 0.066483] rcu: Preemptible hierarchical RCU implementation. [ 0.066483] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.066485] Trampoline variant of Tasks RCU enabled. [ 0.066485] Rude variant of Tasks RCU enabled. [ 0.066485] Tracing variant of Tasks RCU enabled. [ 0.066486] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.066487] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069694] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.069857] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.069965] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.075205] Console: colour VGA+ 80x25 [ 1.112281] printk: console [ttyS1] enabled [ 1.116474] ACPI: Core revision 20230331 [ 1.120566] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.129695] APIC: Switch to symmetric I/O mode setup [ 1.134666] DMAR: Host address width 46 [ 1.138510] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.143824] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.151820] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.158087] DMAR: ATSR flags: 0x0 [ 1.161408] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.167675] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.174027] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.180379] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.185781] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.185781] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.200851] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.206160] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.212373] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.222702] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327233a889f, max_idle_ns: 440795284032 ns [ 1.233215] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.39 BogoMIPS (lpj=3499698) [ 1.234234] CPU0: Thermal monitoring enabled (TM1) [ 1.235268] process: using mwait in idle threads [ 1.236215] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.237214] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.238215] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.239215] Spectre V2 : Mitigation: Retpolines [ 1.240214] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.241214] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.242214] Speculative Store Bypass: Vulnerable [ 1.243220] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.244214] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.245214] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.246217] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.247214] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.248214] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.249214] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.250214] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.262872] Freeing SMP alternatives memory: 36K [ 1.263214] pid_max: default: 32768 minimum: 301 [ 1.264233] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.265219] Yama: becoming mindful. [ 1.266217] SELinux: Initializing. [ 1.267230] LSM support for eBPF active [ 1.268252] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes, linear) [ 1.269233] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes, linear) [ 1.373255] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.375304] cblist_init_generic: Setting adjustable number of callback queues. [ 1.376214] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.377225] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.378223] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.379222] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.380214] ... version: 3 [ 1.381214] ... bit width: 48 [ 1.382214] ... generic registers: 4 [ 1.383214] ... value mask: 0000ffffffffffff [ 1.384214] ... max period: 00007fffffffffff [ 1.385214] ... fixed-purpose events: 3 [ 1.386214] ... event mask: 000000070000000f [ 1.387297] signal: max sigframe size: 1776 [ 1.388225] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.389239] rcu: Hierarchical SRCU implementation. [ 1.389239] rcu: Max phase no-delay instances is 400. [ 1.389247] printk: console [ttyS1] printing thread started [ 1.393815] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.393881] smp: Bringing up secondary CPUs ... [ 1.393949] smpboot: x86: Booting SMP configuration: [ 1.393950] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.400474] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.400474] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.400474] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.400474] smp: Brought up 1 node, 8 CPUs [ 1.400474] smpboot: Max logical packages: 1 [ 1.400474] smpboot: Total of 8 processors activated (55995.16 BogoMIPS) [ 1.442235] node 0 deferred pages initialised in 33ms [ 1.443505] devtmpfs: initialized [ 1.443505] x86/mm: Memory block size: 128MB [ 1.444536] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.444536] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.444536] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.444536] pinctrl core: initialized pinctrl subsystem [ 1.463087] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.463181] DMA: preallocated 2048 KiB GFP_KERNEL pool for atomic allocations [ 1.463190] DMA: preallocated 2048 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.463201] DMA: preallocated 2048 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.463209] audit: initializing netlink subsys (disabled) [ 1.463229] audit: type=2000 audit(1715080600.250:1): state=initialized audit_enabled=0 res=1 [ 1.463283] thermal_sys: Registered thermal governor 'fair_share' [ 1.463284] thermal_sys: Registered thermal governor 'step_wise' [ 1.463284] thermal_sys: Registered thermal governor 'user_space' [ 1.473216] cpuidle: using governor menu [ 1.480244] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.480245] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.480297] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.480300] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.480308] PCI: Using configuration type 1 for base access [ 1.491242] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.491246] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.491246] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.491246] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.491246] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.498254] cryptd: max_cpu_qlen set to 1000 [ 1.505977] ACPI: Added _OSI(Module Device) [ 1.505978] ACPI: Added _OSI(Processor Device) [ 1.505978] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.505979] ACPI: Added _OSI(Processor Aggregator Device) [ 1.505979] ACPI: Added _OSI(Linux-Dell-Video) [ 1.505980] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.505981] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.537584] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.539741] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.541304] ACPI: Dynamic OEM Table Load: [ 1.562585] ACPI: _OSC evaluated successfully for all CPUs [ 1.562843] ACPI: Interpreter enabled [ 1.562853] ACPI: PM: (supports S0 S4 S5) [ 1.562854] ACPI: Using IOAPIC for interrupt routing [ 1.564376] HEST: Enabling Firmware First mode for corrected errors. [ 1.607837] HEST: Table parsing has been initialized. [ 1.607971] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.607974] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.607975] PCI: Using E820 reservations for host bridge windows [ 1.608590] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.632450] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.632454] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.633579] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.634103] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.634103] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.634129] PCI host bridge to bus 0000:ff [ 1.634131] pci_bus 0000:ff: root bus resource [bus ff] [ 1.634141] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.634187] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.634222] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.634252] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.634281] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.634310] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.634340] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.634368] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.634397] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.634426] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.634455] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.634483] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.634511] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.634540] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.634569] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.634598] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.634625] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.634653] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.634681] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.634701] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.634736] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634795] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634854] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634912] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634970] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635028] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635085] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.635131] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.635179] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635229] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635270] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635310] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635350] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.635380] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.635412] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.635442] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.635474] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635515] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635556] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635598] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635639] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.635674] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.635706] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.635737] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.635770] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.635800] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.635832] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.635861] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.635895] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.635924] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.635953] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.635983] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.636003] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventil PCI endpoint [ 1.636034] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.636064] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.638297] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.638300] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.638432] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.638669] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.638670] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.639082] PCI host bridge to bus 0000:00 [ 1.639083] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.639085] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.639086] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.639087] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.639088] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.639088] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.639089] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.639108] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.639209] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.639222] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.639258] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.639349] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.639360] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.639363] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.639396] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.639484] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.639495] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.639497] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.639499] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.639503] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.639532] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.639614] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639622] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.639696] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639703] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.639776] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639783] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.639857] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639864] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.639935] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639942] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.640014] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640021] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.640093] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640100] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.640175] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640182] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.640257] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640318] pci 0000:00:05.1: 000 PCIe Root Co640398] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640454] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.640459] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.640538] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.640773] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.640792] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.640803] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.640814] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.640825] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.640836] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.640848] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.640904] pci 0000:00:11.4: PME# suppo40982] pci 0000:lass 0x0c0330 co41006] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.641092] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.641179] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.641202] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.641291] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.641358] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.641382] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.641469] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.641554] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.641576] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.641692] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.641771] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.641807] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.641898] pci 0000:00:1c.0: PME# s[ 1.641999] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Po642037] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.642041] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.642045] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.642133] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.642231] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.642271] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.642276] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.642279] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.642367] pci 0000:ME# supported from D0 D3hot D3cold [ 1.642472] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.642492] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.642609] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.642691] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.642894] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.642912] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.642922] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.642933] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.642943] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.642955] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.642965] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.643017] pci 0000:00:1f.2: PME# supported from D3hot [ 1.643080] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.643103] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.643133] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.643295] acpiphp: Slot [1] registered [ 1.643306] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.643411] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.643420] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.643436] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.643440] pci 0000:02:00.0: enabling Extended Tags [ 1.643542] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.643648] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.643658] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.643663] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.643673] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.643677] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.643713] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.643729] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.643730] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.643739] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.643740] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.643890] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.643899] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.643904] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.643914] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.643918] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.643954] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.643967] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.643968] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.643976] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.643977] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.644115] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.644160] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.644255] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.644328] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.644341] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.644346] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.644400] pci 0000:05:00.0: enabling Extended Tags [ 1.644532] pci 0000:05:00.0: supports D1 D2 [ 1.644532] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.644709] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.644796] pci_bus 0000:06: extended config space not accessible [ 1.644829] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.644866] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.644885] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.644905] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.645004] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.645074] pci 0000:06:00.0: supports D1 D2 [ 1.645074] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.645224] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.645366] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.645396] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.645432] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.645450] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.645673] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.645734] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645735] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.645769] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645770] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.646101] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.646136] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.646173] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.646191] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.646407] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.646468] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.646469] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.646502] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.646502] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.646798] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.646810] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.647478] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.647509] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.647537] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.647565] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.647595] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.647595] ACPI: PCI: Interrupt link LNKE disabled [ 1.647625] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.647625] ACPI: PCI: Interrupt link LNKF disabled [ 1.647653] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.647653] ACPI: PCI: Interrupt link LNKG disabled [ 1.647683] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.647684] ACPI: PCI: Interrupt link LNKH disabled [ 1.648224] iommu: Default domain type: Translated [ 1.648224] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.648294] SCSI subsystem initialized [ 1.648309] ACPI: bus type USB registered [ 1.648320] usbcore: registered new interface driver usbfs [ 1.648326] usbcore: registered new interface driver hub [ 1.648331] usbcore: registered new device driver usb [ 1.648350] pps_core: LinuxPPS API ver. 1 registered [ 1.648351] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.648353] PTP clock support registered [ 1.648366] EDAC MC: Ver: 3.0.0 [ 1.648386] NetLabel: Initializing [ 1.648387] NetLabel: domain hash size = 128 [ 1.648387] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.648400] NetLabel: unlabeled traffic allowed by default [ 1.648400] PCI: Using ACPI for IRQ routing [ 1.659238] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.659240] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.659240] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.659242] vgaarb: loaded [ 1.659257] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.659261] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.662378] clocksource: Switched to clocksource tsc-early [ 1.732544] VFS: Disk quotas dquot_6.6.0 [ 1.732555] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.732619] pnp: PnP ACPI init [ 1.733064] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.733067] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.733069] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.733070] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.733072] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.733073] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.733075] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.733077] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.733078] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.733080] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.733081] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.733083] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.733084] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.733291] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.733293] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.733294] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.733295] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.733297] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.734232] pnp: PnP ACPI: found 5 devices [ 1.739868] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.739924] NET: Registered PF_INET protocol family [ 1.740110] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.743518] tcp_listen_portaddr_hash hash table entries: 8192 (order: 5, 131072 bytes, linear) [ 1.743542] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.743549] TCP established hash table entries: 131072 (order: 8, 1048576 bytes, linear) [ 1.743724] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.743884] TCP: Hash tables configured (established 131072 bind 65536) [ 1.743967] MPTCP token hash table entries: 16384 (order: 6, 393216 bytes, linear) [ 1.744018] UDP hash table entries: 8192 (order: 6, 262144 bytes, linear) [ 1.744060] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes, linear) [ 1.744125] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.744130] NET: Registered PF_XDP protocol family [ 1.744151] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.744161] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.744163] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.744168] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.744169] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.744175] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744176] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744178] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744178] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744180] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744181] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744182] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744182] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744184] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744185] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744186] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744187] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744188] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744189] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744190] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744191] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744192] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.744193] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.744195] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.744196] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.744199] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.744219] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.744222] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.744230] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.744246] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.744247] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.744253] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.744262] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.744268] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.744274] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.744280] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.744287] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.744288] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.744294] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.744298] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.744303] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.744304] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.744305] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.744306] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.744307] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.744308] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.744308] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.744310] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.744310] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.744311] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.744312] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.744313] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.744314] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.744314] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.744315] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.744316] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.744317] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.744317] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.744463] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.761257] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16237 usecs [ 1.777255] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 15607 usecs [ 1.777269] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.777311] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.777312] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.777318] ACPI: bus type thunderbolt registered [ 1.777325] Trying to unpack rootfs image as initramfs... [ 1.843310] Initialise system trusted keyrings [ 1.843323] Key type blacklist registered [ 1.843374] workingset: timestamp_bits=36 max_order=22 bucket_order=0 [ 1.843392] zbud: loaded [ 1.930779] integrity: Platform Keyring initialized [ 1.930785] integrity: Machine keyring initialized [ 1.938768] NET: Registered PF_ALG protocol family [ 1.938770] xor: automatically using best checksumming function avx [ 1.938771] Key type asymmetric registered [ 1.938772] Asymmetric key parser 'x509' registered [ 1.938773] Running certificate verification selftests [ 1.940297] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.942227] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.942249] io scheduler mq-deadline registered [ 1.942250] io scheduler kyber registered [ 1.942256] io scheduler bfq registered [ 1.972093] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.972439] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.972593] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.972734] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.972864] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.973016] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.973160] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.973322] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.973397] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.997066] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.997089] ACPI: button: Power Button [PWRB] [ 1.997112] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.997211] ACPI: button: Power Button [PWRF] [ 2.013634] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.013636] pstore: Registered erst as persistent store backend [ 2.013739] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.013826] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.022646] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.032303] Non-volatile memory driver v1.3 [ 2.041333] rdac: device handler registered [ 2.041367] hp_sw: device handler registered [ 2.041368] emc: device handler registered [ 2.041395] alua: device handler registered [ 2.041700] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.041729] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 2.041743] ehci-pci 0000:00:1d.0: debug port 2 [ 2.045694] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.052243] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.052306] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.052309] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.052311] usb usb1: Product: EHCI Host Controller [ 2.052313] usb usb1: Manufacturer: Linux 5.14.0-444.el9.x86_64 ehci_hcd [ 2.052314] usb usb1: SerialNumber: 0000:00:1d.0 [ 2.052433] hub 1-0:1.0: USB hub found [ 2.052442] hub 1-0:1.0: 2 ports detected [ 2.052636] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.052672] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.053759] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.053959] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.053973] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.054031] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 2.054031] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 2.054034] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.054050] ehci-pci 0000:00:1a.0: debug port 2 [ 2.054062] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.054064] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.054065] usb usb2: Product: xHCI Host Controller [ 2.054065] usb usb2: Manufacturer: Linux 5.14.0-444.el9.x86_64 xhci-hcd [ 2.054066] usb usb2: SerialNumber: 0000:00:14.0 [ 2.054154] hub 2-0:1.0: USB hub found [ 2.054184] hub 2-0:1.0: 15 ports detected [ 2.055914] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.055916] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.055917] usb usb4: Product: xHCI Host Controller [ 2.055917] usb usb4: Manufacturer: Linux 5.14.0-444.el9.x86_64 xhci-hcd [ 2.055918] usb usb4: SerialNumber: 0000:00:14.0 [ 2.056006] hub 4-0:1.0: USB hub found [ 2.056024] hub 4-0:1.0: 6 ports detected [ 2.056945] usbcore: registered new interface driver usbserial_generic [ 2.056949] usbserial: USB Serial support registered for generic [ 2.056983] i8042: PNP: No PS/2 controller found. [ 2.057031] mousedev: PS/2 mouse device common for all mice [ 2.057088] rtc_cmos 00:00: RTC can wake from S4 [ 2.057405] rtc_cmos 00:00: registered as rtc0 [ 2.057459] rtc_cmos 00:00: setting system clock to 2024-05-07T11:16:42 UTC (1715080602) [ 2.057484] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.057954] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.059988] intel_pstate: Intel P-state driver initializing [ 2.064222] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.064258] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.064260] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.064261] usb usb3: Product: EHCI Host Controller [ 2.064262] usb usb3: Manufacturer: Linux 5.14.0-444.el9.x86_64 ehci_hcd [ 2.064263] usb usb3: SerialNumber: 0000:00:1a.0 [ 2.064350] hub 3-0:1.0: USB hub found [ 2.064355] hub 3-0:1.0: 2 ports detected [ 2.086248] hid: raw HID events driver (C) Jiri Kosina [ 2.086281] usbcore: registered new interface driver usbhid [ 2.086282] usbhid: USB HID core driver [ 2.086311] drop_monitor: Initializing network drop monitor service [ 2.095187] Initializing XFRM netlink socket [ 2.095212] NET: Registered PF_INET6 protocol family [ 2.098403] Freeing initrd memory: 31328K [ 2.103149] Segment Routing with IPv6 [ 2.103171] NET: Registered PF_PACKET protocol family [ 2.103195] mpls_gso: MPLS GSO support [ 2.122962] microcode: Current revision: 0x0b00001b [ 2.147735] resctrl: L3 allocation detected [ 2.147736] resctrl: L3 monitoring detected [ 2.147749] IPI shorthand broadcast: enabled [ 2.147753] AVX2 version of gcm_enc/dec engaged. [ 2.201455] AES CTR mode by8 optimization enabled [ 2.201497] sched_clock: Marking stable (1057886488, 1143327501)->(2545470572, -344256583) [ 2.226313] registered taskstats version 1 [ 2.242978] Loading compiled-in X.509 certificates [ 2.243510] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: 2a5a5cd513b4e8668929c8232d899a1b35d52dcb' [ 2.243775] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.244033] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.244167] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.244175] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.244363] zswap: loaded using pool lzo/zbud [ 2.261054] page_owner is disabled [ 2.261276] pstore: Using crash dump compression: deflate [ 2.261285] Key type big_key registered [ 2.294249] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.302247] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 2.323341] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.383740] Key type encrypted registered [ 2.383746] ima: No TPM chip found, activating TPM-bypass! [ 2.383748] Loading compiled-in module X.509 certificates [ 2.384028] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: 2a5a5cd513b4e8668929c8232d899a1b35d52dcb' [ 2.384030] ima: Allocated hash algorithm: sha256 [ 2.384039] ima: No architecture policies found [ 2.384046] evm: Initialising EVM extended attributes: [ 2.384046] evm: security.selinux [ 2.384047] evm: security.SMACK64 (disabled) [ 2.384047] evm: security.SMACK64EXEC (disabled) [ 2.384048] evm: security.SMACK64TRANSMUTE (disabled) [ 2.384048] evm: security.SMACK64MMAP (disabled) [ 2.384048] evm: security.apparmor (disabled) [ 2.384049] evm: security.ima [ 2.384049] evm: security.capability [ 2.384050] evm: HMAC attrs: 0x1 [ 2.423438] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.423440] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.423844] hub 2-12:1.0: USB hub found [ 2.423920] hub 2-12:1.0: 4 ports detected [ 2.433644] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.433646] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.433796] hub 3-1:1.0: USB hub found [ 2.433895] hub 3-1:1.0: 6 ports detected [ 2.468649] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.468652] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.468800] hub 1-1:1.0: USB hub found [ 2.468895] hub 1-1:1.0: 8 ports detected [ 2.720241] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.780232] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.780235] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.785069] clocksource: Switched to clocksource tsc [ 2.824760] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.824762] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.829724] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.881360] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.884057] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.884107] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.252452] clk: Disabling unused clocks [ 5.253356] Freeing unused decrypted memory: 2028K [ 5.262411] Freeing unused kernel image (initmem) memory: 3932K [ 5.271251] Write protecting the kernel read-only data: 28672k [ 5.271446] Freeing unused kernel image (rodata/data gap) memory: 396K [ 5.320414] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.320416] x86/mm: Checking user space page tables [ 5.358417] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.358428] Run /init as init process [ 5.372225] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.372341] systemd[1]: Detected architecture x86-64. [ 5.372342] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.423422] systemd[1]: Hostname set to . [ OK [[ 5.481535] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.481648] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.503376] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.517285] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.529353] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.540308] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.552492] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.567378] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.581533] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.593453] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.607478] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.621285] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.639865] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.655297] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.668156] systemd[1]: Starting Load Kernel Modules... g Load Kernel Modules... Startin[ 5.680892] systemd[1]: Starting Create System Users... g Create System Users... [ 5.689355] fuse: init (API version 7.36) Startin[ 5.695519] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.707983] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 6.087404] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started [0;[ 6.127616] igb: Intel(R) Gigabit Ethernet Network Driver 1;39mShow Plymou[ 6.127618] igb: Copyright (c) 2007-2014 Intel Corporation. th Boot Screen. [ OK ] Started Forward Password R…s to Plymouth Directory Watch. [ OK ] Reached target Path Units. [ OK [ 6.156508] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver ] Reached target Basic System.[ 6.156511] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.176210] nvme nvme0: pci function 0000:02:00.0 [ 6.176325] ACPI: bus type drm_connector registered [ 6.188163] nvme nvme0: 8/0/0 default/read/poll queues [ 6.194415] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.194418] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.207787] igb 0000:07:00.0: added PHC on eth0 [ 6.207813] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.207814] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:da:6b:a4 [ 6.207888] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.207889] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.211469] scsi host0: ahci [ 6.211605] scsi host1: ahci [ 6.211713] scsi host2: ahci [ 6.211820] scsi host3: ahci [ 6.211870] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 lpm-pol 0 [ 6.211873] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 lpm-pol 0 [ 6.211875] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 lpm-pol 0 [ 6.211878] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 lpm-pol 0 [ 6.212168] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.212171] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.229613] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.229619] scsi host4: ahci [ 6.229726] scsi host5: ahci [ 6.229811] scsi host6: ahci [ 6.229929] scsi host7: ahci [ 6.230056] scsi host8: ahci [ 6.230148] scsi host9: ahci [ 6.230193] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 lpm-pol 0 [ 6.230196] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 lpm-pol 0 [ 6.230198] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 lpm-pol 0 [ 6.230201] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 lpm-pol 0 [ 6.230202] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 lpm-pol 0 [ 6.230204] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 lpm-pol 0 [ 6.256375] Console: switching to colour dummy device 80x25 [ 6.256517] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.256518] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.256528] ast 0000:06:00.0: [drm] Using analog VGA [ 6.256534] ast 0000:06:00.0: [drm] dr=16 [ 6.256708] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.265653] igb 0000:07:00.1: added PHC on eth1 [ 6.265681] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.265682] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:da:6b:a5 [ 6.265756] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.265757] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.270637] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.277049] fbcon: astdrmfb (fb0) is primary device [ 6.288558] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.302006] Console: switching to colour frame buffer device 128x48 [ 6.320715] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.521970] ata4: SATA link down (SStatus 0 SControl 300) [ 6.522002] ata2: SATA link down (SStatus 0 SControl 300) [ 6.522029] ata3: SATA link down (SStatus 0 SControl 300) [ 6.522057] ata1: SATA link down (SStatus 0 SControl 300) [ 6.537312] ata10: SATA link down (SStatus 0 SControl 300) [ 6.537427] ata8: SATA link down (SStatus 0 SControl 300) [ 6.537452] ata9: SATA link down (SStatus 0 SControl 300) [ 6.537756] ata7: SATA link down (SStatus 0 SControl 300) [ 6.537793] ata6: SATA link down (SStatus 0[ 6.541207] a Gbps (SStatus 1[ 6.611914] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.612469] ata5.00: NCQ Send/Recv Log not supported [ 6.612470] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.613972] ata5.00: NCQ Send/Recv Log not supported [ 6.613975] ata5.00: configured for UDMA/133 [ 6.614078] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.666498] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.673163] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.673177] sd 4:0:0:0: [sda] Write Protect is off [ 6.673194] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.673218] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.689521] sda: sda1 [ 6.689571] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.297531] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.297819] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.297901] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.297902] ixgbe 0000:03:00.0: 0c:c4:7a:88:7d:56 [ 7.300266] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.457457] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.457745] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.457826] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.457828] ixgbe 0000:03:00.1: 0c:c4:7a:88:7d:57 [ 7.460821] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.469416] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.502262] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.740143] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. [ 8.079739] systemd-journald[279]: Received SIGTERM from PID 1 (systemd). Starting Switch Root... [ 8.642855] SELinux: policy capability network_peer_controls=1 [ 8.642858] SELinux: policy capability open_perms=1 [ 8.642858] SELinux: policy capability extended_socket_class=1 [ 8.642859] SELinux: policy capability always_check_network=0 [ 8.642859] SELinux: policy capability cgroup_seclabel=1 [ 8.642860] SELinux: policy capability nnp_nosuid_transition=1 [ 8.642860] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.687170] audit: type=1403 audit(1715080609.128:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.689348] systemd[1]: Successfully loaded SELinux policy in 121.534ms. [ 8.748408] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 25.422ms. [ 8.760403] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.760514] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.656983] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.657081] systemd[1]: Stopped Switch Root. [ OK [[ 9.668899] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.669203] systemd[1]: Created slice Slice /system/getty. [ 9.669516] systemd[1]: Created slice Slice /system/modprobe. 0m] Stopped [0;[ 9.690505] systemd[1]: Created slice Slice /system/serial-getty. [ 9.690768] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.691016] systemd[1]: Created slice User and Session Slice. [ 9.691047] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.691145] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.691537] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. 1;39mSwitch Root[ 9.710325] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.731973] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. . [[ 9.741375] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. OK ] Crea[ 9.775125] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.775154] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.775190] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.775222] systemd[1]: Reached target Local Encrypted Volumes. [ 9.797575] systemd[1]: Stopped target Switch Root. ted slice [0;1;[ 9.819311] systemd[1]: Stopped target Initrd File Systems. [ 9.819331] systemd[1]: Stopped target Initrd Root File System. [ 9.819356] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.819401] systemd[1]: Reached target Path Units. [ 9.819435] systemd[1]: Reached target Slice Units. 39mSlice /system[ 9.819466] systemd[1]: Reached target Swaps. [ 9.819493] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.819861] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.831548] systemd[1]: Listening on LVM2 poll daemon socket. [ 9.863887] systemd[1]: Listening on RPCbind Server Activation Socket. /getty. [[ 9.879778] systemd[1]: Reached target RPC Port Mapper. [ 9.881394] systemd[1]: Listening on Process Core Dump Socket. [0;32m OK [ 9.892245] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.892669] systemd[1]: Listening on udev Control Socket. [ 9.892905] systemd[1]: Listening on udev Kernel Socket. ] Created slice Slice /[ 9.911291] systemd[1]: Mounting Huge Pages File System... system/modprobe[ 9.912189] systemd[1]: Mounting POSIX Message Queue File System... [0m. [ [ 9.913401] systemd[1]: Mounting Kernel Debug File System... [ 9.920036] systemd[1]: Mounting Kernel Trace File System... OK ] Creat[ 9.926784] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). ed slice [0;1;3[ 9.954127] systemd[1]: Starting Create List of Static Device Nodes... 9mSlice /system/[ 9.954938] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... serial-getty. [ OK[ 9.974373] systemd[1]: Starting Load Kernel Module configfs... [ 9.975164] systemd[1]: Starting Load Kernel Module drm... [ 9.975995] systemd[1]: Starting Load Kernel Module fuse... ] Created slice S[ 9.994916] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.994995] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 9.995042] systemd[1]: Stopped Plymouth switch root service. [ 9.995238] systemd[1]: Stopped Journal Service. lice /system/sshd-keygen. [ 10.023458] systemd[1]: Starting Journal Service... [ 10.025830] systemd[1]: Starting Load Kernel Modules... [ OK ] Created slic[ 10.035746] systemd[1]: Starting Generate network units from Kernel command line... [ 10.035790] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). e User [ 10.036610] systemd[1]: Starting Remount Root and Kernel File Systems... [ 10.069603] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. [ 10.072027] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. and Session Slic[ 10.072963] systemd[1]: Starting Coldplug All udev Devices... [ 10.091395] systemd[1]: Mounted Huge Pages File System. e. [[0;32[ 10.102870] systemd[1]: Mounted POSIX Message Queue File System. [ 10.103028] systemd[1]: Mounted Kernel Debug File System. m OK ] Sta[ 10.103177] systemd[1]: Mounted Kernel Trace File System. rted Fo[ 10.103522] systemd[1]: Finished Create List of Static Device Nodes. rward Password R[ 10.115704] systemd[1]: modprobe@configfs.service: Deactivated successfully. [ 10.115801] systemd[1]: Finished Load Kernel Module configfs. [ 10.130134] systemd[1]: Started Journal Service. …uests to Wall Directory Watch. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ OK ] Reached target ceph target…on@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ 10.225439] systemd-journald[580]: Received client request to flush runtime journal. [ OK [ 10.235666] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.235687] device-mapper: uevent: version 1.0.3 [ 10.235792] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module configfs. [ OK ] Started Journal Service. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Apply Kernel Variables... Starting Create Static Device Nodes in /dev... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs[ 10.674805] IPMI message handler: version 39.2 [0m... [ 10.681255] ipmi device interface Starting Load Kernel [ 10.686987] ipmi_si: IPMI System Interface driver Module fuse.[ 10.687003] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.687005] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.687007] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.687064] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.687279] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.687690] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.687692] ipmi_si: Adding ACPI-specified kcs state machine [ 10.687750] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 .. [ O[ 10.748376] power_meter ACPI000D:00: Found ACPI power meter. [ 10.748393] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.748468] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.771223] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. K ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel [ 10.798276] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) Module fuse. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Automatic Boot Loader Update. [ 10.837532] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.394609] ipmi_ssif: IPMI SSIF Interface driver [ 11.991152] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 12.001096] igb 0000:07:00.0: DCA enabled [ 12.001111] igb 0000:07:00.1: DCA enabled [ 12.816904] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 12.816983] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 12.817923] i2c i2c-3: 1/8 memory slots populated (from DMI) [ 12.817926] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 12.869915] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 12.869918] RAPL PMU: hw unit of domain package 2^-14 Joules [ 12.869919] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 12.893321] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [* ] (1 of 2) A start job is running for /dev/vg_nvme/lv_5 (3s / no limit) [ 12.973841] iTCO_vendor_support: vendor-support=0 [ 12.979106] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 12.979520] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) M [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Finished Create Volatile Files and Directories. Mounting /var/lib/ceph... Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ 13.291100] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 13.291102] EDAC sbridge: Ver: 1.1.2 [ 13.296879] RPC: Registered named UNIX socket transport module. [ 13.296881] RPC: Registered udp transport module. [ 13.296882] RPC: Registered tcp transport module. [ 13.296882] RPC: Registered tcp-with-tls transport module. [ 13.296883] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 13.373379] intel_rapl_common: Found RAPL domain package [ 13.373387] intel_rapl_common: Found RAPL domain dram [ OK ] Started RPC Bind. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ 13.575110] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 13.583526] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ 13.583625] XFS (dm-4): Mounting V4 Filesystem b1f975be-9df6-4642-a123-e9700b4cc649 [ 13.596706] XFS (dm-4): Ending clean mount [ OK [[ 13.596744] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) 0m] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Mounted /var/lib/ceph. [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Finished Resets System Activity Logs. [ OK ] Started User Login Management. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.214088] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.365142] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 15.592297] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ 15.780320] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 15.780449] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [** ] A start job is running for Network Manager Wait Online (8s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (10s / no limit) M [ **] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.149 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot da…ing new SELinux denial logs... [ 22.294118] block sda: the capability attribute has been deprecated. + '[' 172.21.15.149 '!=' '' ']' + set -e + '[' -n 172.21.15.149 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.149 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.149 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi149.front.sepia.ceph.com + '[' -n smithi149.front.sepia.ceph.com ']' + hostname smithi149.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi149 + echo smithi149 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.149 smithi149.front.sepia.ceph.com smithi149/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-444.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-05-07T11:17:09.505 DEBUG:teuthology.orchestra.console.smithi149:expect after: smithi149 login: 2024-05-07T11:17:09.557 DEBUG:teuthology.orchestra.console.smithi149:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.72 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 7D 57 GUID: 00000000 0000 0000 0000 0CC47ADA6BA4 DHCP./                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.149 MA : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.149 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:7d:57)... Configuring (net0 0c:c4:7a:88:7d:57).... Configuring (net0 0c:c4:7a:88:7d:57)..... Configuring (net0 0c:c4:7a:88:7d:57)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-444.el9.x86_64) 9  CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9              The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-444.el9.x86_64) 9   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9            Use the * and * keys to change the selection.  The selected entry will be started automatically in 4s.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-444.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Fri Apr 26 18:25:52 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-444.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000047fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.698 MHz processor [ 0.000398] last_pfn = 0x480000 max_arch_pfn = 0x400000000 [ 0.000402] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000403] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000736] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006382] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006391] Using GB pages for direct mapping [ 0.006504] RAMDISK: [mem 0x342c0000-0x36157fff] [ 0.006506] ACPI: Early table checksum verification disabled [ 0.006508] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006511] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006516] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006520] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006523] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006525] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006527] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006530] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006532] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006534] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006537] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006539] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006541] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006544] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006546] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006548] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006551] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006553] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006556] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006558] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006560] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006563] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006565] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006567] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006568] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006569] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006569] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006570] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006570] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006571] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006572] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006572] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006573] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006573] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006574] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006575] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006575] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006576] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006576] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006577] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006578] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006578] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006579] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006580] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006626] No NUMA configuration found [ 0.006626] Faking a node at [mem 0x0000000000000000-0x000000047fffffff] [ 0.006635] NODE_DATA(0) allocated [mem 0x47ffd5000-0x47fffffff] [ 0.006819] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 16270MB) [ 0.006842] Zone ranges: [ 0.006842] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006844] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006845] Normal [mem 0x0000000100000000-0x000000047fffffff] [ 0.006846] Device empty [ 0.006847] Movable zone start for each node [ 0.006849] Early memory node ranges [ 0.006850] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006851] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006852] node 0: [mem 0x0000000100000000-0x000000047fffffff] [ 0.006854] Initmem setup node 0 [mem 0x0000000000001000-0x000000047fffffff] [ 0.006859] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006900] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.012545] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.012656] ACPI: PM-Timer IO Port: 0x408 [ 0.012664] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012666] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012666] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012667] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012667] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012668] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012668] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012669] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012678] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012682] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012684] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012685] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012689] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012690] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012694] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012695] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012705] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012706] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.012707] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012708] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.012709] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.012709] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.012710] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.012710] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012711] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012711] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012712] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012713] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012714] Booting paravirtualized kernel on bare hardware [ 0.012716] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.017090] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.017338] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.017363] Fallback order for Node 0: 0 [ 0.017365] Built 1 zonelists, mobility grouping on. Total pages: 4099978 [ 0.017366] Policy zone: Normal [ 0.017367] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-444.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.017424] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-444.el9.x86_64", will be passed to user space. [ 0.017440] random: crng init done [ 0.018547] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.019149] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) [ 0.019404] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.019414] software IO TLB: area num 8. [ 0.047567] Memory: 1751988K/16660796K available (16384K kernel code, 5637K rwdata, 11892K rodata, 3932K init, 5872K bss, 700632K reserved, 0K cma-reserved) [ 0.047674] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.047682] Kernel/User page tables isolation: enabled [ 0.047707] ftrace: allocating 47201 entries in 185 pages [ 0.065935] ftrace: allocated 185 pages with 5 groups [ 0.066452] Dynamic Preempt: voluntary [ 0.066483] rcu: Preemptible hierarchical RCU implementation. [ 0.066483] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.066485] Trampoline variant of Tasks RCU enabled. [ 0.066485] Rude variant of Tasks RCU enabled. [ 0.066485] Tracing variant of Tasks RCU enabled. [ 0.066486] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.066487] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069694] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.069857] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.069965] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.075205] Console: colour VGA+ 80x25 [ 1.112281] printk: console [ttyS1] enabled [ 1.116474] ACPI: Core revision 20230331 [ 1.120566] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.129695] APIC: Switch to symmetric I/O mode setup [ 1.134666] DMAR: Host address width 46 [ 1.138510] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.143824] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.151820] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.158087] DMAR: ATSR flags: 0x0 [ 1.161408] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.167675] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.174027] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.180379] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.185781] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.185781] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.200851] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.206160] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.212373] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.222702] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327233a889f, max_idle_ns: 440795284032 ns [ 1.233215] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.39 BogoMIPS (lpj=3499698) [ 1.234234] CPU0: Thermal monitoring enabled (TM1) [ 1.235268] process: using mwait in idle threads [ 1.236215] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.237214] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.238215] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.239215] Spectre V2 : Mitigation: Retpolines [ 1.240214] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.241214] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.242214] Speculative Store Bypass: Vulnerable [ 1.243220] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.244214] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.245214] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.246217] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.247214] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.248214] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.249214] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.250214] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.262872] Freeing SMP alternatives memory: 36K [ 1.263214] pid_max: default: 32768 minimum: 301 [ 1.264233] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.265219] Yama: becoming mindful. [ 1.266217] SELinux: Initializing. [ 1.267230] LSM support for eBPF active [ 1.268252] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes, linear) [ 1.269233] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes, linear) [ 1.373255] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.375304] cblist_init_generic: Setting adjustable number of callback queues. [ 1.376214] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.377225] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.378223] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.379222] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.380214] ... version: 3 [ 1.381214] ... bit width: 48 [ 1.382214] ... generic registers: 4 [ 1.383214] ... value mask: 0000ffffffffffff [ 1.384214] ... max period: 00007fffffffffff [ 1.385214] ... fixed-purpose events: 3 [ 1.386214] ... event mask: 000000070000000f [ 1.387297] signal: max sigframe size: 1776 [ 1.388225] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.389239] rcu: Hierarchical SRCU implementation. [ 1.389239] rcu: Max phase no-delay instances is 400. [ 1.389247] printk: console [ttyS1] printing thread started [ 1.393815] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.393881] smp: Bringing up secondary CPUs ... [ 1.393949] smpboot: x86: Booting SMP configuration: [ 1.393950] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.400474] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.400474] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.400474] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.400474] smp: Brought up 1 node, 8 CPUs [ 1.400474] smpboot: Max logical packages: 1 [ 1.400474] smpboot: Total of 8 processors activated (55995.16 BogoMIPS) [ 1.442235] node 0 deferred pages initialised in 33ms [ 1.443505] devtmpfs: initialized [ 1.443505] x86/mm: Memory block size: 128MB [ 1.444536] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.444536] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.444536] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.444536] pinctrl core: initialized pinctrl subsystem [ 1.463087] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.463181] DMA: preallocated 2048 KiB GFP_KERNEL pool for atomic allocations [ 1.463190] DMA: preallocated 2048 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.463201] DMA: preallocated 2048 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.463209] audit: initializing netlink subsys (disabled) [ 1.463229] audit: type=2000 audit(1715080600.250:1): state=initialized audit_enabled=0 res=1 [ 1.463283] thermal_sys: Registered thermal governor 'fair_share' [ 1.463284] thermal_sys: Registered thermal governor 'step_wise' [ 1.463284] thermal_sys: Registered thermal governor 'user_space' [ 1.473216] cpuidle: using governor menu [ 1.480244] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.480245] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.480297] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.480300] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.480308] PCI: Using configuration type 1 for base access [ 1.491242] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.491246] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.491246] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.491246] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.491246] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.498254] cryptd: max_cpu_qlen set to 1000 [ 1.505977] ACPI: Added _OSI(Module Device) [ 1.505978] ACPI: Added _OSI(Processor Device) [ 1.505978] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.505979] ACPI: Added _OSI(Processor Aggregator Device) [ 1.505979] ACPI: Added _OSI(Linux-Dell-Video) [ 1.505980] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.505981] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.537584] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.539741] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.541304] ACPI: Dynamic OEM Table Load: [ 1.562585] ACPI: _OSC evaluated successfully for all CPUs [ 1.562843] ACPI: Interpreter enabled [ 1.562853] ACPI: PM: (supports S0 S4 S5) [ 1.562854] ACPI: Using IOAPIC for interrupt routing [ 1.564376] HEST: Enabling Firmware First mode for corrected errors. [ 1.607837] HEST: Table parsing has been initialized. [ 1.607971] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.607974] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.607975] PCI: Using E820 reservations for host bridge windows [ 1.608590] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.632450] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.632454] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.633579] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.634103] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.634103] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.634129] PCI host bridge to bus 0000:ff [ 1.634131] pci_bus 0000:ff: root bus resource [bus ff] [ 1.634141] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.634187] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.634222] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.634252] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.634281] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.634310] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.634340] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.634368] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.634397] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.634426] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.634455] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.634483] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.634511] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.634540] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.634569] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.634598] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.634625] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.634653] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.634681] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.634701] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.634736] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634795] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634854] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634912] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634970] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635028] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635085] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.635131] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.635179] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635229] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635270] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635310] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635350] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.635380] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.635412] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.635442] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.635474] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635515] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635556] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635598] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.635639] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.635674] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.635706] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.635737] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.635770] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.635800] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.635832] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.635861] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.635895] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.635924] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.635953] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.635983] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.636003] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventil PCI endpoint [ 1.636034] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.636064] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.638297] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.638300] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.638432] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.638669] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.638670] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.639082] PCI host bridge to bus 0000:00 [ 1.639083] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.639085] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.639086] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.639087] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.639088] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.639088] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.639089] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.639108] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.639209] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.639222] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.639258] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.639349] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.639360] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.639363] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.639396] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.639484] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.639495] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.639497] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.639499] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.639503] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.639532] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.639614] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639622] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.639696] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639703] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.639776] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639783] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.639857] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639864] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.639935] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639942] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.640014] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640021] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.640093] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640100] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.640175] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640182] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.640257] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640318] pci 0000:00:05.1: 000 PCIe Root Co640398] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640454] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.640459] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.640538] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.640773] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.640792] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.640803] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.640814] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.640825] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.640836] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.640848] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.640904] pci 0000:00:11.4: PME# suppo40982] pci 0000:lass 0x0c0330 co41006] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.641092] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.641179] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.641202] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.641291] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.641358] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.641382] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.641469] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.641554] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.641576] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.641692] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.641771] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.641807] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.641898] pci 0000:00:1c.0: PME# s[ 1.641999] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Po642037] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.642041] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.642045] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.642133] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.642231] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.642271] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.642276] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.642279] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.642367] pci 0000:ME# supported from D0 D3hot D3cold [ 1.642472] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.642492] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.642609] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.642691] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.642894] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.642912] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.642922] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.642933] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.642943] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.642955] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.642965] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.643017] pci 0000:00:1f.2: PME# supported from D3hot [ 1.643080] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.643103] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.643133] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.643295] acpiphp: Slot [1] registered [ 1.643306] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.643411] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.643420] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.643436] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.643440] pci 0000:02:00.0: enabling Extended Tags [ 1.643542] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.643648] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.643658] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.643663] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.643673] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.643677] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.643713] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.643729] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.643730] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.643739] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.643740] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.643890] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.643899] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.643904] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.643914] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.643918] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.643954] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.643967] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.643968] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.643976] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.643977] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.644115] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.644160] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.644255] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.644328] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.644341] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.644346] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.644400] pci 0000:05:00.0: enabling Extended Tags [ 1.644532] pci 0000:05:00.0: supports D1 D2 [ 1.644532] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.644709] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.644796] pci_bus 0000:06: extended config space not accessible [ 1.644829] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.644866] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.644885] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.644905] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.645004] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.645074] pci 0000:06:00.0: supports D1 D2 [ 1.645074] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.645224] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.645366] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.645396] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.645432] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.645450] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.645673] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.645734] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645735] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.645769] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645770] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.646101] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.646136] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.646173] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.646191] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.646407] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.646468] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.646469] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.646502] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.646502] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.646798] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.646810] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.647478] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.647509] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.647537] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.647565] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.647595] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.647595] ACPI: PCI: Interrupt link LNKE disabled [ 1.647625] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.647625] ACPI: PCI: Interrupt link LNKF disabled [ 1.647653] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.647653] ACPI: PCI: Interrupt link LNKG disabled [ 1.647683] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.647684] ACPI: PCI: Interrupt link LNKH disabled [ 1.648224] iommu: Default domain type: Translated [ 1.648224] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.648294] SCSI subsystem initialized [ 1.648309] ACPI: bus type USB registered [ 1.648320] usbcore: registered new interface driver usbfs [ 1.648326] usbcore: registered new interface driver hub [ 1.648331] usbcore: registered new device driver usb [ 1.648350] pps_core: LinuxPPS API ver. 1 registered [ 1.648351] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.648353] PTP clock support registered [ 1.648366] EDAC MC: Ver: 3.0.0 [ 1.648386] NetLabel: Initializing [ 1.648387] NetLabel: domain hash size = 128 [ 1.648387] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.648400] NetLabel: unlabeled traffic allowed by default [ 1.648400] PCI: Using ACPI for IRQ routing [ 1.659238] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.659240] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.659240] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.659242] vgaarb: loaded [ 1.659257] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.659261] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.662378] clocksource: Switched to clocksource tsc-early [ 1.732544] VFS: Disk quotas dquot_6.6.0 [ 1.732555] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.732619] pnp: PnP ACPI init [ 1.733064] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.733067] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.733069] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.733070] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.733072] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.733073] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.733075] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.733077] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.733078] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.733080] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.733081] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.733083] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.733084] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.733291] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.733293] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.733294] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.733295] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.733297] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.734232] pnp: PnP ACPI: found 5 devices [ 1.739868] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.739924] NET: Registered PF_INET protocol family [ 1.740110] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.743518] tcp_listen_portaddr_hash hash table entries: 8192 (order: 5, 131072 bytes, linear) [ 1.743542] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.743549] TCP established hash table entries: 131072 (order: 8, 1048576 bytes, linear) [ 1.743724] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.743884] TCP: Hash tables configured (established 131072 bind 65536) [ 1.743967] MPTCP token hash table entries: 16384 (order: 6, 393216 bytes, linear) [ 1.744018] UDP hash table entries: 8192 (order: 6, 262144 bytes, linear) [ 1.744060] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes, linear) [ 1.744125] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.744130] NET: Registered PF_XDP protocol family [ 1.744151] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.744161] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.744163] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.744168] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.744169] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.744175] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744176] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744178] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744178] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744180] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744181] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744182] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744182] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744184] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744185] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744186] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744187] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744188] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744189] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744190] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.744191] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.744192] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.744193] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.744195] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.744196] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.744199] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.744219] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.744222] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.744230] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.744246] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.744247] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.744253] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.744262] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.744268] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.744274] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.744280] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.744287] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.744288] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.744294] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.744298] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.744303] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.744304] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.744305] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.744306] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.744307] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.744308] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.744308] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.744310] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.744310] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.744311] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.744312] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.744313] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.744314] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.744314] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.744315] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.744316] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.744317] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.744317] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.744463] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.761257] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16237 usecs [ 1.777255] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 15607 usecs [ 1.777269] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.777311] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.777312] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.777318] ACPI: bus type thunderbolt registered [ 1.777325] Trying to unpack rootfs image as initramfs... [ 1.843310] Initialise system trusted keyrings [ 1.843323] Key type blacklist registered [ 1.843374] workingset: timestamp_bits=36 max_order=22 bucket_order=0 [ 1.843392] zbud: loaded [ 1.930779] integrity: Platform Keyring initialized [ 1.930785] integrity: Machine keyring initialized [ 1.938768] NET: Registered PF_ALG protocol family [ 1.938770] xor: automatically using best checksumming function avx [ 1.938771] Key type asymmetric registered [ 1.938772] Asymmetric key parser 'x509' registered [ 1.938773] Running certificate verification selftests [ 1.940297] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.942227] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.942249] io scheduler mq-deadline registered [ 1.942250] io scheduler kyber registered [ 1.942256] io scheduler bfq registered [ 1.972093] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.972439] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.972593] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.972734] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.972864] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.973016] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.973160] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.973322] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.973397] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.997066] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.997089] ACPI: button: Power Button [PWRB] [ 1.997112] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.997211] ACPI: button: Power Button [PWRF] [ 2.013634] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.013636] pstore: Registered erst as persistent store backend [ 2.013739] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.013826] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.022646] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.032303] Non-volatile memory driver v1.3 [ 2.041333] rdac: device handler registered [ 2.041367] hp_sw: device handler registered [ 2.041368] emc: device handler registered [ 2.041395] alua: device handler registered [ 2.041700] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.041729] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 2.041743] ehci-pci 0000:00:1d.0: debug port 2 [ 2.045694] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.052243] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.052306] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.052309] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.052311] usb usb1: Product: EHCI Host Controller [ 2.052313] usb usb1: Manufacturer: Linux 5.14.0-444.el9.x86_64 ehci_hcd [ 2.052314] usb usb1: SerialNumber: 0000:00:1d.0 [ 2.052433] hub 1-0:1.0: USB hub found [ 2.052442] hub 1-0:1.0: 2 ports detected [ 2.052636] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.052672] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.053759] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.053959] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.053973] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.054031] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 2.054031] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 2.054034] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.054050] ehci-pci 0000:00:1a.0: debug port 2 [ 2.054062] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.054064] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.054065] usb usb2: Product: xHCI Host Controller [ 2.054065] usb usb2: Manufacturer: Linux 5.14.0-444.el9.x86_64 xhci-hcd [ 2.054066] usb usb2: SerialNumber: 0000:00:14.0 [ 2.054154] hub 2-0:1.0: USB hub found [ 2.054184] hub 2-0:1.0: 15 ports detected [ 2.055914] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.055916] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.055917] usb usb4: Product: xHCI Host Controller [ 2.055917] usb usb4: Manufacturer: Linux 5.14.0-444.el9.x86_64 xhci-hcd [ 2.055918] usb usb4: SerialNumber: 0000:00:14.0 [ 2.056006] hub 4-0:1.0: USB hub found [ 2.056024] hub 4-0:1.0: 6 ports detected [ 2.056945] usbcore: registered new interface driver usbserial_generic [ 2.056949] usbserial: USB Serial support registered for generic [ 2.056983] i8042: PNP: No PS/2 controller found. [ 2.057031] mousedev: PS/2 mouse device common for all mice [ 2.057088] rtc_cmos 00:00: RTC can wake from S4 [ 2.057405] rtc_cmos 00:00: registered as rtc0 [ 2.057459] rtc_cmos 00:00: setting system clock to 2024-05-07T11:16:42 UTC (1715080602) [ 2.057484] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.057954] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.059988] intel_pstate: Intel P-state driver initializing [ 2.064222] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.064258] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.064260] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.064261] usb usb3: Product: EHCI Host Controller [ 2.064262] usb usb3: Manufacturer: Linux 5.14.0-444.el9.x86_64 ehci_hcd [ 2.064263] usb usb3: SerialNumber: 0000:00:1a.0 [ 2.064350] hub 3-0:1.0: USB hub found [ 2.064355] hub 3-0:1.0: 2 ports detected [ 2.086248] hid: raw HID events driver (C) Jiri Kosina [ 2.086281] usbcore: registered new interface driver usbhid [ 2.086282] usbhid: USB HID core driver [ 2.086311] drop_monitor: Initializing network drop monitor service [ 2.095187] Initializing XFRM netlink socket [ 2.095212] NET: Registered PF_INET6 protocol family [ 2.098403] Freeing initrd memory: 31328K [ 2.103149] Segment Routing with IPv6 [ 2.103171] NET: Registered PF_PACKET protocol family [ 2.103195] mpls_gso: MPLS GSO support [ 2.122962] microcode: Current revision: 0x0b00001b [ 2.147735] resctrl: L3 allocation detected [ 2.147736] resctrl: L3 monitoring detected [ 2.147749] IPI shorthand broadcast: enabled [ 2.147753] AVX2 version of gcm_enc/dec engaged. [ 2.201455] AES CTR mode by8 optimization enabled [ 2.201497] sched_clock: Marking stable (1057886488, 1143327501)->(2545470572, -344256583) [ 2.226313] registered taskstats version 1 [ 2.242978] Loading compiled-in X.509 certificates [ 2.243510] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: 2a5a5cd513b4e8668929c8232d899a1b35d52dcb' [ 2.243775] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.244033] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.244167] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.244175] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.244363] zswap: loaded using pool lzo/zbud [ 2.261054] page_owner is disabled [ 2.261276] pstore: Using crash dump compression: deflate [ 2.261285] Key type big_key registered [ 2.294249] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.302247] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 2.323341] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.383740] Key type encrypted registered [ 2.383746] ima: No TPM chip found, activating TPM-bypass! [ 2.383748] Loading compiled-in module X.509 certificates [ 2.384028] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: 2a5a5cd513b4e8668929c8232d899a1b35d52dcb' [ 2.384030] ima: Allocated hash algorithm: sha256 [ 2.384039] ima: No architecture policies found [ 2.384046] evm: Initialising EVM extended attributes: [ 2.384046] evm: security.selinux [ 2.384047] evm: security.SMACK64 (disabled) [ 2.384047] evm: security.SMACK64EXEC (disabled) [ 2.384048] evm: security.SMACK64TRANSMUTE (disabled) [ 2.384048] evm: security.SMACK64MMAP (disabled) [ 2.384048] evm: security.apparmor (disabled) [ 2.384049] evm: security.ima [ 2.384049] evm: security.capability [ 2.384050] evm: HMAC attrs: 0x1 [ 2.423438] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.423440] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.423844] hub 2-12:1.0: USB hub found [ 2.423920] hub 2-12:1.0: 4 ports detected [ 2.433644] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.433646] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.433796] hub 3-1:1.0: USB hub found [ 2.433895] hub 3-1:1.0: 6 ports detected [ 2.468649] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.468652] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.468800] hub 1-1:1.0: USB hub found [ 2.468895] hub 1-1:1.0: 8 ports detected [ 2.720241] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.780232] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.780235] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.785069] clocksource: Switched to clocksource tsc [ 2.824760] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.824762] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.829724] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.881360] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.884057] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.884107] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.252452] clk: Disabling unused clocks [ 5.253356] Freeing unused decrypted memory: 2028K [ 5.262411] Freeing unused kernel image (initmem) memory: 3932K [ 5.271251] Write protecting the kernel read-only data: 28672k [ 5.271446] Freeing unused kernel image (rodata/data gap) memory: 396K [ 5.320414] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.320416] x86/mm: Checking user space page tables [ 5.358417] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.358428] Run /init as init process [ 5.372225] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.372341] systemd[1]: Detected architecture x86-64. [ 5.372342] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.423422] systemd[1]: Hostname set to . [ OK [[ 5.481535] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.481648] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.503376] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.517285] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.529353] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.540308] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.552492] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.567378] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.581533] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.593453] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.607478] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.621285] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.639865] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.655297] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.668156] systemd[1]: Starting Load Kernel Modules... g Load Kernel Modules... Startin[ 5.680892] systemd[1]: Starting Create System Users... g Create System Users... [ 5.689355] fuse: init (API version 7.36) Startin[ 5.695519] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.707983] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 6.087404] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started [0;[ 6.127616] igb: Intel(R) Gigabit Ethernet Network Driver 1;39mShow Plymou[ 6.127618] igb: Copyright (c) 2007-2014 Intel Corporation. th Boot Screen. [ OK ] Started Forward Password R…s to Plymouth Directory Watch. [ OK ] Reached target Path Units. [ OK [ 6.156508] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver ] Reached target Basic System.[ 6.156511] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.176210] nvme nvme0: pci function 0000:02:00.0 [ 6.176325] ACPI: bus type drm_connector registered [ 6.188163] nvme nvme0: 8/0/0 default/read/poll queues [ 6.194415] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.194418] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.207787] igb 0000:07:00.0: added PHC on eth0 [ 6.207813] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.207814] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:da:6b:a4 [ 6.207888] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.207889] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.211469] scsi host0: ahci [ 6.211605] scsi host1: ahci [ 6.211713] scsi host2: ahci [ 6.211820] scsi host3: ahci [ 6.211870] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 lpm-pol 0 [ 6.211873] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 lpm-pol 0 [ 6.211875] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 lpm-pol 0 [ 6.211878] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 lpm-pol 0 [ 6.212168] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.212171] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.229613] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.229619] scsi host4: ahci [ 6.229726] scsi host5: ahci [ 6.229811] scsi host6: ahci [ 6.229929] scsi host7: ahci [ 6.230056] scsi host8: ahci [ 6.230148] scsi host9: ahci [ 6.230193] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 lpm-pol 0 [ 6.230196] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 lpm-pol 0 [ 6.230198] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 lpm-pol 0 [ 6.230201] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 lpm-pol 0 [ 6.230202] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 lpm-pol 0 [ 6.230204] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 lpm-pol 0 [ 6.256375] Console: switching to colour dummy device 80x25 [ 6.256517] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.256518] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.256528] ast 0000:06:00.0: [drm] Using analog VGA [ 6.256534] ast 0000:06:00.0: [drm] dr=16 [ 6.256708] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.265653] igb 0000:07:00.1: added PHC on eth1 [ 6.265681] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.265682] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:da:6b:a5 [ 6.265756] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.265757] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.270637] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.277049] fbcon: astdrmfb (fb0) is primary device [ 6.288558] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.302006] Console: switching to colour frame buffer device 128x48 [ 6.320715] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.521970] ata4: SATA link down (SStatus 0 SControl 300) [ 6.522002] ata2: SATA link down (SStatus 0 SControl 300) [ 6.522029] ata3: SATA link down (SStatus 0 SControl 300) [ 6.522057] ata1: SATA link down (SStatus 0 SControl 300) [ 6.537312] ata10: SATA link down (SStatus 0 SControl 300) [ 6.537427] ata8: SATA link down (SStatus 0 SControl 300) [ 6.537452] ata9: SATA link down (SStatus 0 SControl 300) [ 6.537756] ata7: SATA link down (SStatus 0 SControl 300) [ 6.537793] ata6: SATA link down (SStatus 0[ 6.541207] a Gbps (SStatus 1[ 6.611914] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.612469] ata5.00: NCQ Send/Recv Log not supported [ 6.612470] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.613972] ata5.00: NCQ Send/Recv Log not supported [ 6.613975] ata5.00: configured for UDMA/133 [ 6.614078] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.666498] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.673163] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.673177] sd 4:0:0:0: [sda] Write Protect is off [ 6.673194] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.673218] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.689521] sda: sda1 [ 6.689571] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.297531] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.297819] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.297901] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.297902] ixgbe 0000:03:00.0: 0c:c4:7a:88:7d:56 [ 7.300266] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.457457] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.457745] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.457826] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.457828] ixgbe 0000:03:00.1: 0c:c4:7a:88:7d:57 [ 7.460821] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.469416] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.502262] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.740143] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. [ 8.079739] systemd-journald[279]: Received SIGTERM from PID 1 (systemd). Starting Switch Root... [ 8.642855] SELinux: policy capability network_peer_controls=1 [ 8.642858] SELinux: policy capability open_perms=1 [ 8.642858] SELinux: policy capability extended_socket_class=1 [ 8.642859] SELinux: policy capability always_check_network=0 [ 8.642859] SELinux: policy capability cgroup_seclabel=1 [ 8.642860] SELinux: policy capability nnp_nosuid_transition=1 [ 8.642860] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.687170] audit: type=1403 audit(1715080609.128:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.689348] systemd[1]: Successfully loaded SELinux policy in 121.534ms. [ 8.748408] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 25.422ms. [ 8.760403] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.760514] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.656983] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.657081] systemd[1]: Stopped Switch Root. [ OK [[ 9.668899] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.669203] systemd[1]: Created slice Slice /system/getty. [ 9.669516] systemd[1]: Created slice Slice /system/modprobe. 0m] Stopped [0;[ 9.690505] systemd[1]: Created slice Slice /system/serial-getty. [ 9.690768] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.691016] systemd[1]: Created slice User and Session Slice. [ 9.691047] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.691145] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.691537] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. 1;39mSwitch Root[ 9.710325] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.731973] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. . [[ 9.741375] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. OK ] Crea[ 9.775125] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.775154] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.775190] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.775222] systemd[1]: Reached target Local Encrypted Volumes. [ 9.797575] systemd[1]: Stopped target Switch Root. ted slice [0;1;[ 9.819311] systemd[1]: Stopped target Initrd File Systems. [ 9.819331] systemd[1]: Stopped target Initrd Root File System. [ 9.819356] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.819401] systemd[1]: Reached target Path Units. [ 9.819435] systemd[1]: Reached target Slice Units. 39mSlice /system[ 9.819466] systemd[1]: Reached target Swaps. [ 9.819493] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.819861] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.831548] systemd[1]: Listening on LVM2 poll daemon socket. [ 9.863887] systemd[1]: Listening on RPCbind Server Activation Socket. /getty. [[ 9.879778] systemd[1]: Reached target RPC Port Mapper. [ 9.881394] systemd[1]: Listening on Process Core Dump Socket. [0;32m OK [ 9.892245] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.892669] systemd[1]: Listening on udev Control Socket. [ 9.892905] systemd[1]: Listening on udev Kernel Socket. ] Created slice Slice /[ 9.911291] systemd[1]: Mounting Huge Pages File System... system/modprobe[ 9.912189] systemd[1]: Mounting POSIX Message Queue File System... [0m. [ [ 9.913401] systemd[1]: Mounting Kernel Debug File System... [ 9.920036] systemd[1]: Mounting Kernel Trace File System... OK ] Creat[ 9.926784] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). ed slice [0;1;3[ 9.954127] systemd[1]: Starting Create List of Static Device Nodes... 9mSlice /system/[ 9.954938] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... serial-getty. [ OK[ 9.974373] systemd[1]: Starting Load Kernel Module configfs... [ 9.975164] systemd[1]: Starting Load Kernel Module drm... [ 9.975995] systemd[1]: Starting Load Kernel Module fuse... ] Created slice S[ 9.994916] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.994995] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 9.995042] systemd[1]: Stopped Plymouth switch root service. [ 9.995238] systemd[1]: Stopped Journal Service. lice /system/sshd-keygen. [ 10.023458] systemd[1]: Starting Journal Service... [ 10.025830] systemd[1]: Starting Load Kernel Modules... [ OK ] Created slic[ 10.035746] systemd[1]: Starting Generate network units from Kernel command line... [ 10.035790] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). e User [ 10.036610] systemd[1]: Starting Remount Root and Kernel File Systems... [ 10.069603] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. [ 10.072027] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. and Session Slic[ 10.072963] systemd[1]: Starting Coldplug All udev Devices... [ 10.091395] systemd[1]: Mounted Huge Pages File System. e. [[0;32[ 10.102870] systemd[1]: Mounted POSIX Message Queue File System. [ 10.103028] systemd[1]: Mounted Kernel Debug File System. m OK ] Sta[ 10.103177] systemd[1]: Mounted Kernel Trace File System. rted Fo[ 10.103522] systemd[1]: Finished Create List of Static Device Nodes. rward Password R[ 10.115704] systemd[1]: modprobe@configfs.service: Deactivated successfully. [ 10.115801] systemd[1]: Finished Load Kernel Module configfs. [ 10.130134] systemd[1]: Started Journal Service. …uests to Wall Directory Watch. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ OK ] Reached target ceph target…on@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ 10.225439] systemd-journald[580]: Received client request to flush runtime journal. [ OK [ 10.235666] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.235687] device-mapper: uevent: version 1.0.3 [ 10.235792] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module configfs. [ OK ] Started Journal Service. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Apply Kernel Variables... Starting Create Static Device Nodes in /dev... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs[ 10.674805] IPMI message handler: version 39.2 [0m... [ 10.681255] ipmi device interface Starting Load Kernel [ 10.686987] ipmi_si: IPMI System Interface driver Module fuse.[ 10.687003] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.687005] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.687007] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.687064] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.687279] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.687690] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.687692] ipmi_si: Adding ACPI-specified kcs state machine [ 10.687750] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 .. [ O[ 10.748376] power_meter ACPI000D:00: Found ACPI power meter. [ 10.748393] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.748468] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.771223] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. K ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel [ 10.798276] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) Module fuse. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Automatic Boot Loader Update. [ 10.837532] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.394609] ipmi_ssif: IPMI SSIF Interface driver [ 11.991152] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 12.001096] igb 0000:07:00.0: DCA enabled [ 12.001111] igb 0000:07:00.1: DCA enabled [ 12.816904] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 12.816983] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 12.817923] i2c i2c-3: 1/8 memory slots populated (from DMI) [ 12.817926] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 12.869915] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 12.869918] RAPL PMU: hw unit of domain package 2^-14 Joules [ 12.869919] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 12.893321] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [* ] (1 of 2) A start job is running for /dev/vg_nvme/lv_5 (3s / no limit) [ 12.973841] iTCO_vendor_support: vendor-support=0 [ 12.979106] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 12.979520] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) M [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Finished Create Volatile Files and Directories. Mounting /var/lib/ceph... Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ 13.291100] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 13.291102] EDAC sbridge: Ver: 1.1.2 [ 13.296879] RPC: Registered named UNIX socket transport module. [ 13.296881] RPC: Registered udp transport module. [ 13.296882] RPC: Registered tcp transport module. [ 13.296882] RPC: Registered tcp-with-tls transport module. [ 13.296883] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 13.373379] intel_rapl_common: Found RAPL domain package [ 13.373387] intel_rapl_common: Found RAPL domain dram [ OK ] Started RPC Bind. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ 13.575110] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 13.583526] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ 13.583625] XFS (dm-4): Mounting V4 Filesystem b1f975be-9df6-4642-a123-e9700b4cc649 [ 13.596706] XFS (dm-4): Ending clean mount [ OK [[ 13.596744] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) 0m] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Mounted /var/lib/ceph. [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Finished Resets System Activity Logs. [ OK ] Started User Login Management. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.214088] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.365142] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 15.592297] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ 15.780320] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 15.780449] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [** ] A start job is running for Network Manager Wait Online (8s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (10s / no limit) M [ **] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.149 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot da…ing new SELinux denial logs... [ 22.294118] block sda: the capability attribute has been deprecated. + '[' 172.21.15.149 '!=' '' ']' + set -e + '[' -n 172.21.15.149 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.149 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.149 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi149.front.sepia.ceph.com + '[' -n smithi149.front.sepia.ceph.com ']' + hostname smithi149.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi149 + echo smithi149 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.149 smithi149.front.sepia.ceph.com smithi149/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-444.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi149 login: [disconnect] 2024-05-07T11:17:09.660 INFO:teuthology.misc:Re-opening connections... 2024-05-07T11:17:09.660 INFO:teuthology.misc:trying to connect to ubuntu@smithi149.front.sepia.ceph.com 2024-05-07T11:17:09.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-07T11:17:09.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T11:17:10.154 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-05-07T11:17:10.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-07T11:17:10.704 DEBUG:teuthology.misc:waited 1.0434768199920654 2024-05-07T11:17:11.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~163s 2024-05-07T11:17:11.704 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-07T11:17:11.705 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi149.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-05-07T11:17:11.705 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-05-07T11:17:12.048 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2024-05-07T11:17:12.210 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-07T11:17:12.213 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-07T11:17:12.216 INFO:tasks.ceph.osd.1:Started 2024-05-07T11:17:12.216 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:17:12.316 INFO:teuthology.orchestra.run.smithi149.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-05-07T11:17:12.318 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-07T11:17:12.318 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-05-07T11:17:13.173 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:17:13.172+0000 7f5fcbe41640 -1 Falling back to public interface 2024-05-07T11:17:16.978 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:17:16.978+0000 7f5fcbe41640 -1 osd.1 52 log_to_monitors true 2024-05-07T11:17:17.284 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-05-07T11:17:17.283+0000 7f5fbfbf7640 -1 osd.1 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T11:17:17.320 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T11:17:17.429 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-07T11:17:17.429 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-05-07T11:17:17.429 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-05-07T11:17:17.429 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-07T11:17:17.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-05-07T11:17:17.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-07T11:17:17.568 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a: {} 2024-05-07T11:17:17.568 INFO:teuthology.orchestra.run.smithi062.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T11:17:17.577 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b: {} 2024-05-07T11:17:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T11:17:17.586 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c: {} 2024-05-07T11:17:17.586 INFO:teuthology.orchestra.run.smithi062.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T11:17:17.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-07T11:17:18.240 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.0 to 1 (10000) 2024-05-07T11:17:18.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-05-07T11:17:19.397 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-05-07T11:17:19.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-07T11:17:20.396 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.2 to 1 (10000) 2024-05-07T11:17:20.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-05-07T11:17:21.410 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-05-07T11:17:21.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-07T11:17:22.411 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.1 to 1 (10000) 2024-05-07T11:17:22.428 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-05-07T11:17:23.392 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-05-07T11:17:23.409 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-05-07T11:17:23.409 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-05-07T11:17:23.409 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-05-07T11:17:23.409 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-05-07T11:17:23.409 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-07T11:17:23.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:17:23.718 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:23.719 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":76,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:17:23.390069+0000","last_up_change":"2024-05-07T11:17:18.238867+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.7300000190734863,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.7300000190734863,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":52,"up_from":70,"up_thru":75,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6801","nonce":1252745844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6803","nonce":1252745844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6807","nonce":1252745844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6805","nonce":1252745844}]},"public_addr":"172.21.15.149:6801/1252745844","cluster_addr":"172.21.15.149:6803/1252745844","heartbeat_back_addr":"172.21.15.149:6807/1252745844","heartbeat_front_addr":"172.21.15.149:6805/1252745844","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.7","osds":[2,1]},{"pgid":"4.0","osds":[2,0]},{"pgid":"4.8","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.2","osds":[2]},{"pgid":"4.4","osds":[2]},{"pgid":"4.7","osds":[2]},{"pgid":"4.8","osds":[2]},{"pgid":"4.a","osds":[2]},{"pgid":"4.c","osds":[2]},{"pgid":"4.d","osds":[2]},{"pgid":"4.10","osds":[2]},{"pgid":"4.12","osds":[2]},{"pgid":"4.18","osds":[2]},{"pgid":"4.1a","osds":[2]},{"pgid":"4.1e","osds":[2]},{"pgid":"4.1f","osds":[2]},{"pgid":"4.20","osds":[2]},{"pgid":"4.22","osds":[2]},{"pgid":"4.24","osds":[2]},{"pgid":"4.2a","osds":[2]},{"pgid":"4.2c","osds":[2]},{"pgid":"4.30","osds":[2]},{"pgid":"4.32","osds":[2]},{"pgid":"4.34","osds":[2]},{"pgid":"4.37","osds":[2]},{"pgid":"4.3a","osds":[2]},{"pgid":"4.3d","osds":[2]},{"pgid":"4.3f","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:17:23.732 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-07T11:17:23.732 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:17:24.032 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:24.032 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":76,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:17:23.390069+0000","last_up_change":"2024-05-07T11:17:18.238867+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.7300000190734863,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.7300000190734863,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":52,"up_from":70,"up_thru":75,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6801","nonce":1252745844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6803","nonce":1252745844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6807","nonce":1252745844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6805","nonce":1252745844}]},"public_addr":"172.21.15.149:6801/1252745844","cluster_addr":"172.21.15.149:6803/1252745844","heartbeat_back_addr":"172.21.15.149:6807/1252745844","heartbeat_front_addr":"172.21.15.149:6805/1252745844","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.7","osds":[2,1]},{"pgid":"4.0","osds":[2,0]},{"pgid":"4.8","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.2","osds":[2]},{"pgid":"4.4","osds":[2]},{"pgid":"4.7","osds":[2]},{"pgid":"4.8","osds":[2]},{"pgid":"4.a","osds":[2]},{"pgid":"4.c","osds":[2]},{"pgid":"4.d","osds":[2]},{"pgid":"4.10","osds":[2]},{"pgid":"4.12","osds":[2]},{"pgid":"4.18","osds":[2]},{"pgid":"4.1a","osds":[2]},{"pgid":"4.1e","osds":[2]},{"pgid":"4.1f","osds":[2]},{"pgid":"4.20","osds":[2]},{"pgid":"4.22","osds":[2]},{"pgid":"4.24","osds":[2]},{"pgid":"4.2a","osds":[2]},{"pgid":"4.2c","osds":[2]},{"pgid":"4.30","osds":[2]},{"pgid":"4.32","osds":[2]},{"pgid":"4.34","osds":[2]},{"pgid":"4.37","osds":[2]},{"pgid":"4.3a","osds":[2]},{"pgid":"4.3d","osds":[2]},{"pgid":"4.3f","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:17:24.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-07T11:17:24.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-07T11:17:24.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-07T11:17:24.195 INFO:teuthology.orchestra.run.smithi062.stdout:300647710723 2024-05-07T11:17:24.195 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T11:17:24.196 INFO:teuthology.orchestra.run.smithi062.stdout:34359738429 2024-05-07T11:17:24.196 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T11:17:24.197 INFO:teuthology.orchestra.run.smithi062.stdout:34359738429 2024-05-07T11:17:24.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T11:17:24.547 INFO:teuthology.orchestra.run.smithi062.stdout:34359738428 2024-05-07T11:17:24.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.0 2024-05-07T11:17:24.566 INFO:teuthology.orchestra.run.smithi062.stdout:34359738428 2024-05-07T11:17:24.568 INFO:teuthology.orchestra.run.smithi062.stdout:300647710722 2024-05-07T11:17:24.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.2 2024-05-07T11:17:24.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 300647710723 got 300647710722 for osd.1 2024-05-07T11:17:25.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T11:17:25.582 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T11:17:25.583 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T11:17:25.906 INFO:teuthology.orchestra.run.smithi062.stdout:34359738429 2024-05-07T11:17:25.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738429 for osd.0 2024-05-07T11:17:25.920 DEBUG:teuthology.parallel:result is None 2024-05-07T11:17:25.921 INFO:teuthology.orchestra.run.smithi062.stdout:300647710723 2024-05-07T11:17:25.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 300647710723 got 300647710723 for osd.1 2024-05-07T11:17:25.934 DEBUG:teuthology.parallel:result is None 2024-05-07T11:17:25.939 INFO:teuthology.orchestra.run.smithi062.stdout:34359738429 2024-05-07T11:17:25.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738429 for osd.2 2024-05-07T11:17:25.953 DEBUG:teuthology.parallel:result is None 2024-05-07T11:17:25.953 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-07T11:17:25.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:26.299 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:26.301 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:26.309 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-05-07T11:17:25.397295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2328,"num_objects_misplaced":434,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3137,"num_bytes_recovered":47528968,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11001,"ondisk_log_size":11001,"up":210,"acting":185,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":235,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":206052,"kb_used_data":77248,"kb_used_omap":13,"kb_used_meta":128754,"kb_avail":282909468,"statfs":{"total":289910292480,"available":289699295232,"internally_reserved":0,"allocated":79101952,"data_stored":136603719,"data_compressed":16663207,"data_compressed_allocated":19755008,"data_compressed_original":96051200,"omap_allocated":13594,"internal_metadata":131844838},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-822,"num_objects_misplaced":434,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3131,"num_bytes_recovered":47528386,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.988416"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":308,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.397072+0000","last_change":"2024-05-07T11:17:19.438566+0000","last_active":"2024-05-07T11:17:23.397072+0000","last_peered":"2024-05-07T11:17:23.397072+0000","last_clean":"2024-05-07T11:14:24.364900+0000","last_became_active":"2024-05-07T11:17:19.437076+0000","last_became_peered":"2024-05-07T11:17:19.437076+0000","last_unstale":"2024-05-07T11:17:23.397072+0000","last_undegraded":"2024-05-07T11:17:19.425486+0000","last_fullsized":"2024-05-07T11:17:19.407594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":104,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":49}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"63'155","reported_seq":295,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394610+0000","last_change":"2024-05-07T11:17:21.419253+0000","last_active":"2024-05-07T11:17:23.394610+0000","last_peered":"2024-05-07T11:17:23.394610+0000","last_clean":"2024-05-07T11:17:23.394610+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:23.394610+0000","last_undegraded":"2024-05-07T11:17:23.394610+0000","last_fullsized":"2024-05-07T11:17:23.394610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:45:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'169","reported_seq":308,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394330+0000","last_change":"2024-05-07T11:17:19.436446+0000","last_active":"2024-05-07T11:17:23.394330+0000","last_peered":"2024-05-07T11:17:23.394330+0000","last_clean":"2024-05-07T11:14:24.486064+0000","last_became_active":"2024-05-07T11:17:19.434058+0000","last_became_peered":"2024-05-07T11:17:19.434058+0000","last_unstale":"2024-05-07T11:17:23.394330+0000","last_undegraded":"2024-05-07T11:17:19.408807+0000","last_fullsized":"2024-05-07T11:17:19.403831+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":260,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396641+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:23.396641+0000","last_peered":"2024-05-07T11:17:23.396641+0000","last_clean":"2024-05-07T11:17:23.396641+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:23.396641+0000","last_undegraded":"2024-05-07T11:17:23.396641+0000","last_fullsized":"2024-05-07T11:17:23.396641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"63'186","reported_seq":326,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394395+0000","last_change":"2024-05-07T11:17:21.419034+0000","last_active":"2024-05-07T11:17:23.394395+0000","last_peered":"2024-05-07T11:17:23.394395+0000","last_clean":"2024-05-07T11:17:23.394395+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:23.394395+0000","last_undegraded":"2024-05-07T11:17:23.394395+0000","last_fullsized":"2024-05-07T11:17:23.394395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:42.536445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":251,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394324+0000","last_change":"2024-05-07T11:17:22.419149+0000","last_active":"2024-05-07T11:17:23.394324+0000","last_peered":"2024-05-07T11:17:23.394324+0000","last_clean":"2024-05-07T11:14:24.385916+0000","last_became_active":"2024-05-07T11:17:22.416956+0000","last_became_peered":"2024-05-07T11:17:22.416956+0000","last_unstale":"2024-05-07T11:17:23.394324+0000","last_undegraded":"2024-05-07T11:17:22.411982+0000","last_fullsized":"2024-05-07T11:17:22.411747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":108,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":42}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"63'166","reported_seq":255,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393747+0000","last_change":"2024-05-07T11:17:22.418934+0000","last_active":"2024-05-07T11:17:23.393747+0000","last_peered":"2024-05-07T11:17:23.393747+0000","last_clean":"2024-05-07T11:17:23.393747+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:23.393747+0000","last_undegraded":"2024-05-07T11:17:23.393747+0000","last_fullsized":"2024-05-07T11:17:23.393747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:05.143462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":449,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.399107+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:23.399107+0000","last_peered":"2024-05-07T11:17:23.399107+0000","last_clean":"2024-05-07T11:17:23.399107+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:23.399107+0000","last_undegraded":"2024-05-07T11:17:23.399107+0000","last_fullsized":"2024-05-07T11:17:23.399107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:04.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":246,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.397630+0000","last_change":"2024-05-07T11:17:19.437547+0000","last_active":"2024-05-07T11:17:23.397630+0000","last_peered":"2024-05-07T11:17:23.397630+0000","last_clean":"2024-05-07T11:14:24.451837+0000","last_became_active":"2024-05-07T11:17:19.435835+0000","last_became_peered":"2024-05-07T11:17:19.435835+0000","last_unstale":"2024-05-07T11:17:23.397630+0000","last_undegraded":"2024-05-07T11:17:19.424674+0000","last_fullsized":"2024-05-07T11:17:19.410369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":106,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'156","reported_seq":299,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394572+0000","last_change":"2024-05-07T11:17:22.416801+0000","last_active":"2024-05-07T11:17:23.394572+0000","last_peered":"2024-05-07T11:17:23.394572+0000","last_clean":"2024-05-07T11:17:23.394572+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:23.394572+0000","last_undegraded":"2024-05-07T11:17:23.394572+0000","last_fullsized":"2024-05-07T11:17:23.394572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:07.028486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'154","reported_seq":436,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394586+0000","last_change":"2024-05-07T11:17:22.419089+0000","last_active":"2024-05-07T11:17:23.394586+0000","last_peered":"2024-05-07T11:17:23.394586+0000","last_clean":"2024-05-07T11:17:23.394586+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:23.394586+0000","last_undegraded":"2024-05-07T11:17:23.394586+0000","last_fullsized":"2024-05-07T11:17:23.394586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:57.833385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":279,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394814+0000","last_change":"2024-05-07T11:17:19.438657+0000","last_active":"2024-05-07T11:17:23.394814+0000","last_peered":"2024-05-07T11:17:23.394814+0000","last_clean":"2024-05-07T11:14:24.417671+0000","last_became_active":"2024-05-07T11:17:19.435011+0000","last_became_peered":"2024-05-07T11:17:19.435011+0000","last_unstale":"2024-05-07T11:17:23.394814+0000","last_undegraded":"2024-05-07T11:17:19.413983+0000","last_fullsized":"2024-05-07T11:17:19.412423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":86,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"63'136","reported_seq":277,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.398879+0000","last_change":"2024-05-07T11:17:23.398879+0000","last_active":"2024-05-07T11:17:23.398879+0000","last_peered":"2024-05-07T11:17:23.398879+0000","last_clean":"2024-05-07T11:17:23.398879+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:23.398879+0000","last_undegraded":"2024-05-07T11:17:23.398879+0000","last_fullsized":"2024-05-07T11:17:23.398879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:33:07.091905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'175","reported_seq":313,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394552+0000","last_change":"2024-05-07T11:17:19.436711+0000","last_active":"2024-05-07T11:17:23.394552+0000","last_peered":"2024-05-07T11:17:23.394552+0000","last_clean":"2024-05-07T11:14:24.470554+0000","last_became_active":"2024-05-07T11:17:19.431229+0000","last_became_peered":"2024-05-07T11:17:19.431229+0000","last_unstale":"2024-05-07T11:17:23.394552+0000","last_undegraded":"2024-05-07T11:17:19.399847+0000","last_fullsized":"2024-05-07T11:17:19.397290+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":516,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.399194+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:23.399194+0000","last_peered":"2024-05-07T11:17:23.399194+0000","last_clean":"2024-05-07T11:17:23.399194+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:23.399194+0000","last_undegraded":"2024-05-07T11:17:23.399194+0000","last_fullsized":"2024-05-07T11:17:23.399194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:30:48.688430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":253,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394035+0000","last_change":"2024-05-07T11:17:22.420019+0000","last_active":"2024-05-07T11:17:23.394035+0000","last_peered":"2024-05-07T11:17:23.394035+0000","last_clean":"2024-05-07T11:14:24.378895+0000","last_became_active":"2024-05-07T11:17:22.418850+0000","last_became_peered":"2024-05-07T11:17:22.418850+0000","last_unstale":"2024-05-07T11:17:23.394035+0000","last_undegraded":"2024-05-07T11:17:22.412415+0000","last_fullsized":"2024-05-07T11:17:22.412148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":113,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'161","reported_seq":501,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397856+0000","last_change":"2024-05-07T11:17:22.416613+0000","last_active":"2024-05-07T11:17:23.397856+0000","last_peered":"2024-05-07T11:17:23.397856+0000","last_clean":"2024-05-07T11:17:23.397856+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:23.397856+0000","last_undegraded":"2024-05-07T11:17:23.397856+0000","last_fullsized":"2024-05-07T11:17:23.397856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"63'148","reported_seq":288,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394464+0000","last_change":"2024-05-07T11:17:21.418472+0000","last_active":"2024-05-07T11:17:23.394464+0000","last_peered":"2024-05-07T11:17:23.394464+0000","last_clean":"2024-05-07T11:17:23.394464+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:23.394464+0000","last_undegraded":"2024-05-07T11:17:23.394464+0000","last_fullsized":"2024-05-07T11:17:23.394464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:18.184681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'147","reported_seq":223,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397397+0000","last_change":"2024-05-07T11:17:21.418164+0000","last_active":"2024-05-07T11:17:23.397397+0000","last_peered":"2024-05-07T11:17:23.397397+0000","last_clean":"2024-05-07T11:17:23.397397+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:23.397397+0000","last_undegraded":"2024-05-07T11:17:23.397397+0000","last_fullsized":"2024-05-07T11:17:23.397397+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":328,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.396746+0000","last_change":"2024-05-07T11:17:19.439196+0000","last_active":"2024-05-07T11:17:23.396746+0000","last_peered":"2024-05-07T11:17:23.396746+0000","last_clean":"2024-05-07T11:14:24.396282+0000","last_became_active":"2024-05-07T11:17:19.437184+0000","last_became_peered":"2024-05-07T11:17:19.437184+0000","last_unstale":"2024-05-07T11:17:23.396746+0000","last_undegraded":"2024-05-07T11:17:19.422229+0000","last_fullsized":"2024-05-07T11:17:19.419110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":112,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":291,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393973+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:23.393973+0000","last_peered":"2024-05-07T11:17:23.393973+0000","last_clean":"2024-05-07T11:17:23.393973+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:23.393973+0000","last_undegraded":"2024-05-07T11:17:23.393973+0000","last_fullsized":"2024-05-07T11:17:23.393973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":304,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393647+0000","last_change":"2024-05-07T11:17:19.439396+0000","last_active":"2024-05-07T11:17:23.393647+0000","last_peered":"2024-05-07T11:17:23.393647+0000","last_clean":"2024-05-07T11:14:24.332238+0000","last_became_active":"2024-05-07T11:17:19.434809+0000","last_became_peered":"2024-05-07T11:17:19.434809+0000","last_unstale":"2024-05-07T11:17:23.393647+0000","last_undegraded":"2024-05-07T11:17:19.410512+0000","last_fullsized":"2024-05-07T11:17:19.407581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":101,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":7}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"63'159","reported_seq":233,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396783+0000","last_change":"2024-05-07T11:17:21.418519+0000","last_active":"2024-05-07T11:17:23.396783+0000","last_peered":"2024-05-07T11:17:23.396783+0000","last_clean":"2024-05-07T11:17:23.396783+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:23.396783+0000","last_undegraded":"2024-05-07T11:17:23.396783+0000","last_fullsized":"2024-05-07T11:17:23.396783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"63'169","reported_seq":309,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393668+0000","last_change":"2024-05-07T11:17:21.414896+0000","last_active":"2024-05-07T11:17:23.393668+0000","last_peered":"2024-05-07T11:17:23.393668+0000","last_clean":"2024-05-07T11:17:23.393668+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:23.393668+0000","last_undegraded":"2024-05-07T11:17:23.393668+0000","last_fullsized":"2024-05-07T11:17:23.393668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:52.242314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":282,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.394634+0000","last_change":"2024-05-07T11:17:23.394634+0000","last_active":"2024-05-07T11:17:18.396063+0000","last_peered":"2024-05-07T11:17:17.243932+0000","last_clean":"2024-05-07T11:14:24.475528+0000","last_became_active":"2024-05-07T11:14:25.512804+0000","last_became_peered":"2024-05-07T11:14:25.512804+0000","last_unstale":"2024-05-07T11:17:23.394634+0000","last_undegraded":"2024-05-07T11:17:23.394634+0000","last_fullsized":"2024-05-07T11:17:23.394634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'195","reported_seq":331,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397769+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:17:23.397769+0000","last_peered":"2024-05-07T11:17:23.397769+0000","last_clean":"2024-05-07T11:17:23.397769+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:23.397769+0000","last_undegraded":"2024-05-07T11:17:23.397769+0000","last_fullsized":"2024-05-07T11:17:23.397769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":273,"reported_epoch":76,"state":"active+recovery_wait+degraded","last_fresh":"2024-05-07T11:17:23.403662+0000","last_change":"2024-05-07T11:17:23.403843+0000","last_active":"2024-05-07T11:17:23.403662+0000","last_peered":"2024-05-07T11:17:23.403662+0000","last_clean":"2024-05-07T11:14:24.294325+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:23.403662+0000","last_undegraded":"2024-05-07T11:17:23.394924+0000","last_fullsized":"2024-05-07T11:17:23.403662+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":91,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":286,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.396379+0000","last_change":"2024-05-07T11:17:19.438982+0000","last_active":"2024-05-07T11:17:23.396379+0000","last_peered":"2024-05-07T11:17:23.396379+0000","last_clean":"2024-05-07T11:14:24.430825+0000","last_became_active":"2024-05-07T11:17:19.436245+0000","last_became_peered":"2024-05-07T11:17:19.436245+0000","last_unstale":"2024-05-07T11:17:23.396379+0000","last_undegraded":"2024-05-07T11:17:19.417373+0000","last_fullsized":"2024-05-07T11:17:19.414331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":91,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":227,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.116134+0000","last_change":"2024-05-07T11:17:24.181998+0000","last_active":"2024-05-07T11:17:24.181998+0000","last_peered":"2024-05-07T11:17:23.116134+0000","last_clean":"2024-05-07T11:14:24.443460+0000","last_became_active":"2024-05-07T11:17:19.431780+0000","last_became_peered":"2024-05-07T11:17:19.431780+0000","last_unstale":"2024-05-07T11:17:23.116134+0000","last_undegraded":"2024-05-07T11:17:23.116134+0000","last_fullsized":"2024-05-07T11:17:19.408755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":324,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394264+0000","last_change":"2024-05-07T11:17:19.439496+0000","last_active":"2024-05-07T11:17:23.394264+0000","last_peered":"2024-05-07T11:17:23.394264+0000","last_clean":"2024-05-07T11:14:24.440580+0000","last_became_active":"2024-05-07T11:17:19.435641+0000","last_became_peered":"2024-05-07T11:17:19.435641+0000","last_unstale":"2024-05-07T11:17:23.394264+0000","last_undegraded":"2024-05-07T11:17:19.416557+0000","last_fullsized":"2024-05-07T11:17:19.412853+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":114,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"63'192","reported_seq":572,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396991+0000","last_change":"2024-05-07T11:17:22.416120+0000","last_active":"2024-05-07T11:17:23.396991+0000","last_peered":"2024-05-07T11:17:23.396991+0000","last_clean":"2024-05-07T11:17:23.396991+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:23.396991+0000","last_undegraded":"2024-05-07T11:17:23.396991+0000","last_fullsized":"2024-05-07T11:17:23.396991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:13.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"63'185","reported_seq":328,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394584+0000","last_change":"2024-05-07T11:17:19.438939+0000","last_active":"2024-05-07T11:17:23.394584+0000","last_peered":"2024-05-07T11:17:23.394584+0000","last_clean":"2024-05-07T11:14:24.357156+0000","last_became_active":"2024-05-07T11:17:19.437340+0000","last_became_peered":"2024-05-07T11:17:19.437340+0000","last_unstale":"2024-05-07T11:17:23.394584+0000","last_undegraded":"2024-05-07T11:17:19.420606+0000","last_fullsized":"2024-05-07T11:17:19.414996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":49}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'156","reported_seq":299,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393912+0000","last_change":"2024-05-07T11:17:22.416165+0000","last_active":"2024-05-07T11:17:23.393912+0000","last_peered":"2024-05-07T11:17:23.393912+0000","last_clean":"2024-05-07T11:17:23.393912+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:23.393912+0000","last_undegraded":"2024-05-07T11:17:23.393912+0000","last_fullsized":"2024-05-07T11:17:23.393912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:57.237765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":262,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395342+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:23.395342+0000","last_peered":"2024-05-07T11:17:23.395342+0000","last_clean":"2024-05-07T11:17:23.395342+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:23.395342+0000","last_undegraded":"2024-05-07T11:17:23.395342+0000","last_fullsized":"2024-05-07T11:17:23.395342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"63'141","reported_seq":281,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394291+0000","last_change":"2024-05-07T11:17:21.419206+0000","last_active":"2024-05-07T11:17:23.394291+0000","last_peered":"2024-05-07T11:17:23.394291+0000","last_clean":"2024-05-07T11:17:23.394291+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:23.394291+0000","last_undegraded":"2024-05-07T11:17:23.394291+0000","last_fullsized":"2024-05-07T11:17:23.394291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:12.679336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397177+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:23.397177+0000","last_peered":"2024-05-07T11:17:23.397177+0000","last_clean":"2024-05-07T11:17:23.397177+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:23.397177+0000","last_undegraded":"2024-05-07T11:17:23.397177+0000","last_fullsized":"2024-05-07T11:17:23.397177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.025763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"63'179","reported_seq":253,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397532+0000","last_change":"2024-05-07T11:17:21.419284+0000","last_active":"2024-05-07T11:17:23.397532+0000","last_peered":"2024-05-07T11:17:23.397532+0000","last_clean":"2024-05-07T11:17:23.397532+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:23.397532+0000","last_undegraded":"2024-05-07T11:17:23.397532+0000","last_fullsized":"2024-05-07T11:17:23.397532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:54.463898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393647+0000","last_change":"2024-05-07T11:17:18.423604+0000","last_active":"2024-05-07T11:17:23.393647+0000","last_peered":"2024-05-07T11:17:23.393647+0000","last_clean":"2024-05-07T11:17:23.393647+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:23.393647+0000","last_undegraded":"2024-05-07T11:17:23.393647+0000","last_fullsized":"2024-05-07T11:17:23.393647+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:45:28.650148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":230,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.401355+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:23.401355+0000","last_peered":"2024-05-07T11:17:23.401355+0000","last_clean":"2024-05-07T11:17:23.401355+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:23.401355+0000","last_undegraded":"2024-05-07T11:17:23.401355+0000","last_fullsized":"2024-05-07T11:17:23.401355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":151,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395256+0000","last_change":"2024-05-07T11:17:18.433027+0000","last_active":"2024-05-07T11:17:23.395256+0000","last_peered":"2024-05-07T11:17:23.395256+0000","last_clean":"2024-05-07T11:17:23.395256+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:23.395256+0000","last_undegraded":"2024-05-07T11:17:23.395256+0000","last_fullsized":"2024-05-07T11:17:23.395256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:47.068504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":146,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397627+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:23.397627+0000","last_peered":"2024-05-07T11:17:23.397627+0000","last_clean":"2024-05-07T11:17:23.397627+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:23.397627+0000","last_undegraded":"2024-05-07T11:17:23.397627+0000","last_fullsized":"2024-05-07T11:17:23.397627+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:35:51.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'155","reported_seq":224,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393522+0000","last_change":"2024-05-07T11:17:19.437866+0000","last_active":"2024-05-07T11:17:23.393522+0000","last_peered":"2024-05-07T11:17:23.393522+0000","last_clean":"2024-05-07T11:14:24.400453+0000","last_became_active":"2024-05-07T11:17:19.433702+0000","last_became_peered":"2024-05-07T11:17:19.433702+0000","last_unstale":"2024-05-07T11:17:23.393522+0000","last_undegraded":"2024-05-07T11:17:19.404990+0000","last_fullsized":"2024-05-07T11:17:19.399778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":95,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394209+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:23.394209+0000","last_peered":"2024-05-07T11:17:23.394209+0000","last_clean":"2024-05-07T11:17:23.394209+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:23.394209+0000","last_undegraded":"2024-05-07T11:17:23.394209+0000","last_fullsized":"2024-05-07T11:17:23.394209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:16.479879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'167","reported_seq":307,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393522+0000","last_change":"2024-05-07T11:17:21.418782+0000","last_active":"2024-05-07T11:17:23.393522+0000","last_peered":"2024-05-07T11:17:23.393522+0000","last_clean":"2024-05-07T11:17:23.393522+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:23.393522+0000","last_undegraded":"2024-05-07T11:17:23.393522+0000","last_fullsized":"2024-05-07T11:17:23.393522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:13.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396832+0000","last_change":"2024-05-07T11:17:22.419069+0000","last_active":"2024-05-07T11:17:23.396832+0000","last_peered":"2024-05-07T11:17:23.396832+0000","last_clean":"2024-05-07T11:17:23.396832+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:23.396832+0000","last_undegraded":"2024-05-07T11:17:23.396832+0000","last_fullsized":"2024-05-07T11:17:23.396832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:20.890067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":302,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394613+0000","last_change":"2024-05-07T11:17:19.439572+0000","last_active":"2024-05-07T11:17:23.394613+0000","last_peered":"2024-05-07T11:17:23.394613+0000","last_clean":"2024-05-07T11:14:24.352569+0000","last_became_active":"2024-05-07T11:17:19.437369+0000","last_became_peered":"2024-05-07T11:17:19.437369+0000","last_unstale":"2024-05-07T11:17:23.394613+0000","last_undegraded":"2024-05-07T11:17:19.420446+0000","last_fullsized":"2024-05-07T11:17:19.417984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397543+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:23.397543+0000","last_peered":"2024-05-07T11:17:23.397543+0000","last_clean":"2024-05-07T11:17:23.397543+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:23.397543+0000","last_undegraded":"2024-05-07T11:17:23.397543+0000","last_fullsized":"2024-05-07T11:17:23.397543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:31:28.580245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"63'164","reported_seq":300,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397425+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:17:23.397425+0000","last_peered":"2024-05-07T11:17:23.397425+0000","last_clean":"2024-05-07T11:17:23.397425+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:23.397425+0000","last_undegraded":"2024-05-07T11:17:23.397425+0000","last_fullsized":"2024-05-07T11:17:23.397425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397475+0000","last_change":"2024-05-07T11:17:18.450923+0000","last_active":"2024-05-07T11:17:23.397475+0000","last_peered":"2024-05-07T11:17:23.397475+0000","last_clean":"2024-05-07T11:17:23.397475+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:23.397475+0000","last_undegraded":"2024-05-07T11:17:23.397475+0000","last_fullsized":"2024-05-07T11:17:23.397475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:38.864461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"63'172","reported_seq":315,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.396868+0000","last_change":"2024-05-07T11:17:19.439191+0000","last_active":"2024-05-07T11:17:23.396868+0000","last_peered":"2024-05-07T11:17:23.396868+0000","last_clean":"2024-05-07T11:14:24.436962+0000","last_became_active":"2024-05-07T11:17:19.438026+0000","last_became_peered":"2024-05-07T11:17:19.438026+0000","last_unstale":"2024-05-07T11:17:23.396868+0000","last_undegraded":"2024-05-07T11:17:19.423429+0000","last_fullsized":"2024-05-07T11:17:19.419186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":112,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395161+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:23.395161+0000","last_peered":"2024-05-07T11:17:23.395161+0000","last_clean":"2024-05-07T11:17:23.395161+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:23.395161+0000","last_undegraded":"2024-05-07T11:17:23.395161+0000","last_fullsized":"2024-05-07T11:17:23.395161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"63'163","reported_seq":302,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.395431+0000","last_change":"2024-05-07T11:17:19.437566+0000","last_active":"2024-05-07T11:17:23.395431+0000","last_peered":"2024-05-07T11:17:23.395431+0000","last_clean":"2024-05-07T11:14:24.493593+0000","last_became_active":"2024-05-07T11:17:19.436403+0000","last_became_peered":"2024-05-07T11:17:19.436403+0000","last_unstale":"2024-05-07T11:17:23.395431+0000","last_undegraded":"2024-05-07T11:17:19.420310+0000","last_fullsized":"2024-05-07T11:17:19.416685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":98,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":5}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393494+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:23.393494+0000","last_peered":"2024-05-07T11:17:23.393494+0000","last_clean":"2024-05-07T11:17:23.393494+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:23.393494+0000","last_undegraded":"2024-05-07T11:17:23.393494+0000","last_fullsized":"2024-05-07T11:17:23.393494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:47.689436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'137","reported_seq":453,"reported_epoch":75,"state":"peering","last_fresh":"2024-05-07T11:17:22.518029+0000","last_change":"2024-05-07T11:17:23.394952+0000","last_active":"2024-05-07T11:17:23.394952+0000","last_peered":"2024-05-07T11:17:22.518029+0000","last_clean":"2024-05-07T11:14:24.395523+0000","last_became_active":"2024-05-07T11:17:19.432130+0000","last_became_peered":"2024-05-07T11:17:19.432130+0000","last_unstale":"2024-05-07T11:17:22.518029+0000","last_undegraded":"2024-05-07T11:17:22.518029+0000","last_fullsized":"2024-05-07T11:17:19.415262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393850+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:23.393850+0000","last_peered":"2024-05-07T11:17:23.393850+0000","last_clean":"2024-05-07T11:17:23.393850+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:23.393850+0000","last_undegraded":"2024-05-07T11:17:23.393850+0000","last_fullsized":"2024-05-07T11:17:23.393850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:59.411938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'141","reported_seq":461,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397799+0000","last_change":"2024-05-07T11:17:22.417126+0000","last_active":"2024-05-07T11:17:23.397799+0000","last_peered":"2024-05-07T11:17:23.397799+0000","last_clean":"2024-05-07T11:17:23.397799+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:23.397799+0000","last_undegraded":"2024-05-07T11:17:23.397799+0000","last_fullsized":"2024-05-07T11:17:23.397799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":345,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395388+0000","last_change":"2024-05-07T11:17:18.433863+0000","last_active":"2024-05-07T11:17:23.395388+0000","last_peered":"2024-05-07T11:17:23.395388+0000","last_clean":"2024-05-07T11:17:23.395388+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:23.395388+0000","last_undegraded":"2024-05-07T11:17:23.395388+0000","last_fullsized":"2024-05-07T11:17:23.395388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:10.515455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":154,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395912+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:23.395912+0000","last_peered":"2024-05-07T11:17:23.395912+0000","last_clean":"2024-05-07T11:17:23.395912+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:23.395912+0000","last_undegraded":"2024-05-07T11:17:23.395912+0000","last_fullsized":"2024-05-07T11:17:23.395912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:03:02.539869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397079+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:23.397079+0000","last_peered":"2024-05-07T11:17:23.397079+0000","last_clean":"2024-05-07T11:17:23.397079+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:23.397079+0000","last_undegraded":"2024-05-07T11:17:23.397079+0000","last_fullsized":"2024-05-07T11:17:23.397079+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":268,"reported_epoch":76,"state":"active+recovery_wait+degraded","last_fresh":"2024-05-07T11:17:23.403359+0000","last_change":"2024-05-07T11:17:23.403839+0000","last_active":"2024-05-07T11:17:23.403359+0000","last_peered":"2024-05-07T11:17:23.403359+0000","last_clean":"2024-05-07T11:14:24.305202+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:23.403359+0000","last_undegraded":"2024-05-07T11:17:23.396611+0000","last_fullsized":"2024-05-07T11:17:23.403359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":52}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395307+0000","last_change":"2024-05-07T11:17:18.433452+0000","last_active":"2024-05-07T11:17:23.395307+0000","last_peered":"2024-05-07T11:17:23.395307+0000","last_clean":"2024-05-07T11:17:23.395307+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:23.395307+0000","last_undegraded":"2024-05-07T11:17:23.395307+0000","last_fullsized":"2024-05-07T11:17:23.395307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:26.663080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":206,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397102+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:17:23.397102+0000","last_peered":"2024-05-07T11:17:23.397102+0000","last_clean":"2024-05-07T11:17:23.397102+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:23.397102+0000","last_undegraded":"2024-05-07T11:17:23.397102+0000","last_fullsized":"2024-05-07T11:17:23.397102+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"63'160","reported_seq":293,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.394449+0000","last_change":"2024-05-07T11:17:23.394449+0000","last_active":"2024-05-07T11:17:18.396148+0000","last_peered":"2024-05-07T11:17:17.243626+0000","last_clean":"2024-05-07T11:14:24.444615+0000","last_became_active":"2024-05-07T11:14:25.509161+0000","last_became_peered":"2024-05-07T11:14:25.509161+0000","last_unstale":"2024-05-07T11:17:23.394449+0000","last_undegraded":"2024-05-07T11:17:23.394449+0000","last_fullsized":"2024-05-07T11:17:23.394449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397216+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:23.397216+0000","last_peered":"2024-05-07T11:17:23.397216+0000","last_clean":"2024-05-07T11:17:23.397216+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:23.397216+0000","last_undegraded":"2024-05-07T11:17:23.397216+0000","last_fullsized":"2024-05-07T11:17:23.397216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:20.744525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393493+0000","last_change":"2024-05-07T11:17:18.572639+0000","last_active":"2024-05-07T11:17:23.393493+0000","last_peered":"2024-05-07T11:17:23.393493+0000","last_clean":"2024-05-07T11:17:23.393493+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:23.393493+0000","last_undegraded":"2024-05-07T11:17:23.393493+0000","last_fullsized":"2024-05-07T11:17:23.393493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:15.538158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":244,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394418+0000","last_change":"2024-05-07T11:17:19.436365+0000","last_active":"2024-05-07T11:17:23.394418+0000","last_peered":"2024-05-07T11:17:23.394418+0000","last_clean":"2024-05-07T11:14:24.445283+0000","last_became_active":"2024-05-07T11:17:19.432372+0000","last_became_peered":"2024-05-07T11:17:19.432372+0000","last_unstale":"2024-05-07T11:17:23.394418+0000","last_undegraded":"2024-05-07T11:17:19.409832+0000","last_fullsized":"2024-05-07T11:17:19.399925+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":109,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":6},{"shards":"2","objects":50}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395254+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:23.395254+0000","last_peered":"2024-05-07T11:17:23.395254+0000","last_clean":"2024-05-07T11:17:23.395254+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:23.395254+0000","last_undegraded":"2024-05-07T11:17:23.395254+0000","last_fullsized":"2024-05-07T11:17:23.395254+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":148,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395811+0000","last_change":"2024-05-07T11:17:18.404539+0000","last_active":"2024-05-07T11:17:23.395811+0000","last_peered":"2024-05-07T11:17:23.395811+0000","last_clean":"2024-05-07T11:17:23.395811+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:23.395811+0000","last_undegraded":"2024-05-07T11:17:23.395811+0000","last_fullsized":"2024-05-07T11:17:23.395811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:50.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":398,"reported_epoch":76,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:24.181331+0000","last_change":"2024-05-07T11:17:24.052450+0000","last_active":"2024-05-07T11:17:24.181331+0000","last_peered":"2024-05-07T11:17:24.181331+0000","last_clean":"2024-05-07T11:14:24.363205+0000","last_became_active":"2024-05-07T11:17:19.429221+0000","last_became_peered":"2024-05-07T11:17:19.429221+0000","last_unstale":"2024-05-07T11:17:24.181331+0000","last_undegraded":"2024-05-07T11:17:19.417937+0000","last_fullsized":"2024-05-07T11:17:19.407481+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":11,"num_objects_misplaced":15,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":143021,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":46}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396935+0000","last_change":"2024-05-07T11:17:22.424750+0000","last_active":"2024-05-07T11:17:23.396935+0000","last_peered":"2024-05-07T11:17:23.396935+0000","last_clean":"2024-05-07T11:17:23.396935+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:23.396935+0000","last_undegraded":"2024-05-07T11:17:23.396935+0000","last_fullsized":"2024-05-07T11:17:23.396935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:12.283160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397838+0000","last_change":"2024-05-07T11:17:18.433137+0000","last_active":"2024-05-07T11:17:23.397838+0000","last_peered":"2024-05-07T11:17:23.397838+0000","last_clean":"2024-05-07T11:17:23.397838+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:23.397838+0000","last_undegraded":"2024-05-07T11:17:23.397838+0000","last_fullsized":"2024-05-07T11:17:23.397838+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:40.770823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":297,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393947+0000","last_change":"2024-05-07T11:17:19.439272+0000","last_active":"2024-05-07T11:17:23.393947+0000","last_peered":"2024-05-07T11:17:23.393947+0000","last_clean":"2024-05-07T11:14:24.425940+0000","last_became_active":"2024-05-07T11:17:19.434379+0000","last_became_peered":"2024-05-07T11:17:19.434379+0000","last_unstale":"2024-05-07T11:17:23.393947+0000","last_undegraded":"2024-05-07T11:17:19.403485+0000","last_fullsized":"2024-05-07T11:17:19.397696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397705+0000","last_change":"2024-05-07T11:17:18.431763+0000","last_active":"2024-05-07T11:17:23.397705+0000","last_peered":"2024-05-07T11:17:23.397705+0000","last_clean":"2024-05-07T11:17:23.397705+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:23.397705+0000","last_undegraded":"2024-05-07T11:17:23.397705+0000","last_fullsized":"2024-05-07T11:17:23.397705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:38.234395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394551+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:23.394551+0000","last_peered":"2024-05-07T11:17:23.394551+0000","last_clean":"2024-05-07T11:17:23.394551+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:23.394551+0000","last_undegraded":"2024-05-07T11:17:23.394551+0000","last_fullsized":"2024-05-07T11:17:23.394551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:54.609817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'181","reported_seq":317,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.399296+0000","last_change":"2024-05-07T11:17:23.399296+0000","last_active":"2024-05-07T11:17:23.399296+0000","last_peered":"2024-05-07T11:17:23.399296+0000","last_clean":"2024-05-07T11:17:23.399296+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:23.399296+0000","last_undegraded":"2024-05-07T11:17:23.399296+0000","last_fullsized":"2024-05-07T11:17:23.399296+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:21.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":86,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395081+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:23.395081+0000","last_peered":"2024-05-07T11:17:23.395081+0000","last_clean":"2024-05-07T11:17:23.395081+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:23.395081+0000","last_undegraded":"2024-05-07T11:17:23.395081+0000","last_fullsized":"2024-05-07T11:17:23.395081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:03.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397671+0000","last_change":"2024-05-07T11:17:18.432358+0000","last_active":"2024-05-07T11:17:23.397671+0000","last_peered":"2024-05-07T11:17:23.397671+0000","last_clean":"2024-05-07T11:17:23.397671+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:23.397671+0000","last_undegraded":"2024-05-07T11:17:23.397671+0000","last_fullsized":"2024-05-07T11:17:23.397671+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:36.281521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"63'175","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393858+0000","last_change":"2024-05-07T11:17:22.420080+0000","last_active":"2024-05-07T11:17:23.393858+0000","last_peered":"2024-05-07T11:17:23.393858+0000","last_clean":"2024-05-07T11:17:23.393858+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:23.393858+0000","last_undegraded":"2024-05-07T11:17:23.393858+0000","last_fullsized":"2024-05-07T11:17:23.393858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:41.233935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'38","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397563+0000","last_change":"2024-05-07T11:17:18.459674+0000","last_active":"2024-05-07T11:17:23.397563+0000","last_peered":"2024-05-07T11:17:23.397563+0000","last_clean":"2024-05-07T11:17:23.397563+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:23.397563+0000","last_undegraded":"2024-05-07T11:17:23.397563+0000","last_fullsized":"2024-05-07T11:17:23.397563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:35.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":149,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397844+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:23.397844+0000","last_peered":"2024-05-07T11:17:23.397844+0000","last_clean":"2024-05-07T11:17:23.397844+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:23.397844+0000","last_undegraded":"2024-05-07T11:17:23.397844+0000","last_fullsized":"2024-05-07T11:17:23.397844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:14.650941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'138","reported_seq":276,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393764+0000","last_change":"2024-05-07T11:17:22.417629+0000","last_active":"2024-05-07T11:17:23.393764+0000","last_peered":"2024-05-07T11:17:23.393764+0000","last_clean":"2024-05-07T11:17:23.393764+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:23.393764+0000","last_undegraded":"2024-05-07T11:17:23.393764+0000","last_fullsized":"2024-05-07T11:17:23.393764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:58.760049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'164","reported_seq":495,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.400613+0000","last_change":"2024-05-07T11:17:23.400613+0000","last_active":"2024-05-07T11:17:23.400613+0000","last_peered":"2024-05-07T11:17:23.400613+0000","last_clean":"2024-05-07T11:17:23.400613+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:23.400613+0000","last_undegraded":"2024-05-07T11:17:23.400613+0000","last_fullsized":"2024-05-07T11:17:23.400613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:28.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":193,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397519+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:23.397519+0000","last_peered":"2024-05-07T11:17:23.397519+0000","last_clean":"2024-05-07T11:17:23.397519+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:23.397519+0000","last_undegraded":"2024-05-07T11:17:23.397519+0000","last_fullsized":"2024-05-07T11:17:23.397519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:35.832524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":498,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:23.626703+0000","last_change":"2024-05-07T11:17:23.626897+0000","last_active":"2024-05-07T11:17:23.626703+0000","last_peered":"2024-05-07T11:17:23.626703+0000","last_clean":"2024-05-07T11:14:24.380609+0000","last_became_active":"2024-05-07T11:17:19.432285+0000","last_became_peered":"2024-05-07T11:17:19.432285+0000","last_unstale":"2024-05-07T11:17:23.626703+0000","last_undegraded":"2024-05-07T11:17:23.626703+0000","last_fullsized":"2024-05-07T11:17:19.405108+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":52}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393959+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:23.393959+0000","last_peered":"2024-05-07T11:17:23.393959+0000","last_clean":"2024-05-07T11:17:23.393959+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:23.393959+0000","last_undegraded":"2024-05-07T11:17:23.393959+0000","last_fullsized":"2024-05-07T11:17:23.393959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:46.092532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395657+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:23.395657+0000","last_peered":"2024-05-07T11:17:23.395657+0000","last_clean":"2024-05-07T11:17:23.395657+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:23.395657+0000","last_undegraded":"2024-05-07T11:17:23.395657+0000","last_fullsized":"2024-05-07T11:17:23.395657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.076287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"63'172","reported_seq":247,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396881+0000","last_change":"2024-05-07T11:17:21.419673+0000","last_active":"2024-05-07T11:17:23.396881+0000","last_peered":"2024-05-07T11:17:23.396881+0000","last_clean":"2024-05-07T11:17:23.396881+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:23.396881+0000","last_undegraded":"2024-05-07T11:17:23.396881+0000","last_fullsized":"2024-05-07T11:17:23.396881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:01.519110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397476+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:23.397476+0000","last_peered":"2024-05-07T11:17:23.397476+0000","last_clean":"2024-05-07T11:17:23.397476+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:23.397476+0000","last_undegraded":"2024-05-07T11:17:23.397476+0000","last_fullsized":"2024-05-07T11:17:23.397476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:45.698283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":231,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393507+0000","last_change":"2024-05-07T11:17:19.438036+0000","last_active":"2024-05-07T11:17:23.393507+0000","last_peered":"2024-05-07T11:17:23.393507+0000","last_clean":"2024-05-07T11:14:24.381417+0000","last_became_active":"2024-05-07T11:17:19.436774+0000","last_became_peered":"2024-05-07T11:17:19.436774+0000","last_unstale":"2024-05-07T11:17:23.393507+0000","last_undegraded":"2024-05-07T11:17:19.412827+0000","last_fullsized":"2024-05-07T11:17:19.397337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":100,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":45}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":314,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.395790+0000","last_change":"2024-05-07T11:17:19.437422+0000","last_active":"2024-05-07T11:17:23.395790+0000","last_peered":"2024-05-07T11:17:23.395790+0000","last_clean":"2024-05-07T11:14:24.468775+0000","last_became_active":"2024-05-07T11:17:19.432546+0000","last_became_peered":"2024-05-07T11:17:19.432546+0000","last_unstale":"2024-05-07T11:17:23.395790+0000","last_undegraded":"2024-05-07T11:17:19.406490+0000","last_fullsized":"2024-05-07T11:17:19.403425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396766+0000","last_change":"2024-05-07T11:17:18.431271+0000","last_active":"2024-05-07T11:17:23.396766+0000","last_peered":"2024-05-07T11:17:23.396766+0000","last_clean":"2024-05-07T11:17:23.396766+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:23.396766+0000","last_undegraded":"2024-05-07T11:17:23.396766+0000","last_fullsized":"2024-05-07T11:17:23.396766+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":421,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:24.051589+0000","last_change":"2024-05-07T11:17:24.051740+0000","last_active":"2024-05-07T11:17:24.051589+0000","last_peered":"2024-05-07T11:17:24.051589+0000","last_clean":"2024-05-07T11:14:24.298846+0000","last_became_active":"2024-05-07T11:17:19.434163+0000","last_became_peered":"2024-05-07T11:17:19.434163+0000","last_unstale":"2024-05-07T11:17:24.051589+0000","last_undegraded":"2024-05-07T11:17:19.419458+0000","last_fullsized":"2024-05-07T11:17:19.416477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396990+0000","last_change":"2024-05-07T11:17:18.402834+0000","last_active":"2024-05-07T11:17:23.396990+0000","last_peered":"2024-05-07T11:17:23.396990+0000","last_clean":"2024-05-07T11:17:23.396990+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:23.396990+0000","last_undegraded":"2024-05-07T11:17:23.396990+0000","last_fullsized":"2024-05-07T11:17:23.396990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"63'205","reported_seq":343,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394003+0000","last_change":"2024-05-07T11:17:22.421343+0000","last_active":"2024-05-07T11:17:23.394003+0000","last_peered":"2024-05-07T11:17:23.394003+0000","last_clean":"2024-05-07T11:17:23.394003+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:23.394003+0000","last_undegraded":"2024-05-07T11:17:23.394003+0000","last_fullsized":"2024-05-07T11:17:23.394003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:24.076915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393769+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:23.393769+0000","last_peered":"2024-05-07T11:17:23.393769+0000","last_clean":"2024-05-07T11:17:23.393769+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:23.393769+0000","last_undegraded":"2024-05-07T11:17:23.393769+0000","last_fullsized":"2024-05-07T11:17:23.393769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:53.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'163","reported_seq":296,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.394970+0000","last_change":"2024-05-07T11:17:23.394970+0000","last_active":"2024-05-07T11:17:18.395583+0000","last_peered":"2024-05-07T11:17:17.242817+0000","last_clean":"2024-05-07T11:14:24.449814+0000","last_became_active":"2024-05-07T11:14:25.512203+0000","last_became_peered":"2024-05-07T11:14:25.512203+0000","last_unstale":"2024-05-07T11:17:23.394970+0000","last_undegraded":"2024-05-07T11:17:23.394970+0000","last_fullsized":"2024-05-07T11:17:23.394970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394133+0000","last_change":"2024-05-07T11:17:18.555160+0000","last_active":"2024-05-07T11:17:23.394133+0000","last_peered":"2024-05-07T11:17:23.394133+0000","last_clean":"2024-05-07T11:17:23.394133+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:23.394133+0000","last_undegraded":"2024-05-07T11:17:23.394133+0000","last_fullsized":"2024-05-07T11:17:23.394133+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:37.962741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'166","reported_seq":519,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393837+0000","last_change":"2024-05-07T11:17:21.418540+0000","last_active":"2024-05-07T11:17:23.393837+0000","last_peered":"2024-05-07T11:17:23.393837+0000","last_clean":"2024-05-07T11:17:23.393837+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:23.393837+0000","last_undegraded":"2024-05-07T11:17:23.393837+0000","last_fullsized":"2024-05-07T11:17:23.393837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:16.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":157,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397184+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:23.397184+0000","last_peered":"2024-05-07T11:17:23.397184+0000","last_clean":"2024-05-07T11:17:23.397184+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:23.397184+0000","last_undegraded":"2024-05-07T11:17:23.397184+0000","last_fullsized":"2024-05-07T11:17:23.397184+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:17.953399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":300,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394831+0000","last_change":"2024-05-07T11:17:19.440247+0000","last_active":"2024-05-07T11:17:23.394831+0000","last_peered":"2024-05-07T11:17:23.394831+0000","last_clean":"2024-05-07T11:14:24.442642+0000","last_became_active":"2024-05-07T11:17:19.439763+0000","last_became_peered":"2024-05-07T11:17:19.439763+0000","last_unstale":"2024-05-07T11:17:23.394831+0000","last_undegraded":"2024-05-07T11:17:19.422552+0000","last_fullsized":"2024-05-07T11:17:19.420828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":6},{"shards":"2","objects":51}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394116+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:23.394116+0000","last_peered":"2024-05-07T11:17:23.394116+0000","last_clean":"2024-05-07T11:17:23.394116+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:23.394116+0000","last_undegraded":"2024-05-07T11:17:23.394116+0000","last_fullsized":"2024-05-07T11:17:23.394116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:24.011380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'169","reported_seq":307,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393646+0000","last_change":"2024-05-07T11:17:22.416150+0000","last_active":"2024-05-07T11:17:23.393646+0000","last_peered":"2024-05-07T11:17:23.393646+0000","last_clean":"2024-05-07T11:17:23.393646+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:23.393646+0000","last_undegraded":"2024-05-07T11:17:23.393646+0000","last_fullsized":"2024-05-07T11:17:23.393646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:28.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397795+0000","last_change":"2024-05-07T11:17:18.504321+0000","last_active":"2024-05-07T11:17:23.397795+0000","last_peered":"2024-05-07T11:17:23.397795+0000","last_clean":"2024-05-07T11:17:23.397795+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:23.397795+0000","last_undegraded":"2024-05-07T11:17:23.397795+0000","last_fullsized":"2024-05-07T11:17:23.397795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"63'199","reported_seq":595,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:23.874613+0000","last_change":"2024-05-07T11:17:23.874777+0000","last_active":"2024-05-07T11:17:23.874613+0000","last_peered":"2024-05-07T11:17:23.874613+0000","last_clean":"2024-05-07T11:14:24.451073+0000","last_became_active":"2024-05-07T11:17:19.426840+0000","last_became_peered":"2024-05-07T11:17:19.426840+0000","last_unstale":"2024-05-07T11:17:23.874613+0000","last_undegraded":"2024-05-07T11:17:19.398884+0000","last_fullsized":"2024-05-07T11:17:19.397117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":62}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397630+0000","last_change":"2024-05-07T11:17:18.429950+0000","last_active":"2024-05-07T11:17:23.397630+0000","last_peered":"2024-05-07T11:17:23.397630+0000","last_clean":"2024-05-07T11:17:23.397630+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:23.397630+0000","last_undegraded":"2024-05-07T11:17:23.397630+0000","last_fullsized":"2024-05-07T11:17:23.397630+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2328,"num_objects_misplaced":434,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3115,"num_bytes_recovered":10110672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62046208,"data_stored":52021508,"data_compressed":4472281,"data_compressed_allocated":5259264,"data_compressed_original":13680640,"omap_allocated":0,"internal_metadata":0},"log_size":10416,"ondisk_log_size":10416,"up":128,"acting":103,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":428,"ondisk_log_size":428,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87884,"kb_used_data":34492,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94283956,"statfs":{"total":96636764160,"available":96546770944,"internally_reserved":0,"allocated":35319808,"data_stored":57209467,"data_compressed":6730892,"data_compressed_allocated":8085504,"data_compressed_original":38760448,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710723,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68648,"kb_used_data":24412,"kb_used_omap":10,"kb_used_meta":44213,"kb_avail":94303192,"statfs":{"total":96636764160,"available":96566468608,"internally_reserved":0,"allocated":24997888,"data_stored":46562034,"data_compressed":5505454,"data_compressed_allocated":6463488,"data_compressed_original":33083392,"omap_allocated":10404,"internal_metadata":45274972},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49520,"kb_used_data":18344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322320,"statfs":{"total":96636764160,"available":96586055680,"internally_reserved":0,"allocated":18784256,"data_stored":32832218,"data_compressed":4426861,"data_compressed_allocated":5206016,"data_compressed_original":24207360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15187968,"data_stored":12540098,"data_compressed":1440329,"data_compressed_allocated":1683456,"data_compressed_original":4333568,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19030016,"data_stored":16315709,"data_compressed":1057885,"data_compressed_allocated":1261568,"data_compressed_original":3276800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27828224,"data_stored":23165701,"data_compressed":1974067,"data_compressed_allocated":2314240,"data_compressed_original":6070272,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:26.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:26.659 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:26.661 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:26.671 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-05-07T11:17:26.398215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2328,"num_objects_misplaced":434,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3137,"num_bytes_recovered":47528968,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11001,"ondisk_log_size":11001,"up":210,"acting":185,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":235,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":206052,"kb_used_data":77248,"kb_used_omap":13,"kb_used_meta":128754,"kb_avail":282909468,"statfs":{"total":289910292480,"available":289699295232,"internally_reserved":0,"allocated":79101952,"data_stored":136603719,"data_compressed":16663207,"data_compressed_allocated":19755008,"data_compressed_original":96051200,"omap_allocated":13594,"internal_metadata":131844838},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-576,"num_objects_misplaced":-580,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1213,"num_bytes_recovered":2027404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.988356"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":308,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.397072+0000","last_change":"2024-05-07T11:17:19.438566+0000","last_active":"2024-05-07T11:17:23.397072+0000","last_peered":"2024-05-07T11:17:23.397072+0000","last_clean":"2024-05-07T11:14:24.364900+0000","last_became_active":"2024-05-07T11:17:19.437076+0000","last_became_peered":"2024-05-07T11:17:19.437076+0000","last_unstale":"2024-05-07T11:17:23.397072+0000","last_undegraded":"2024-05-07T11:17:19.425486+0000","last_fullsized":"2024-05-07T11:17:19.407594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":104,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":49}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"63'155","reported_seq":295,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394610+0000","last_change":"2024-05-07T11:17:21.419253+0000","last_active":"2024-05-07T11:17:23.394610+0000","last_peered":"2024-05-07T11:17:23.394610+0000","last_clean":"2024-05-07T11:17:23.394610+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:23.394610+0000","last_undegraded":"2024-05-07T11:17:23.394610+0000","last_fullsized":"2024-05-07T11:17:23.394610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:45:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'169","reported_seq":308,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394330+0000","last_change":"2024-05-07T11:17:19.436446+0000","last_active":"2024-05-07T11:17:23.394330+0000","last_peered":"2024-05-07T11:17:23.394330+0000","last_clean":"2024-05-07T11:14:24.486064+0000","last_became_active":"2024-05-07T11:17:19.434058+0000","last_became_peered":"2024-05-07T11:17:19.434058+0000","last_unstale":"2024-05-07T11:17:23.394330+0000","last_undegraded":"2024-05-07T11:17:19.408807+0000","last_fullsized":"2024-05-07T11:17:19.403831+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":260,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396641+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:23.396641+0000","last_peered":"2024-05-07T11:17:23.396641+0000","last_clean":"2024-05-07T11:17:23.396641+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:23.396641+0000","last_undegraded":"2024-05-07T11:17:23.396641+0000","last_fullsized":"2024-05-07T11:17:23.396641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"63'186","reported_seq":326,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394395+0000","last_change":"2024-05-07T11:17:21.419034+0000","last_active":"2024-05-07T11:17:23.394395+0000","last_peered":"2024-05-07T11:17:23.394395+0000","last_clean":"2024-05-07T11:17:23.394395+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:23.394395+0000","last_undegraded":"2024-05-07T11:17:23.394395+0000","last_fullsized":"2024-05-07T11:17:23.394395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:42.536445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":251,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394324+0000","last_change":"2024-05-07T11:17:22.419149+0000","last_active":"2024-05-07T11:17:23.394324+0000","last_peered":"2024-05-07T11:17:23.394324+0000","last_clean":"2024-05-07T11:14:24.385916+0000","last_became_active":"2024-05-07T11:17:22.416956+0000","last_became_peered":"2024-05-07T11:17:22.416956+0000","last_unstale":"2024-05-07T11:17:23.394324+0000","last_undegraded":"2024-05-07T11:17:22.411982+0000","last_fullsized":"2024-05-07T11:17:22.411747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":108,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":42}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"63'166","reported_seq":255,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393747+0000","last_change":"2024-05-07T11:17:22.418934+0000","last_active":"2024-05-07T11:17:23.393747+0000","last_peered":"2024-05-07T11:17:23.393747+0000","last_clean":"2024-05-07T11:17:23.393747+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:23.393747+0000","last_undegraded":"2024-05-07T11:17:23.393747+0000","last_fullsized":"2024-05-07T11:17:23.393747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:05.143462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":449,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.399107+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:23.399107+0000","last_peered":"2024-05-07T11:17:23.399107+0000","last_clean":"2024-05-07T11:17:23.399107+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:23.399107+0000","last_undegraded":"2024-05-07T11:17:23.399107+0000","last_fullsized":"2024-05-07T11:17:23.399107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:04.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":246,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.397630+0000","last_change":"2024-05-07T11:17:19.437547+0000","last_active":"2024-05-07T11:17:23.397630+0000","last_peered":"2024-05-07T11:17:23.397630+0000","last_clean":"2024-05-07T11:14:24.451837+0000","last_became_active":"2024-05-07T11:17:19.435835+0000","last_became_peered":"2024-05-07T11:17:19.435835+0000","last_unstale":"2024-05-07T11:17:23.397630+0000","last_undegraded":"2024-05-07T11:17:19.424674+0000","last_fullsized":"2024-05-07T11:17:19.410369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":106,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'156","reported_seq":299,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394572+0000","last_change":"2024-05-07T11:17:22.416801+0000","last_active":"2024-05-07T11:17:23.394572+0000","last_peered":"2024-05-07T11:17:23.394572+0000","last_clean":"2024-05-07T11:17:23.394572+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:23.394572+0000","last_undegraded":"2024-05-07T11:17:23.394572+0000","last_fullsized":"2024-05-07T11:17:23.394572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:07.028486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'154","reported_seq":436,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394586+0000","last_change":"2024-05-07T11:17:22.419089+0000","last_active":"2024-05-07T11:17:23.394586+0000","last_peered":"2024-05-07T11:17:23.394586+0000","last_clean":"2024-05-07T11:17:23.394586+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:23.394586+0000","last_undegraded":"2024-05-07T11:17:23.394586+0000","last_fullsized":"2024-05-07T11:17:23.394586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:57.833385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":279,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394814+0000","last_change":"2024-05-07T11:17:19.438657+0000","last_active":"2024-05-07T11:17:23.394814+0000","last_peered":"2024-05-07T11:17:23.394814+0000","last_clean":"2024-05-07T11:14:24.417671+0000","last_became_active":"2024-05-07T11:17:19.435011+0000","last_became_peered":"2024-05-07T11:17:19.435011+0000","last_unstale":"2024-05-07T11:17:23.394814+0000","last_undegraded":"2024-05-07T11:17:19.413983+0000","last_fullsized":"2024-05-07T11:17:19.412423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":86,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"63'136","reported_seq":277,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.398879+0000","last_change":"2024-05-07T11:17:23.398879+0000","last_active":"2024-05-07T11:17:23.398879+0000","last_peered":"2024-05-07T11:17:23.398879+0000","last_clean":"2024-05-07T11:17:23.398879+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:23.398879+0000","last_undegraded":"2024-05-07T11:17:23.398879+0000","last_fullsized":"2024-05-07T11:17:23.398879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:33:07.091905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'175","reported_seq":313,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394552+0000","last_change":"2024-05-07T11:17:19.436711+0000","last_active":"2024-05-07T11:17:23.394552+0000","last_peered":"2024-05-07T11:17:23.394552+0000","last_clean":"2024-05-07T11:14:24.470554+0000","last_became_active":"2024-05-07T11:17:19.431229+0000","last_became_peered":"2024-05-07T11:17:19.431229+0000","last_unstale":"2024-05-07T11:17:23.394552+0000","last_undegraded":"2024-05-07T11:17:19.399847+0000","last_fullsized":"2024-05-07T11:17:19.397290+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":516,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.399194+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:23.399194+0000","last_peered":"2024-05-07T11:17:23.399194+0000","last_clean":"2024-05-07T11:17:23.399194+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:23.399194+0000","last_undegraded":"2024-05-07T11:17:23.399194+0000","last_fullsized":"2024-05-07T11:17:23.399194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:30:48.688430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":253,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394035+0000","last_change":"2024-05-07T11:17:22.420019+0000","last_active":"2024-05-07T11:17:23.394035+0000","last_peered":"2024-05-07T11:17:23.394035+0000","last_clean":"2024-05-07T11:14:24.378895+0000","last_became_active":"2024-05-07T11:17:22.418850+0000","last_became_peered":"2024-05-07T11:17:22.418850+0000","last_unstale":"2024-05-07T11:17:23.394035+0000","last_undegraded":"2024-05-07T11:17:22.412415+0000","last_fullsized":"2024-05-07T11:17:22.412148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":113,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'161","reported_seq":501,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397856+0000","last_change":"2024-05-07T11:17:22.416613+0000","last_active":"2024-05-07T11:17:23.397856+0000","last_peered":"2024-05-07T11:17:23.397856+0000","last_clean":"2024-05-07T11:17:23.397856+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:23.397856+0000","last_undegraded":"2024-05-07T11:17:23.397856+0000","last_fullsized":"2024-05-07T11:17:23.397856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"63'148","reported_seq":288,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394464+0000","last_change":"2024-05-07T11:17:21.418472+0000","last_active":"2024-05-07T11:17:23.394464+0000","last_peered":"2024-05-07T11:17:23.394464+0000","last_clean":"2024-05-07T11:17:23.394464+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:23.394464+0000","last_undegraded":"2024-05-07T11:17:23.394464+0000","last_fullsized":"2024-05-07T11:17:23.394464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:18.184681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'147","reported_seq":223,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397397+0000","last_change":"2024-05-07T11:17:21.418164+0000","last_active":"2024-05-07T11:17:23.397397+0000","last_peered":"2024-05-07T11:17:23.397397+0000","last_clean":"2024-05-07T11:17:23.397397+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:23.397397+0000","last_undegraded":"2024-05-07T11:17:23.397397+0000","last_fullsized":"2024-05-07T11:17:23.397397+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":328,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.396746+0000","last_change":"2024-05-07T11:17:19.439196+0000","last_active":"2024-05-07T11:17:23.396746+0000","last_peered":"2024-05-07T11:17:23.396746+0000","last_clean":"2024-05-07T11:14:24.396282+0000","last_became_active":"2024-05-07T11:17:19.437184+0000","last_became_peered":"2024-05-07T11:17:19.437184+0000","last_unstale":"2024-05-07T11:17:23.396746+0000","last_undegraded":"2024-05-07T11:17:19.422229+0000","last_fullsized":"2024-05-07T11:17:19.419110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":112,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":291,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393973+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:23.393973+0000","last_peered":"2024-05-07T11:17:23.393973+0000","last_clean":"2024-05-07T11:17:23.393973+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:23.393973+0000","last_undegraded":"2024-05-07T11:17:23.393973+0000","last_fullsized":"2024-05-07T11:17:23.393973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":304,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393647+0000","last_change":"2024-05-07T11:17:19.439396+0000","last_active":"2024-05-07T11:17:23.393647+0000","last_peered":"2024-05-07T11:17:23.393647+0000","last_clean":"2024-05-07T11:14:24.332238+0000","last_became_active":"2024-05-07T11:17:19.434809+0000","last_became_peered":"2024-05-07T11:17:19.434809+0000","last_unstale":"2024-05-07T11:17:23.393647+0000","last_undegraded":"2024-05-07T11:17:19.410512+0000","last_fullsized":"2024-05-07T11:17:19.407581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":101,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":7}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"63'159","reported_seq":233,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396783+0000","last_change":"2024-05-07T11:17:21.418519+0000","last_active":"2024-05-07T11:17:23.396783+0000","last_peered":"2024-05-07T11:17:23.396783+0000","last_clean":"2024-05-07T11:17:23.396783+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:23.396783+0000","last_undegraded":"2024-05-07T11:17:23.396783+0000","last_fullsized":"2024-05-07T11:17:23.396783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"63'169","reported_seq":309,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393668+0000","last_change":"2024-05-07T11:17:21.414896+0000","last_active":"2024-05-07T11:17:23.393668+0000","last_peered":"2024-05-07T11:17:23.393668+0000","last_clean":"2024-05-07T11:17:23.393668+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:23.393668+0000","last_undegraded":"2024-05-07T11:17:23.393668+0000","last_fullsized":"2024-05-07T11:17:23.393668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:52.242314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":282,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.394634+0000","last_change":"2024-05-07T11:17:23.394634+0000","last_active":"2024-05-07T11:17:18.396063+0000","last_peered":"2024-05-07T11:17:17.243932+0000","last_clean":"2024-05-07T11:14:24.475528+0000","last_became_active":"2024-05-07T11:14:25.512804+0000","last_became_peered":"2024-05-07T11:14:25.512804+0000","last_unstale":"2024-05-07T11:17:23.394634+0000","last_undegraded":"2024-05-07T11:17:23.394634+0000","last_fullsized":"2024-05-07T11:17:23.394634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'195","reported_seq":331,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397769+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:17:23.397769+0000","last_peered":"2024-05-07T11:17:23.397769+0000","last_clean":"2024-05-07T11:17:23.397769+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:23.397769+0000","last_undegraded":"2024-05-07T11:17:23.397769+0000","last_fullsized":"2024-05-07T11:17:23.397769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":273,"reported_epoch":76,"state":"active+recovery_wait+degraded","last_fresh":"2024-05-07T11:17:23.403662+0000","last_change":"2024-05-07T11:17:23.403843+0000","last_active":"2024-05-07T11:17:23.403662+0000","last_peered":"2024-05-07T11:17:23.403662+0000","last_clean":"2024-05-07T11:14:24.294325+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:23.403662+0000","last_undegraded":"2024-05-07T11:17:23.394924+0000","last_fullsized":"2024-05-07T11:17:23.403662+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":91,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":286,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.396379+0000","last_change":"2024-05-07T11:17:19.438982+0000","last_active":"2024-05-07T11:17:23.396379+0000","last_peered":"2024-05-07T11:17:23.396379+0000","last_clean":"2024-05-07T11:14:24.430825+0000","last_became_active":"2024-05-07T11:17:19.436245+0000","last_became_peered":"2024-05-07T11:17:19.436245+0000","last_unstale":"2024-05-07T11:17:23.396379+0000","last_undegraded":"2024-05-07T11:17:19.417373+0000","last_fullsized":"2024-05-07T11:17:19.414331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":91,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":227,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.116134+0000","last_change":"2024-05-07T11:17:24.181998+0000","last_active":"2024-05-07T11:17:24.181998+0000","last_peered":"2024-05-07T11:17:23.116134+0000","last_clean":"2024-05-07T11:14:24.443460+0000","last_became_active":"2024-05-07T11:17:19.431780+0000","last_became_peered":"2024-05-07T11:17:19.431780+0000","last_unstale":"2024-05-07T11:17:23.116134+0000","last_undegraded":"2024-05-07T11:17:23.116134+0000","last_fullsized":"2024-05-07T11:17:19.408755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":324,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394264+0000","last_change":"2024-05-07T11:17:19.439496+0000","last_active":"2024-05-07T11:17:23.394264+0000","last_peered":"2024-05-07T11:17:23.394264+0000","last_clean":"2024-05-07T11:14:24.440580+0000","last_became_active":"2024-05-07T11:17:19.435641+0000","last_became_peered":"2024-05-07T11:17:19.435641+0000","last_unstale":"2024-05-07T11:17:23.394264+0000","last_undegraded":"2024-05-07T11:17:19.416557+0000","last_fullsized":"2024-05-07T11:17:19.412853+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":114,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"63'192","reported_seq":572,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396991+0000","last_change":"2024-05-07T11:17:22.416120+0000","last_active":"2024-05-07T11:17:23.396991+0000","last_peered":"2024-05-07T11:17:23.396991+0000","last_clean":"2024-05-07T11:17:23.396991+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:23.396991+0000","last_undegraded":"2024-05-07T11:17:23.396991+0000","last_fullsized":"2024-05-07T11:17:23.396991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:13.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"63'185","reported_seq":328,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394584+0000","last_change":"2024-05-07T11:17:19.438939+0000","last_active":"2024-05-07T11:17:23.394584+0000","last_peered":"2024-05-07T11:17:23.394584+0000","last_clean":"2024-05-07T11:14:24.357156+0000","last_became_active":"2024-05-07T11:17:19.437340+0000","last_became_peered":"2024-05-07T11:17:19.437340+0000","last_unstale":"2024-05-07T11:17:23.394584+0000","last_undegraded":"2024-05-07T11:17:19.420606+0000","last_fullsized":"2024-05-07T11:17:19.414996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":49}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'156","reported_seq":299,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393912+0000","last_change":"2024-05-07T11:17:22.416165+0000","last_active":"2024-05-07T11:17:23.393912+0000","last_peered":"2024-05-07T11:17:23.393912+0000","last_clean":"2024-05-07T11:17:23.393912+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:23.393912+0000","last_undegraded":"2024-05-07T11:17:23.393912+0000","last_fullsized":"2024-05-07T11:17:23.393912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:57.237765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":262,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395342+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:23.395342+0000","last_peered":"2024-05-07T11:17:23.395342+0000","last_clean":"2024-05-07T11:17:23.395342+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:23.395342+0000","last_undegraded":"2024-05-07T11:17:23.395342+0000","last_fullsized":"2024-05-07T11:17:23.395342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"63'141","reported_seq":281,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394291+0000","last_change":"2024-05-07T11:17:21.419206+0000","last_active":"2024-05-07T11:17:23.394291+0000","last_peered":"2024-05-07T11:17:23.394291+0000","last_clean":"2024-05-07T11:17:23.394291+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:23.394291+0000","last_undegraded":"2024-05-07T11:17:23.394291+0000","last_fullsized":"2024-05-07T11:17:23.394291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:12.679336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397177+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:23.397177+0000","last_peered":"2024-05-07T11:17:23.397177+0000","last_clean":"2024-05-07T11:17:23.397177+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:23.397177+0000","last_undegraded":"2024-05-07T11:17:23.397177+0000","last_fullsized":"2024-05-07T11:17:23.397177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.025763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"63'179","reported_seq":253,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397532+0000","last_change":"2024-05-07T11:17:21.419284+0000","last_active":"2024-05-07T11:17:23.397532+0000","last_peered":"2024-05-07T11:17:23.397532+0000","last_clean":"2024-05-07T11:17:23.397532+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:23.397532+0000","last_undegraded":"2024-05-07T11:17:23.397532+0000","last_fullsized":"2024-05-07T11:17:23.397532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:54.463898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393647+0000","last_change":"2024-05-07T11:17:18.423604+0000","last_active":"2024-05-07T11:17:23.393647+0000","last_peered":"2024-05-07T11:17:23.393647+0000","last_clean":"2024-05-07T11:17:23.393647+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:23.393647+0000","last_undegraded":"2024-05-07T11:17:23.393647+0000","last_fullsized":"2024-05-07T11:17:23.393647+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:45:28.650148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":230,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.401355+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:23.401355+0000","last_peered":"2024-05-07T11:17:23.401355+0000","last_clean":"2024-05-07T11:17:23.401355+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:23.401355+0000","last_undegraded":"2024-05-07T11:17:23.401355+0000","last_fullsized":"2024-05-07T11:17:23.401355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":151,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395256+0000","last_change":"2024-05-07T11:17:18.433027+0000","last_active":"2024-05-07T11:17:23.395256+0000","last_peered":"2024-05-07T11:17:23.395256+0000","last_clean":"2024-05-07T11:17:23.395256+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:23.395256+0000","last_undegraded":"2024-05-07T11:17:23.395256+0000","last_fullsized":"2024-05-07T11:17:23.395256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:47.068504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":146,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397627+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:23.397627+0000","last_peered":"2024-05-07T11:17:23.397627+0000","last_clean":"2024-05-07T11:17:23.397627+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:23.397627+0000","last_undegraded":"2024-05-07T11:17:23.397627+0000","last_fullsized":"2024-05-07T11:17:23.397627+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:35:51.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'155","reported_seq":224,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393522+0000","last_change":"2024-05-07T11:17:19.437866+0000","last_active":"2024-05-07T11:17:23.393522+0000","last_peered":"2024-05-07T11:17:23.393522+0000","last_clean":"2024-05-07T11:14:24.400453+0000","last_became_active":"2024-05-07T11:17:19.433702+0000","last_became_peered":"2024-05-07T11:17:19.433702+0000","last_unstale":"2024-05-07T11:17:23.393522+0000","last_undegraded":"2024-05-07T11:17:19.404990+0000","last_fullsized":"2024-05-07T11:17:19.399778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":95,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394209+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:23.394209+0000","last_peered":"2024-05-07T11:17:23.394209+0000","last_clean":"2024-05-07T11:17:23.394209+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:23.394209+0000","last_undegraded":"2024-05-07T11:17:23.394209+0000","last_fullsized":"2024-05-07T11:17:23.394209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:16.479879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'167","reported_seq":307,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393522+0000","last_change":"2024-05-07T11:17:21.418782+0000","last_active":"2024-05-07T11:17:23.393522+0000","last_peered":"2024-05-07T11:17:23.393522+0000","last_clean":"2024-05-07T11:17:23.393522+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:23.393522+0000","last_undegraded":"2024-05-07T11:17:23.393522+0000","last_fullsized":"2024-05-07T11:17:23.393522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:13.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396832+0000","last_change":"2024-05-07T11:17:22.419069+0000","last_active":"2024-05-07T11:17:23.396832+0000","last_peered":"2024-05-07T11:17:23.396832+0000","last_clean":"2024-05-07T11:17:23.396832+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:23.396832+0000","last_undegraded":"2024-05-07T11:17:23.396832+0000","last_fullsized":"2024-05-07T11:17:23.396832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:20.890067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":302,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394613+0000","last_change":"2024-05-07T11:17:19.439572+0000","last_active":"2024-05-07T11:17:23.394613+0000","last_peered":"2024-05-07T11:17:23.394613+0000","last_clean":"2024-05-07T11:14:24.352569+0000","last_became_active":"2024-05-07T11:17:19.437369+0000","last_became_peered":"2024-05-07T11:17:19.437369+0000","last_unstale":"2024-05-07T11:17:23.394613+0000","last_undegraded":"2024-05-07T11:17:19.420446+0000","last_fullsized":"2024-05-07T11:17:19.417984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397543+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:23.397543+0000","last_peered":"2024-05-07T11:17:23.397543+0000","last_clean":"2024-05-07T11:17:23.397543+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:23.397543+0000","last_undegraded":"2024-05-07T11:17:23.397543+0000","last_fullsized":"2024-05-07T11:17:23.397543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:31:28.580245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"63'164","reported_seq":300,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397425+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:17:23.397425+0000","last_peered":"2024-05-07T11:17:23.397425+0000","last_clean":"2024-05-07T11:17:23.397425+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:23.397425+0000","last_undegraded":"2024-05-07T11:17:23.397425+0000","last_fullsized":"2024-05-07T11:17:23.397425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397475+0000","last_change":"2024-05-07T11:17:18.450923+0000","last_active":"2024-05-07T11:17:23.397475+0000","last_peered":"2024-05-07T11:17:23.397475+0000","last_clean":"2024-05-07T11:17:23.397475+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:23.397475+0000","last_undegraded":"2024-05-07T11:17:23.397475+0000","last_fullsized":"2024-05-07T11:17:23.397475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:38.864461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"63'172","reported_seq":315,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.396868+0000","last_change":"2024-05-07T11:17:19.439191+0000","last_active":"2024-05-07T11:17:23.396868+0000","last_peered":"2024-05-07T11:17:23.396868+0000","last_clean":"2024-05-07T11:14:24.436962+0000","last_became_active":"2024-05-07T11:17:19.438026+0000","last_became_peered":"2024-05-07T11:17:19.438026+0000","last_unstale":"2024-05-07T11:17:23.396868+0000","last_undegraded":"2024-05-07T11:17:19.423429+0000","last_fullsized":"2024-05-07T11:17:19.419186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":112,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395161+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:23.395161+0000","last_peered":"2024-05-07T11:17:23.395161+0000","last_clean":"2024-05-07T11:17:23.395161+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:23.395161+0000","last_undegraded":"2024-05-07T11:17:23.395161+0000","last_fullsized":"2024-05-07T11:17:23.395161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"63'163","reported_seq":302,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.395431+0000","last_change":"2024-05-07T11:17:19.437566+0000","last_active":"2024-05-07T11:17:23.395431+0000","last_peered":"2024-05-07T11:17:23.395431+0000","last_clean":"2024-05-07T11:14:24.493593+0000","last_became_active":"2024-05-07T11:17:19.436403+0000","last_became_peered":"2024-05-07T11:17:19.436403+0000","last_unstale":"2024-05-07T11:17:23.395431+0000","last_undegraded":"2024-05-07T11:17:19.420310+0000","last_fullsized":"2024-05-07T11:17:19.416685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":98,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":5}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393494+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:23.393494+0000","last_peered":"2024-05-07T11:17:23.393494+0000","last_clean":"2024-05-07T11:17:23.393494+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:23.393494+0000","last_undegraded":"2024-05-07T11:17:23.393494+0000","last_fullsized":"2024-05-07T11:17:23.393494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:47.689436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'137","reported_seq":453,"reported_epoch":75,"state":"peering","last_fresh":"2024-05-07T11:17:22.518029+0000","last_change":"2024-05-07T11:17:23.394952+0000","last_active":"2024-05-07T11:17:23.394952+0000","last_peered":"2024-05-07T11:17:22.518029+0000","last_clean":"2024-05-07T11:14:24.395523+0000","last_became_active":"2024-05-07T11:17:19.432130+0000","last_became_peered":"2024-05-07T11:17:19.432130+0000","last_unstale":"2024-05-07T11:17:22.518029+0000","last_undegraded":"2024-05-07T11:17:22.518029+0000","last_fullsized":"2024-05-07T11:17:19.415262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393850+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:23.393850+0000","last_peered":"2024-05-07T11:17:23.393850+0000","last_clean":"2024-05-07T11:17:23.393850+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:23.393850+0000","last_undegraded":"2024-05-07T11:17:23.393850+0000","last_fullsized":"2024-05-07T11:17:23.393850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:59.411938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'141","reported_seq":461,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397799+0000","last_change":"2024-05-07T11:17:22.417126+0000","last_active":"2024-05-07T11:17:23.397799+0000","last_peered":"2024-05-07T11:17:23.397799+0000","last_clean":"2024-05-07T11:17:23.397799+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:23.397799+0000","last_undegraded":"2024-05-07T11:17:23.397799+0000","last_fullsized":"2024-05-07T11:17:23.397799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":345,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395388+0000","last_change":"2024-05-07T11:17:18.433863+0000","last_active":"2024-05-07T11:17:23.395388+0000","last_peered":"2024-05-07T11:17:23.395388+0000","last_clean":"2024-05-07T11:17:23.395388+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:23.395388+0000","last_undegraded":"2024-05-07T11:17:23.395388+0000","last_fullsized":"2024-05-07T11:17:23.395388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:10.515455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":154,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395912+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:23.395912+0000","last_peered":"2024-05-07T11:17:23.395912+0000","last_clean":"2024-05-07T11:17:23.395912+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:23.395912+0000","last_undegraded":"2024-05-07T11:17:23.395912+0000","last_fullsized":"2024-05-07T11:17:23.395912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:03:02.539869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397079+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:23.397079+0000","last_peered":"2024-05-07T11:17:23.397079+0000","last_clean":"2024-05-07T11:17:23.397079+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:23.397079+0000","last_undegraded":"2024-05-07T11:17:23.397079+0000","last_fullsized":"2024-05-07T11:17:23.397079+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":268,"reported_epoch":76,"state":"active+recovery_wait+degraded","last_fresh":"2024-05-07T11:17:23.403359+0000","last_change":"2024-05-07T11:17:23.403839+0000","last_active":"2024-05-07T11:17:23.403359+0000","last_peered":"2024-05-07T11:17:23.403359+0000","last_clean":"2024-05-07T11:14:24.305202+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:23.403359+0000","last_undegraded":"2024-05-07T11:17:23.396611+0000","last_fullsized":"2024-05-07T11:17:23.403359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":52}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395307+0000","last_change":"2024-05-07T11:17:18.433452+0000","last_active":"2024-05-07T11:17:23.395307+0000","last_peered":"2024-05-07T11:17:23.395307+0000","last_clean":"2024-05-07T11:17:23.395307+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:23.395307+0000","last_undegraded":"2024-05-07T11:17:23.395307+0000","last_fullsized":"2024-05-07T11:17:23.395307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:26.663080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":206,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397102+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:17:23.397102+0000","last_peered":"2024-05-07T11:17:23.397102+0000","last_clean":"2024-05-07T11:17:23.397102+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:23.397102+0000","last_undegraded":"2024-05-07T11:17:23.397102+0000","last_fullsized":"2024-05-07T11:17:23.397102+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"63'160","reported_seq":293,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.394449+0000","last_change":"2024-05-07T11:17:23.394449+0000","last_active":"2024-05-07T11:17:18.396148+0000","last_peered":"2024-05-07T11:17:17.243626+0000","last_clean":"2024-05-07T11:14:24.444615+0000","last_became_active":"2024-05-07T11:14:25.509161+0000","last_became_peered":"2024-05-07T11:14:25.509161+0000","last_unstale":"2024-05-07T11:17:23.394449+0000","last_undegraded":"2024-05-07T11:17:23.394449+0000","last_fullsized":"2024-05-07T11:17:23.394449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397216+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:23.397216+0000","last_peered":"2024-05-07T11:17:23.397216+0000","last_clean":"2024-05-07T11:17:23.397216+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:23.397216+0000","last_undegraded":"2024-05-07T11:17:23.397216+0000","last_fullsized":"2024-05-07T11:17:23.397216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:20.744525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393493+0000","last_change":"2024-05-07T11:17:18.572639+0000","last_active":"2024-05-07T11:17:23.393493+0000","last_peered":"2024-05-07T11:17:23.393493+0000","last_clean":"2024-05-07T11:17:23.393493+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:23.393493+0000","last_undegraded":"2024-05-07T11:17:23.393493+0000","last_fullsized":"2024-05-07T11:17:23.393493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:15.538158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":244,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394418+0000","last_change":"2024-05-07T11:17:19.436365+0000","last_active":"2024-05-07T11:17:23.394418+0000","last_peered":"2024-05-07T11:17:23.394418+0000","last_clean":"2024-05-07T11:14:24.445283+0000","last_became_active":"2024-05-07T11:17:19.432372+0000","last_became_peered":"2024-05-07T11:17:19.432372+0000","last_unstale":"2024-05-07T11:17:23.394418+0000","last_undegraded":"2024-05-07T11:17:19.409832+0000","last_fullsized":"2024-05-07T11:17:19.399925+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":109,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":6},{"shards":"2","objects":50}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395254+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:23.395254+0000","last_peered":"2024-05-07T11:17:23.395254+0000","last_clean":"2024-05-07T11:17:23.395254+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:23.395254+0000","last_undegraded":"2024-05-07T11:17:23.395254+0000","last_fullsized":"2024-05-07T11:17:23.395254+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":148,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395811+0000","last_change":"2024-05-07T11:17:18.404539+0000","last_active":"2024-05-07T11:17:23.395811+0000","last_peered":"2024-05-07T11:17:23.395811+0000","last_clean":"2024-05-07T11:17:23.395811+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:23.395811+0000","last_undegraded":"2024-05-07T11:17:23.395811+0000","last_fullsized":"2024-05-07T11:17:23.395811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:50.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":398,"reported_epoch":76,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:24.181331+0000","last_change":"2024-05-07T11:17:24.052450+0000","last_active":"2024-05-07T11:17:24.181331+0000","last_peered":"2024-05-07T11:17:24.181331+0000","last_clean":"2024-05-07T11:14:24.363205+0000","last_became_active":"2024-05-07T11:17:19.429221+0000","last_became_peered":"2024-05-07T11:17:19.429221+0000","last_unstale":"2024-05-07T11:17:24.181331+0000","last_undegraded":"2024-05-07T11:17:19.417937+0000","last_fullsized":"2024-05-07T11:17:19.407481+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":11,"num_objects_misplaced":15,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":143021,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":46}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396935+0000","last_change":"2024-05-07T11:17:22.424750+0000","last_active":"2024-05-07T11:17:23.396935+0000","last_peered":"2024-05-07T11:17:23.396935+0000","last_clean":"2024-05-07T11:17:23.396935+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:23.396935+0000","last_undegraded":"2024-05-07T11:17:23.396935+0000","last_fullsized":"2024-05-07T11:17:23.396935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:12.283160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397838+0000","last_change":"2024-05-07T11:17:18.433137+0000","last_active":"2024-05-07T11:17:23.397838+0000","last_peered":"2024-05-07T11:17:23.397838+0000","last_clean":"2024-05-07T11:17:23.397838+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:23.397838+0000","last_undegraded":"2024-05-07T11:17:23.397838+0000","last_fullsized":"2024-05-07T11:17:23.397838+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:40.770823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":297,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393947+0000","last_change":"2024-05-07T11:17:19.439272+0000","last_active":"2024-05-07T11:17:23.393947+0000","last_peered":"2024-05-07T11:17:23.393947+0000","last_clean":"2024-05-07T11:14:24.425940+0000","last_became_active":"2024-05-07T11:17:19.434379+0000","last_became_peered":"2024-05-07T11:17:19.434379+0000","last_unstale":"2024-05-07T11:17:23.393947+0000","last_undegraded":"2024-05-07T11:17:19.403485+0000","last_fullsized":"2024-05-07T11:17:19.397696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397705+0000","last_change":"2024-05-07T11:17:18.431763+0000","last_active":"2024-05-07T11:17:23.397705+0000","last_peered":"2024-05-07T11:17:23.397705+0000","last_clean":"2024-05-07T11:17:23.397705+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:23.397705+0000","last_undegraded":"2024-05-07T11:17:23.397705+0000","last_fullsized":"2024-05-07T11:17:23.397705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:38.234395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394551+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:23.394551+0000","last_peered":"2024-05-07T11:17:23.394551+0000","last_clean":"2024-05-07T11:17:23.394551+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:23.394551+0000","last_undegraded":"2024-05-07T11:17:23.394551+0000","last_fullsized":"2024-05-07T11:17:23.394551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:54.609817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'181","reported_seq":317,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.399296+0000","last_change":"2024-05-07T11:17:23.399296+0000","last_active":"2024-05-07T11:17:23.399296+0000","last_peered":"2024-05-07T11:17:23.399296+0000","last_clean":"2024-05-07T11:17:23.399296+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:23.399296+0000","last_undegraded":"2024-05-07T11:17:23.399296+0000","last_fullsized":"2024-05-07T11:17:23.399296+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:21.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":86,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395081+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:23.395081+0000","last_peered":"2024-05-07T11:17:23.395081+0000","last_clean":"2024-05-07T11:17:23.395081+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:23.395081+0000","last_undegraded":"2024-05-07T11:17:23.395081+0000","last_fullsized":"2024-05-07T11:17:23.395081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:03.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397671+0000","last_change":"2024-05-07T11:17:18.432358+0000","last_active":"2024-05-07T11:17:23.397671+0000","last_peered":"2024-05-07T11:17:23.397671+0000","last_clean":"2024-05-07T11:17:23.397671+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:23.397671+0000","last_undegraded":"2024-05-07T11:17:23.397671+0000","last_fullsized":"2024-05-07T11:17:23.397671+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:36.281521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"63'175","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393858+0000","last_change":"2024-05-07T11:17:22.420080+0000","last_active":"2024-05-07T11:17:23.393858+0000","last_peered":"2024-05-07T11:17:23.393858+0000","last_clean":"2024-05-07T11:17:23.393858+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:23.393858+0000","last_undegraded":"2024-05-07T11:17:23.393858+0000","last_fullsized":"2024-05-07T11:17:23.393858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:41.233935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'38","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397563+0000","last_change":"2024-05-07T11:17:18.459674+0000","last_active":"2024-05-07T11:17:23.397563+0000","last_peered":"2024-05-07T11:17:23.397563+0000","last_clean":"2024-05-07T11:17:23.397563+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:23.397563+0000","last_undegraded":"2024-05-07T11:17:23.397563+0000","last_fullsized":"2024-05-07T11:17:23.397563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:35.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":149,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397844+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:23.397844+0000","last_peered":"2024-05-07T11:17:23.397844+0000","last_clean":"2024-05-07T11:17:23.397844+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:23.397844+0000","last_undegraded":"2024-05-07T11:17:23.397844+0000","last_fullsized":"2024-05-07T11:17:23.397844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:14.650941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'138","reported_seq":276,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393764+0000","last_change":"2024-05-07T11:17:22.417629+0000","last_active":"2024-05-07T11:17:23.393764+0000","last_peered":"2024-05-07T11:17:23.393764+0000","last_clean":"2024-05-07T11:17:23.393764+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:23.393764+0000","last_undegraded":"2024-05-07T11:17:23.393764+0000","last_fullsized":"2024-05-07T11:17:23.393764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:58.760049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'164","reported_seq":495,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.400613+0000","last_change":"2024-05-07T11:17:23.400613+0000","last_active":"2024-05-07T11:17:23.400613+0000","last_peered":"2024-05-07T11:17:23.400613+0000","last_clean":"2024-05-07T11:17:23.400613+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:23.400613+0000","last_undegraded":"2024-05-07T11:17:23.400613+0000","last_fullsized":"2024-05-07T11:17:23.400613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:28.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":193,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397519+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:23.397519+0000","last_peered":"2024-05-07T11:17:23.397519+0000","last_clean":"2024-05-07T11:17:23.397519+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:23.397519+0000","last_undegraded":"2024-05-07T11:17:23.397519+0000","last_fullsized":"2024-05-07T11:17:23.397519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:35.832524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":498,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:23.626703+0000","last_change":"2024-05-07T11:17:23.626897+0000","last_active":"2024-05-07T11:17:23.626703+0000","last_peered":"2024-05-07T11:17:23.626703+0000","last_clean":"2024-05-07T11:14:24.380609+0000","last_became_active":"2024-05-07T11:17:19.432285+0000","last_became_peered":"2024-05-07T11:17:19.432285+0000","last_unstale":"2024-05-07T11:17:23.626703+0000","last_undegraded":"2024-05-07T11:17:23.626703+0000","last_fullsized":"2024-05-07T11:17:19.405108+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":52}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393959+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:23.393959+0000","last_peered":"2024-05-07T11:17:23.393959+0000","last_clean":"2024-05-07T11:17:23.393959+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:23.393959+0000","last_undegraded":"2024-05-07T11:17:23.393959+0000","last_fullsized":"2024-05-07T11:17:23.393959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:46.092532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395657+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:23.395657+0000","last_peered":"2024-05-07T11:17:23.395657+0000","last_clean":"2024-05-07T11:17:23.395657+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:23.395657+0000","last_undegraded":"2024-05-07T11:17:23.395657+0000","last_fullsized":"2024-05-07T11:17:23.395657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.076287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"63'172","reported_seq":247,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396881+0000","last_change":"2024-05-07T11:17:21.419673+0000","last_active":"2024-05-07T11:17:23.396881+0000","last_peered":"2024-05-07T11:17:23.396881+0000","last_clean":"2024-05-07T11:17:23.396881+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:23.396881+0000","last_undegraded":"2024-05-07T11:17:23.396881+0000","last_fullsized":"2024-05-07T11:17:23.396881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:01.519110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397476+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:23.397476+0000","last_peered":"2024-05-07T11:17:23.397476+0000","last_clean":"2024-05-07T11:17:23.397476+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:23.397476+0000","last_undegraded":"2024-05-07T11:17:23.397476+0000","last_fullsized":"2024-05-07T11:17:23.397476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:45.698283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":231,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393507+0000","last_change":"2024-05-07T11:17:19.438036+0000","last_active":"2024-05-07T11:17:23.393507+0000","last_peered":"2024-05-07T11:17:23.393507+0000","last_clean":"2024-05-07T11:14:24.381417+0000","last_became_active":"2024-05-07T11:17:19.436774+0000","last_became_peered":"2024-05-07T11:17:19.436774+0000","last_unstale":"2024-05-07T11:17:23.393507+0000","last_undegraded":"2024-05-07T11:17:19.412827+0000","last_fullsized":"2024-05-07T11:17:19.397337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":100,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":45}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":314,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.395790+0000","last_change":"2024-05-07T11:17:19.437422+0000","last_active":"2024-05-07T11:17:23.395790+0000","last_peered":"2024-05-07T11:17:23.395790+0000","last_clean":"2024-05-07T11:14:24.468775+0000","last_became_active":"2024-05-07T11:17:19.432546+0000","last_became_peered":"2024-05-07T11:17:19.432546+0000","last_unstale":"2024-05-07T11:17:23.395790+0000","last_undegraded":"2024-05-07T11:17:19.406490+0000","last_fullsized":"2024-05-07T11:17:19.403425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396766+0000","last_change":"2024-05-07T11:17:18.431271+0000","last_active":"2024-05-07T11:17:23.396766+0000","last_peered":"2024-05-07T11:17:23.396766+0000","last_clean":"2024-05-07T11:17:23.396766+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:23.396766+0000","last_undegraded":"2024-05-07T11:17:23.396766+0000","last_fullsized":"2024-05-07T11:17:23.396766+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":421,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:24.051589+0000","last_change":"2024-05-07T11:17:24.051740+0000","last_active":"2024-05-07T11:17:24.051589+0000","last_peered":"2024-05-07T11:17:24.051589+0000","last_clean":"2024-05-07T11:14:24.298846+0000","last_became_active":"2024-05-07T11:17:19.434163+0000","last_became_peered":"2024-05-07T11:17:19.434163+0000","last_unstale":"2024-05-07T11:17:24.051589+0000","last_undegraded":"2024-05-07T11:17:19.419458+0000","last_fullsized":"2024-05-07T11:17:19.416477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396990+0000","last_change":"2024-05-07T11:17:18.402834+0000","last_active":"2024-05-07T11:17:23.396990+0000","last_peered":"2024-05-07T11:17:23.396990+0000","last_clean":"2024-05-07T11:17:23.396990+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:23.396990+0000","last_undegraded":"2024-05-07T11:17:23.396990+0000","last_fullsized":"2024-05-07T11:17:23.396990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"63'205","reported_seq":343,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394003+0000","last_change":"2024-05-07T11:17:22.421343+0000","last_active":"2024-05-07T11:17:23.394003+0000","last_peered":"2024-05-07T11:17:23.394003+0000","last_clean":"2024-05-07T11:17:23.394003+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:23.394003+0000","last_undegraded":"2024-05-07T11:17:23.394003+0000","last_fullsized":"2024-05-07T11:17:23.394003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:24.076915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393769+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:23.393769+0000","last_peered":"2024-05-07T11:17:23.393769+0000","last_clean":"2024-05-07T11:17:23.393769+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:23.393769+0000","last_undegraded":"2024-05-07T11:17:23.393769+0000","last_fullsized":"2024-05-07T11:17:23.393769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:53.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'163","reported_seq":296,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.394970+0000","last_change":"2024-05-07T11:17:23.394970+0000","last_active":"2024-05-07T11:17:18.395583+0000","last_peered":"2024-05-07T11:17:17.242817+0000","last_clean":"2024-05-07T11:14:24.449814+0000","last_became_active":"2024-05-07T11:14:25.512203+0000","last_became_peered":"2024-05-07T11:14:25.512203+0000","last_unstale":"2024-05-07T11:17:23.394970+0000","last_undegraded":"2024-05-07T11:17:23.394970+0000","last_fullsized":"2024-05-07T11:17:23.394970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394133+0000","last_change":"2024-05-07T11:17:18.555160+0000","last_active":"2024-05-07T11:17:23.394133+0000","last_peered":"2024-05-07T11:17:23.394133+0000","last_clean":"2024-05-07T11:17:23.394133+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:23.394133+0000","last_undegraded":"2024-05-07T11:17:23.394133+0000","last_fullsized":"2024-05-07T11:17:23.394133+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:37.962741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'166","reported_seq":519,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393837+0000","last_change":"2024-05-07T11:17:21.418540+0000","last_active":"2024-05-07T11:17:23.393837+0000","last_peered":"2024-05-07T11:17:23.393837+0000","last_clean":"2024-05-07T11:17:23.393837+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:23.393837+0000","last_undegraded":"2024-05-07T11:17:23.393837+0000","last_fullsized":"2024-05-07T11:17:23.393837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:16.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":157,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397184+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:23.397184+0000","last_peered":"2024-05-07T11:17:23.397184+0000","last_clean":"2024-05-07T11:17:23.397184+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:23.397184+0000","last_undegraded":"2024-05-07T11:17:23.397184+0000","last_fullsized":"2024-05-07T11:17:23.397184+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:17.953399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":300,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394831+0000","last_change":"2024-05-07T11:17:19.440247+0000","last_active":"2024-05-07T11:17:23.394831+0000","last_peered":"2024-05-07T11:17:23.394831+0000","last_clean":"2024-05-07T11:14:24.442642+0000","last_became_active":"2024-05-07T11:17:19.439763+0000","last_became_peered":"2024-05-07T11:17:19.439763+0000","last_unstale":"2024-05-07T11:17:23.394831+0000","last_undegraded":"2024-05-07T11:17:19.422552+0000","last_fullsized":"2024-05-07T11:17:19.420828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":6},{"shards":"2","objects":51}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394116+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:23.394116+0000","last_peered":"2024-05-07T11:17:23.394116+0000","last_clean":"2024-05-07T11:17:23.394116+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:23.394116+0000","last_undegraded":"2024-05-07T11:17:23.394116+0000","last_fullsized":"2024-05-07T11:17:23.394116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:24.011380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'169","reported_seq":307,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393646+0000","last_change":"2024-05-07T11:17:22.416150+0000","last_active":"2024-05-07T11:17:23.393646+0000","last_peered":"2024-05-07T11:17:23.393646+0000","last_clean":"2024-05-07T11:17:23.393646+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:23.393646+0000","last_undegraded":"2024-05-07T11:17:23.393646+0000","last_fullsized":"2024-05-07T11:17:23.393646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:28.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397795+0000","last_change":"2024-05-07T11:17:18.504321+0000","last_active":"2024-05-07T11:17:23.397795+0000","last_peered":"2024-05-07T11:17:23.397795+0000","last_clean":"2024-05-07T11:17:23.397795+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:23.397795+0000","last_undegraded":"2024-05-07T11:17:23.397795+0000","last_fullsized":"2024-05-07T11:17:23.397795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"63'199","reported_seq":595,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:23.874613+0000","last_change":"2024-05-07T11:17:23.874777+0000","last_active":"2024-05-07T11:17:23.874613+0000","last_peered":"2024-05-07T11:17:23.874613+0000","last_clean":"2024-05-07T11:14:24.451073+0000","last_became_active":"2024-05-07T11:17:19.426840+0000","last_became_peered":"2024-05-07T11:17:19.426840+0000","last_unstale":"2024-05-07T11:17:23.874613+0000","last_undegraded":"2024-05-07T11:17:19.398884+0000","last_fullsized":"2024-05-07T11:17:19.397117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":62}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397630+0000","last_change":"2024-05-07T11:17:18.429950+0000","last_active":"2024-05-07T11:17:23.397630+0000","last_peered":"2024-05-07T11:17:23.397630+0000","last_clean":"2024-05-07T11:17:23.397630+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:23.397630+0000","last_undegraded":"2024-05-07T11:17:23.397630+0000","last_fullsized":"2024-05-07T11:17:23.397630+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2328,"num_objects_misplaced":434,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3115,"num_bytes_recovered":10110672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62046208,"data_stored":52021508,"data_compressed":4472281,"data_compressed_allocated":5259264,"data_compressed_original":13680640,"omap_allocated":0,"internal_metadata":0},"log_size":10416,"ondisk_log_size":10416,"up":128,"acting":103,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":428,"ondisk_log_size":428,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87884,"kb_used_data":34492,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94283956,"statfs":{"total":96636764160,"available":96546770944,"internally_reserved":0,"allocated":35319808,"data_stored":57209467,"data_compressed":6730892,"data_compressed_allocated":8085504,"data_compressed_original":38760448,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710723,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68648,"kb_used_data":24412,"kb_used_omap":10,"kb_used_meta":44213,"kb_avail":94303192,"statfs":{"total":96636764160,"available":96566468608,"internally_reserved":0,"allocated":24997888,"data_stored":46562034,"data_compressed":5505454,"data_compressed_allocated":6463488,"data_compressed_original":33083392,"omap_allocated":10404,"internal_metadata":45274972},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49520,"kb_used_data":18344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322320,"statfs":{"total":96636764160,"available":96586055680,"internally_reserved":0,"allocated":18784256,"data_stored":32832218,"data_compressed":4426861,"data_compressed_allocated":5206016,"data_compressed_original":24207360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15187968,"data_stored":12540098,"data_compressed":1440329,"data_compressed_allocated":1683456,"data_compressed_original":4333568,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19030016,"data_stored":16315709,"data_compressed":1057885,"data_compressed_allocated":1261568,"data_compressed_original":3276800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27828224,"data_stored":23165701,"data_compressed":1974067,"data_compressed_allocated":2314240,"data_compressed_original":6070272,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:26.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-07T11:17:27.082 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:27.083 INFO:teuthology.orchestra.run.smithi062.stdout:{"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2328/6966 objects degraded (33.419%), 24 pgs degraded","count":24},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":298,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":79,"num_osds":3,"num_up_osds":3,"osd_up_since":1715080638,"num_in_osds":3,"osd_in_since":1715080349,"num_remapped_pgs":12},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":73},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":21},{"state_name":"peering","count":5},{"state_name":"active+undersized+remapped","count":3},{"state_name":"active+recovery_wait+degraded","count":2},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":3483,"data_bytes":68828561,"bytes_used":210997248,"bytes_avail":289699295232,"bytes_total":289910292480,"inactive_pgs_ratio":0.0476190485060215,"degraded_objects":2328,"degraded_total":6966,"degraded_ratio":0.33419465977605511,"misplaced_objects":434,"misplaced_total":6966,"misplaced_ratio":0.062302612690209591,"recovering_objects_per_sec":782,"recovering_bytes_per_sec":11879373,"recovering_keys_per_sec":0,"num_objects_recovered":3131,"num_bytes_recovered":47528386,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4190}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-05-07T11:13:48.949854+0000","services":{}},"progress_events":{}} 2024-05-07T11:17:27.096 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-05-07T11:17:27.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:27.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:27.399 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:27.411 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-05-07T11:17:27.013395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2328,"num_objects_misplaced":434,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3137,"num_bytes_recovered":47528968,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11001,"ondisk_log_size":11001,"up":210,"acting":185,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":235,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":206052,"kb_used_data":77248,"kb_used_omap":13,"kb_used_meta":128754,"kb_avail":282909468,"statfs":{"total":289910292480,"available":289699295232,"internally_reserved":0,"allocated":79101952,"data_stored":136603719,"data_compressed":16663207,"data_compressed_allocated":19755008,"data_compressed_original":96051200,"omap_allocated":13594,"internal_metadata":131844838},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-576,"num_objects_misplaced":-580,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1213,"num_bytes_recovered":2027404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000789"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":308,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.397072+0000","last_change":"2024-05-07T11:17:19.438566+0000","last_active":"2024-05-07T11:17:23.397072+0000","last_peered":"2024-05-07T11:17:23.397072+0000","last_clean":"2024-05-07T11:14:24.364900+0000","last_became_active":"2024-05-07T11:17:19.437076+0000","last_became_peered":"2024-05-07T11:17:19.437076+0000","last_unstale":"2024-05-07T11:17:23.397072+0000","last_undegraded":"2024-05-07T11:17:19.425486+0000","last_fullsized":"2024-05-07T11:17:19.407594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":104,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":49}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"63'155","reported_seq":295,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394610+0000","last_change":"2024-05-07T11:17:21.419253+0000","last_active":"2024-05-07T11:17:23.394610+0000","last_peered":"2024-05-07T11:17:23.394610+0000","last_clean":"2024-05-07T11:17:23.394610+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:23.394610+0000","last_undegraded":"2024-05-07T11:17:23.394610+0000","last_fullsized":"2024-05-07T11:17:23.394610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:45:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'169","reported_seq":308,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394330+0000","last_change":"2024-05-07T11:17:19.436446+0000","last_active":"2024-05-07T11:17:23.394330+0000","last_peered":"2024-05-07T11:17:23.394330+0000","last_clean":"2024-05-07T11:14:24.486064+0000","last_became_active":"2024-05-07T11:17:19.434058+0000","last_became_peered":"2024-05-07T11:17:19.434058+0000","last_unstale":"2024-05-07T11:17:23.394330+0000","last_undegraded":"2024-05-07T11:17:19.408807+0000","last_fullsized":"2024-05-07T11:17:19.403831+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":260,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396641+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:23.396641+0000","last_peered":"2024-05-07T11:17:23.396641+0000","last_clean":"2024-05-07T11:17:23.396641+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:23.396641+0000","last_undegraded":"2024-05-07T11:17:23.396641+0000","last_fullsized":"2024-05-07T11:17:23.396641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"63'186","reported_seq":326,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394395+0000","last_change":"2024-05-07T11:17:21.419034+0000","last_active":"2024-05-07T11:17:23.394395+0000","last_peered":"2024-05-07T11:17:23.394395+0000","last_clean":"2024-05-07T11:17:23.394395+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:23.394395+0000","last_undegraded":"2024-05-07T11:17:23.394395+0000","last_fullsized":"2024-05-07T11:17:23.394395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:42.536445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":251,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394324+0000","last_change":"2024-05-07T11:17:22.419149+0000","last_active":"2024-05-07T11:17:23.394324+0000","last_peered":"2024-05-07T11:17:23.394324+0000","last_clean":"2024-05-07T11:14:24.385916+0000","last_became_active":"2024-05-07T11:17:22.416956+0000","last_became_peered":"2024-05-07T11:17:22.416956+0000","last_unstale":"2024-05-07T11:17:23.394324+0000","last_undegraded":"2024-05-07T11:17:22.411982+0000","last_fullsized":"2024-05-07T11:17:22.411747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":108,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":42}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"63'166","reported_seq":255,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393747+0000","last_change":"2024-05-07T11:17:22.418934+0000","last_active":"2024-05-07T11:17:23.393747+0000","last_peered":"2024-05-07T11:17:23.393747+0000","last_clean":"2024-05-07T11:17:23.393747+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:23.393747+0000","last_undegraded":"2024-05-07T11:17:23.393747+0000","last_fullsized":"2024-05-07T11:17:23.393747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:05.143462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":449,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.399107+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:23.399107+0000","last_peered":"2024-05-07T11:17:23.399107+0000","last_clean":"2024-05-07T11:17:23.399107+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:23.399107+0000","last_undegraded":"2024-05-07T11:17:23.399107+0000","last_fullsized":"2024-05-07T11:17:23.399107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:04.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":246,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.397630+0000","last_change":"2024-05-07T11:17:19.437547+0000","last_active":"2024-05-07T11:17:23.397630+0000","last_peered":"2024-05-07T11:17:23.397630+0000","last_clean":"2024-05-07T11:14:24.451837+0000","last_became_active":"2024-05-07T11:17:19.435835+0000","last_became_peered":"2024-05-07T11:17:19.435835+0000","last_unstale":"2024-05-07T11:17:23.397630+0000","last_undegraded":"2024-05-07T11:17:19.424674+0000","last_fullsized":"2024-05-07T11:17:19.410369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":106,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'156","reported_seq":299,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394572+0000","last_change":"2024-05-07T11:17:22.416801+0000","last_active":"2024-05-07T11:17:23.394572+0000","last_peered":"2024-05-07T11:17:23.394572+0000","last_clean":"2024-05-07T11:17:23.394572+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:23.394572+0000","last_undegraded":"2024-05-07T11:17:23.394572+0000","last_fullsized":"2024-05-07T11:17:23.394572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:07.028486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'154","reported_seq":436,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394586+0000","last_change":"2024-05-07T11:17:22.419089+0000","last_active":"2024-05-07T11:17:23.394586+0000","last_peered":"2024-05-07T11:17:23.394586+0000","last_clean":"2024-05-07T11:17:23.394586+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:23.394586+0000","last_undegraded":"2024-05-07T11:17:23.394586+0000","last_fullsized":"2024-05-07T11:17:23.394586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:57.833385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":279,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394814+0000","last_change":"2024-05-07T11:17:19.438657+0000","last_active":"2024-05-07T11:17:23.394814+0000","last_peered":"2024-05-07T11:17:23.394814+0000","last_clean":"2024-05-07T11:14:24.417671+0000","last_became_active":"2024-05-07T11:17:19.435011+0000","last_became_peered":"2024-05-07T11:17:19.435011+0000","last_unstale":"2024-05-07T11:17:23.394814+0000","last_undegraded":"2024-05-07T11:17:19.413983+0000","last_fullsized":"2024-05-07T11:17:19.412423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":86,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"63'136","reported_seq":277,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.398879+0000","last_change":"2024-05-07T11:17:23.398879+0000","last_active":"2024-05-07T11:17:23.398879+0000","last_peered":"2024-05-07T11:17:23.398879+0000","last_clean":"2024-05-07T11:17:23.398879+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:23.398879+0000","last_undegraded":"2024-05-07T11:17:23.398879+0000","last_fullsized":"2024-05-07T11:17:23.398879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:33:07.091905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'175","reported_seq":313,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394552+0000","last_change":"2024-05-07T11:17:19.436711+0000","last_active":"2024-05-07T11:17:23.394552+0000","last_peered":"2024-05-07T11:17:23.394552+0000","last_clean":"2024-05-07T11:14:24.470554+0000","last_became_active":"2024-05-07T11:17:19.431229+0000","last_became_peered":"2024-05-07T11:17:19.431229+0000","last_unstale":"2024-05-07T11:17:23.394552+0000","last_undegraded":"2024-05-07T11:17:19.399847+0000","last_fullsized":"2024-05-07T11:17:19.397290+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":516,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.399194+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:23.399194+0000","last_peered":"2024-05-07T11:17:23.399194+0000","last_clean":"2024-05-07T11:17:23.399194+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:23.399194+0000","last_undegraded":"2024-05-07T11:17:23.399194+0000","last_fullsized":"2024-05-07T11:17:23.399194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:30:48.688430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":253,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394035+0000","last_change":"2024-05-07T11:17:22.420019+0000","last_active":"2024-05-07T11:17:23.394035+0000","last_peered":"2024-05-07T11:17:23.394035+0000","last_clean":"2024-05-07T11:14:24.378895+0000","last_became_active":"2024-05-07T11:17:22.418850+0000","last_became_peered":"2024-05-07T11:17:22.418850+0000","last_unstale":"2024-05-07T11:17:23.394035+0000","last_undegraded":"2024-05-07T11:17:22.412415+0000","last_fullsized":"2024-05-07T11:17:22.412148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":113,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'161","reported_seq":501,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397856+0000","last_change":"2024-05-07T11:17:22.416613+0000","last_active":"2024-05-07T11:17:23.397856+0000","last_peered":"2024-05-07T11:17:23.397856+0000","last_clean":"2024-05-07T11:17:23.397856+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:23.397856+0000","last_undegraded":"2024-05-07T11:17:23.397856+0000","last_fullsized":"2024-05-07T11:17:23.397856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"63'148","reported_seq":288,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394464+0000","last_change":"2024-05-07T11:17:21.418472+0000","last_active":"2024-05-07T11:17:23.394464+0000","last_peered":"2024-05-07T11:17:23.394464+0000","last_clean":"2024-05-07T11:17:23.394464+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:23.394464+0000","last_undegraded":"2024-05-07T11:17:23.394464+0000","last_fullsized":"2024-05-07T11:17:23.394464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:18.184681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'147","reported_seq":223,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397397+0000","last_change":"2024-05-07T11:17:21.418164+0000","last_active":"2024-05-07T11:17:23.397397+0000","last_peered":"2024-05-07T11:17:23.397397+0000","last_clean":"2024-05-07T11:17:23.397397+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:23.397397+0000","last_undegraded":"2024-05-07T11:17:23.397397+0000","last_fullsized":"2024-05-07T11:17:23.397397+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":328,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.396746+0000","last_change":"2024-05-07T11:17:19.439196+0000","last_active":"2024-05-07T11:17:23.396746+0000","last_peered":"2024-05-07T11:17:23.396746+0000","last_clean":"2024-05-07T11:14:24.396282+0000","last_became_active":"2024-05-07T11:17:19.437184+0000","last_became_peered":"2024-05-07T11:17:19.437184+0000","last_unstale":"2024-05-07T11:17:23.396746+0000","last_undegraded":"2024-05-07T11:17:19.422229+0000","last_fullsized":"2024-05-07T11:17:19.419110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":112,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":291,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393973+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:23.393973+0000","last_peered":"2024-05-07T11:17:23.393973+0000","last_clean":"2024-05-07T11:17:23.393973+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:23.393973+0000","last_undegraded":"2024-05-07T11:17:23.393973+0000","last_fullsized":"2024-05-07T11:17:23.393973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":304,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393647+0000","last_change":"2024-05-07T11:17:19.439396+0000","last_active":"2024-05-07T11:17:23.393647+0000","last_peered":"2024-05-07T11:17:23.393647+0000","last_clean":"2024-05-07T11:14:24.332238+0000","last_became_active":"2024-05-07T11:17:19.434809+0000","last_became_peered":"2024-05-07T11:17:19.434809+0000","last_unstale":"2024-05-07T11:17:23.393647+0000","last_undegraded":"2024-05-07T11:17:19.410512+0000","last_fullsized":"2024-05-07T11:17:19.407581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":101,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":7}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"63'159","reported_seq":233,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396783+0000","last_change":"2024-05-07T11:17:21.418519+0000","last_active":"2024-05-07T11:17:23.396783+0000","last_peered":"2024-05-07T11:17:23.396783+0000","last_clean":"2024-05-07T11:17:23.396783+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:23.396783+0000","last_undegraded":"2024-05-07T11:17:23.396783+0000","last_fullsized":"2024-05-07T11:17:23.396783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"63'169","reported_seq":309,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393668+0000","last_change":"2024-05-07T11:17:21.414896+0000","last_active":"2024-05-07T11:17:23.393668+0000","last_peered":"2024-05-07T11:17:23.393668+0000","last_clean":"2024-05-07T11:17:23.393668+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:23.393668+0000","last_undegraded":"2024-05-07T11:17:23.393668+0000","last_fullsized":"2024-05-07T11:17:23.393668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:52.242314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":282,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.394634+0000","last_change":"2024-05-07T11:17:23.394634+0000","last_active":"2024-05-07T11:17:18.396063+0000","last_peered":"2024-05-07T11:17:17.243932+0000","last_clean":"2024-05-07T11:14:24.475528+0000","last_became_active":"2024-05-07T11:14:25.512804+0000","last_became_peered":"2024-05-07T11:14:25.512804+0000","last_unstale":"2024-05-07T11:17:23.394634+0000","last_undegraded":"2024-05-07T11:17:23.394634+0000","last_fullsized":"2024-05-07T11:17:23.394634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'195","reported_seq":331,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397769+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:17:23.397769+0000","last_peered":"2024-05-07T11:17:23.397769+0000","last_clean":"2024-05-07T11:17:23.397769+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:23.397769+0000","last_undegraded":"2024-05-07T11:17:23.397769+0000","last_fullsized":"2024-05-07T11:17:23.397769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":273,"reported_epoch":76,"state":"active+recovery_wait+degraded","last_fresh":"2024-05-07T11:17:23.403662+0000","last_change":"2024-05-07T11:17:23.403843+0000","last_active":"2024-05-07T11:17:23.403662+0000","last_peered":"2024-05-07T11:17:23.403662+0000","last_clean":"2024-05-07T11:14:24.294325+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:23.403662+0000","last_undegraded":"2024-05-07T11:17:23.394924+0000","last_fullsized":"2024-05-07T11:17:23.403662+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":91,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":286,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.396379+0000","last_change":"2024-05-07T11:17:19.438982+0000","last_active":"2024-05-07T11:17:23.396379+0000","last_peered":"2024-05-07T11:17:23.396379+0000","last_clean":"2024-05-07T11:14:24.430825+0000","last_became_active":"2024-05-07T11:17:19.436245+0000","last_became_peered":"2024-05-07T11:17:19.436245+0000","last_unstale":"2024-05-07T11:17:23.396379+0000","last_undegraded":"2024-05-07T11:17:19.417373+0000","last_fullsized":"2024-05-07T11:17:19.414331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":91,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":227,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.116134+0000","last_change":"2024-05-07T11:17:24.181998+0000","last_active":"2024-05-07T11:17:24.181998+0000","last_peered":"2024-05-07T11:17:23.116134+0000","last_clean":"2024-05-07T11:14:24.443460+0000","last_became_active":"2024-05-07T11:17:19.431780+0000","last_became_peered":"2024-05-07T11:17:19.431780+0000","last_unstale":"2024-05-07T11:17:23.116134+0000","last_undegraded":"2024-05-07T11:17:23.116134+0000","last_fullsized":"2024-05-07T11:17:19.408755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":324,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394264+0000","last_change":"2024-05-07T11:17:19.439496+0000","last_active":"2024-05-07T11:17:23.394264+0000","last_peered":"2024-05-07T11:17:23.394264+0000","last_clean":"2024-05-07T11:14:24.440580+0000","last_became_active":"2024-05-07T11:17:19.435641+0000","last_became_peered":"2024-05-07T11:17:19.435641+0000","last_unstale":"2024-05-07T11:17:23.394264+0000","last_undegraded":"2024-05-07T11:17:19.416557+0000","last_fullsized":"2024-05-07T11:17:19.412853+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":114,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"63'192","reported_seq":572,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396991+0000","last_change":"2024-05-07T11:17:22.416120+0000","last_active":"2024-05-07T11:17:23.396991+0000","last_peered":"2024-05-07T11:17:23.396991+0000","last_clean":"2024-05-07T11:17:23.396991+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:23.396991+0000","last_undegraded":"2024-05-07T11:17:23.396991+0000","last_fullsized":"2024-05-07T11:17:23.396991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:13.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"63'185","reported_seq":328,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394584+0000","last_change":"2024-05-07T11:17:19.438939+0000","last_active":"2024-05-07T11:17:23.394584+0000","last_peered":"2024-05-07T11:17:23.394584+0000","last_clean":"2024-05-07T11:14:24.357156+0000","last_became_active":"2024-05-07T11:17:19.437340+0000","last_became_peered":"2024-05-07T11:17:19.437340+0000","last_unstale":"2024-05-07T11:17:23.394584+0000","last_undegraded":"2024-05-07T11:17:19.420606+0000","last_fullsized":"2024-05-07T11:17:19.414996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":49}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'156","reported_seq":299,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393912+0000","last_change":"2024-05-07T11:17:22.416165+0000","last_active":"2024-05-07T11:17:23.393912+0000","last_peered":"2024-05-07T11:17:23.393912+0000","last_clean":"2024-05-07T11:17:23.393912+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:23.393912+0000","last_undegraded":"2024-05-07T11:17:23.393912+0000","last_fullsized":"2024-05-07T11:17:23.393912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:57.237765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":262,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395342+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:23.395342+0000","last_peered":"2024-05-07T11:17:23.395342+0000","last_clean":"2024-05-07T11:17:23.395342+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:23.395342+0000","last_undegraded":"2024-05-07T11:17:23.395342+0000","last_fullsized":"2024-05-07T11:17:23.395342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"63'141","reported_seq":281,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394291+0000","last_change":"2024-05-07T11:17:21.419206+0000","last_active":"2024-05-07T11:17:23.394291+0000","last_peered":"2024-05-07T11:17:23.394291+0000","last_clean":"2024-05-07T11:17:23.394291+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:23.394291+0000","last_undegraded":"2024-05-07T11:17:23.394291+0000","last_fullsized":"2024-05-07T11:17:23.394291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:12.679336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397177+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:23.397177+0000","last_peered":"2024-05-07T11:17:23.397177+0000","last_clean":"2024-05-07T11:17:23.397177+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:23.397177+0000","last_undegraded":"2024-05-07T11:17:23.397177+0000","last_fullsized":"2024-05-07T11:17:23.397177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.025763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"63'179","reported_seq":253,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397532+0000","last_change":"2024-05-07T11:17:21.419284+0000","last_active":"2024-05-07T11:17:23.397532+0000","last_peered":"2024-05-07T11:17:23.397532+0000","last_clean":"2024-05-07T11:17:23.397532+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:23.397532+0000","last_undegraded":"2024-05-07T11:17:23.397532+0000","last_fullsized":"2024-05-07T11:17:23.397532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:54.463898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393647+0000","last_change":"2024-05-07T11:17:18.423604+0000","last_active":"2024-05-07T11:17:23.393647+0000","last_peered":"2024-05-07T11:17:23.393647+0000","last_clean":"2024-05-07T11:17:23.393647+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:23.393647+0000","last_undegraded":"2024-05-07T11:17:23.393647+0000","last_fullsized":"2024-05-07T11:17:23.393647+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:45:28.650148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":230,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.401355+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:23.401355+0000","last_peered":"2024-05-07T11:17:23.401355+0000","last_clean":"2024-05-07T11:17:23.401355+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:23.401355+0000","last_undegraded":"2024-05-07T11:17:23.401355+0000","last_fullsized":"2024-05-07T11:17:23.401355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":151,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395256+0000","last_change":"2024-05-07T11:17:18.433027+0000","last_active":"2024-05-07T11:17:23.395256+0000","last_peered":"2024-05-07T11:17:23.395256+0000","last_clean":"2024-05-07T11:17:23.395256+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:23.395256+0000","last_undegraded":"2024-05-07T11:17:23.395256+0000","last_fullsized":"2024-05-07T11:17:23.395256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:47.068504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":146,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397627+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:23.397627+0000","last_peered":"2024-05-07T11:17:23.397627+0000","last_clean":"2024-05-07T11:17:23.397627+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:23.397627+0000","last_undegraded":"2024-05-07T11:17:23.397627+0000","last_fullsized":"2024-05-07T11:17:23.397627+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:35:51.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'155","reported_seq":224,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393522+0000","last_change":"2024-05-07T11:17:19.437866+0000","last_active":"2024-05-07T11:17:23.393522+0000","last_peered":"2024-05-07T11:17:23.393522+0000","last_clean":"2024-05-07T11:14:24.400453+0000","last_became_active":"2024-05-07T11:17:19.433702+0000","last_became_peered":"2024-05-07T11:17:19.433702+0000","last_unstale":"2024-05-07T11:17:23.393522+0000","last_undegraded":"2024-05-07T11:17:19.404990+0000","last_fullsized":"2024-05-07T11:17:19.399778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":95,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394209+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:23.394209+0000","last_peered":"2024-05-07T11:17:23.394209+0000","last_clean":"2024-05-07T11:17:23.394209+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:23.394209+0000","last_undegraded":"2024-05-07T11:17:23.394209+0000","last_fullsized":"2024-05-07T11:17:23.394209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:16.479879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'167","reported_seq":307,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393522+0000","last_change":"2024-05-07T11:17:21.418782+0000","last_active":"2024-05-07T11:17:23.393522+0000","last_peered":"2024-05-07T11:17:23.393522+0000","last_clean":"2024-05-07T11:17:23.393522+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:23.393522+0000","last_undegraded":"2024-05-07T11:17:23.393522+0000","last_fullsized":"2024-05-07T11:17:23.393522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:13.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396832+0000","last_change":"2024-05-07T11:17:22.419069+0000","last_active":"2024-05-07T11:17:23.396832+0000","last_peered":"2024-05-07T11:17:23.396832+0000","last_clean":"2024-05-07T11:17:23.396832+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:23.396832+0000","last_undegraded":"2024-05-07T11:17:23.396832+0000","last_fullsized":"2024-05-07T11:17:23.396832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:20.890067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":302,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394613+0000","last_change":"2024-05-07T11:17:19.439572+0000","last_active":"2024-05-07T11:17:23.394613+0000","last_peered":"2024-05-07T11:17:23.394613+0000","last_clean":"2024-05-07T11:14:24.352569+0000","last_became_active":"2024-05-07T11:17:19.437369+0000","last_became_peered":"2024-05-07T11:17:19.437369+0000","last_unstale":"2024-05-07T11:17:23.394613+0000","last_undegraded":"2024-05-07T11:17:19.420446+0000","last_fullsized":"2024-05-07T11:17:19.417984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397543+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:23.397543+0000","last_peered":"2024-05-07T11:17:23.397543+0000","last_clean":"2024-05-07T11:17:23.397543+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:23.397543+0000","last_undegraded":"2024-05-07T11:17:23.397543+0000","last_fullsized":"2024-05-07T11:17:23.397543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:31:28.580245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"63'164","reported_seq":300,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397425+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:17:23.397425+0000","last_peered":"2024-05-07T11:17:23.397425+0000","last_clean":"2024-05-07T11:17:23.397425+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:23.397425+0000","last_undegraded":"2024-05-07T11:17:23.397425+0000","last_fullsized":"2024-05-07T11:17:23.397425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397475+0000","last_change":"2024-05-07T11:17:18.450923+0000","last_active":"2024-05-07T11:17:23.397475+0000","last_peered":"2024-05-07T11:17:23.397475+0000","last_clean":"2024-05-07T11:17:23.397475+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:23.397475+0000","last_undegraded":"2024-05-07T11:17:23.397475+0000","last_fullsized":"2024-05-07T11:17:23.397475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:38.864461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"63'172","reported_seq":315,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.396868+0000","last_change":"2024-05-07T11:17:19.439191+0000","last_active":"2024-05-07T11:17:23.396868+0000","last_peered":"2024-05-07T11:17:23.396868+0000","last_clean":"2024-05-07T11:14:24.436962+0000","last_became_active":"2024-05-07T11:17:19.438026+0000","last_became_peered":"2024-05-07T11:17:19.438026+0000","last_unstale":"2024-05-07T11:17:23.396868+0000","last_undegraded":"2024-05-07T11:17:19.423429+0000","last_fullsized":"2024-05-07T11:17:19.419186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":112,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395161+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:23.395161+0000","last_peered":"2024-05-07T11:17:23.395161+0000","last_clean":"2024-05-07T11:17:23.395161+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:23.395161+0000","last_undegraded":"2024-05-07T11:17:23.395161+0000","last_fullsized":"2024-05-07T11:17:23.395161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"63'163","reported_seq":302,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.395431+0000","last_change":"2024-05-07T11:17:19.437566+0000","last_active":"2024-05-07T11:17:23.395431+0000","last_peered":"2024-05-07T11:17:23.395431+0000","last_clean":"2024-05-07T11:14:24.493593+0000","last_became_active":"2024-05-07T11:17:19.436403+0000","last_became_peered":"2024-05-07T11:17:19.436403+0000","last_unstale":"2024-05-07T11:17:23.395431+0000","last_undegraded":"2024-05-07T11:17:19.420310+0000","last_fullsized":"2024-05-07T11:17:19.416685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":98,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":5}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393494+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:23.393494+0000","last_peered":"2024-05-07T11:17:23.393494+0000","last_clean":"2024-05-07T11:17:23.393494+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:23.393494+0000","last_undegraded":"2024-05-07T11:17:23.393494+0000","last_fullsized":"2024-05-07T11:17:23.393494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:47.689436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'137","reported_seq":453,"reported_epoch":75,"state":"peering","last_fresh":"2024-05-07T11:17:22.518029+0000","last_change":"2024-05-07T11:17:23.394952+0000","last_active":"2024-05-07T11:17:23.394952+0000","last_peered":"2024-05-07T11:17:22.518029+0000","last_clean":"2024-05-07T11:14:24.395523+0000","last_became_active":"2024-05-07T11:17:19.432130+0000","last_became_peered":"2024-05-07T11:17:19.432130+0000","last_unstale":"2024-05-07T11:17:22.518029+0000","last_undegraded":"2024-05-07T11:17:22.518029+0000","last_fullsized":"2024-05-07T11:17:19.415262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393850+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:23.393850+0000","last_peered":"2024-05-07T11:17:23.393850+0000","last_clean":"2024-05-07T11:17:23.393850+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:23.393850+0000","last_undegraded":"2024-05-07T11:17:23.393850+0000","last_fullsized":"2024-05-07T11:17:23.393850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:59.411938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'141","reported_seq":461,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397799+0000","last_change":"2024-05-07T11:17:22.417126+0000","last_active":"2024-05-07T11:17:23.397799+0000","last_peered":"2024-05-07T11:17:23.397799+0000","last_clean":"2024-05-07T11:17:23.397799+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:23.397799+0000","last_undegraded":"2024-05-07T11:17:23.397799+0000","last_fullsized":"2024-05-07T11:17:23.397799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":345,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395388+0000","last_change":"2024-05-07T11:17:18.433863+0000","last_active":"2024-05-07T11:17:23.395388+0000","last_peered":"2024-05-07T11:17:23.395388+0000","last_clean":"2024-05-07T11:17:23.395388+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:23.395388+0000","last_undegraded":"2024-05-07T11:17:23.395388+0000","last_fullsized":"2024-05-07T11:17:23.395388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:10.515455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":154,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395912+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:23.395912+0000","last_peered":"2024-05-07T11:17:23.395912+0000","last_clean":"2024-05-07T11:17:23.395912+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:23.395912+0000","last_undegraded":"2024-05-07T11:17:23.395912+0000","last_fullsized":"2024-05-07T11:17:23.395912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:03:02.539869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397079+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:23.397079+0000","last_peered":"2024-05-07T11:17:23.397079+0000","last_clean":"2024-05-07T11:17:23.397079+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:23.397079+0000","last_undegraded":"2024-05-07T11:17:23.397079+0000","last_fullsized":"2024-05-07T11:17:23.397079+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":268,"reported_epoch":76,"state":"active+recovery_wait+degraded","last_fresh":"2024-05-07T11:17:23.403359+0000","last_change":"2024-05-07T11:17:23.403839+0000","last_active":"2024-05-07T11:17:23.403359+0000","last_peered":"2024-05-07T11:17:23.403359+0000","last_clean":"2024-05-07T11:14:24.305202+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:23.403359+0000","last_undegraded":"2024-05-07T11:17:23.396611+0000","last_fullsized":"2024-05-07T11:17:23.403359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":52}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395307+0000","last_change":"2024-05-07T11:17:18.433452+0000","last_active":"2024-05-07T11:17:23.395307+0000","last_peered":"2024-05-07T11:17:23.395307+0000","last_clean":"2024-05-07T11:17:23.395307+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:23.395307+0000","last_undegraded":"2024-05-07T11:17:23.395307+0000","last_fullsized":"2024-05-07T11:17:23.395307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:26.663080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":206,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397102+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:17:23.397102+0000","last_peered":"2024-05-07T11:17:23.397102+0000","last_clean":"2024-05-07T11:17:23.397102+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:23.397102+0000","last_undegraded":"2024-05-07T11:17:23.397102+0000","last_fullsized":"2024-05-07T11:17:23.397102+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"63'160","reported_seq":293,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.394449+0000","last_change":"2024-05-07T11:17:23.394449+0000","last_active":"2024-05-07T11:17:18.396148+0000","last_peered":"2024-05-07T11:17:17.243626+0000","last_clean":"2024-05-07T11:14:24.444615+0000","last_became_active":"2024-05-07T11:14:25.509161+0000","last_became_peered":"2024-05-07T11:14:25.509161+0000","last_unstale":"2024-05-07T11:17:23.394449+0000","last_undegraded":"2024-05-07T11:17:23.394449+0000","last_fullsized":"2024-05-07T11:17:23.394449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397216+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:23.397216+0000","last_peered":"2024-05-07T11:17:23.397216+0000","last_clean":"2024-05-07T11:17:23.397216+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:23.397216+0000","last_undegraded":"2024-05-07T11:17:23.397216+0000","last_fullsized":"2024-05-07T11:17:23.397216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:20.744525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393493+0000","last_change":"2024-05-07T11:17:18.572639+0000","last_active":"2024-05-07T11:17:23.393493+0000","last_peered":"2024-05-07T11:17:23.393493+0000","last_clean":"2024-05-07T11:17:23.393493+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:23.393493+0000","last_undegraded":"2024-05-07T11:17:23.393493+0000","last_fullsized":"2024-05-07T11:17:23.393493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:15.538158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":244,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394418+0000","last_change":"2024-05-07T11:17:19.436365+0000","last_active":"2024-05-07T11:17:23.394418+0000","last_peered":"2024-05-07T11:17:23.394418+0000","last_clean":"2024-05-07T11:14:24.445283+0000","last_became_active":"2024-05-07T11:17:19.432372+0000","last_became_peered":"2024-05-07T11:17:19.432372+0000","last_unstale":"2024-05-07T11:17:23.394418+0000","last_undegraded":"2024-05-07T11:17:19.409832+0000","last_fullsized":"2024-05-07T11:17:19.399925+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":109,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":6},{"shards":"2","objects":50}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395254+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:23.395254+0000","last_peered":"2024-05-07T11:17:23.395254+0000","last_clean":"2024-05-07T11:17:23.395254+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:23.395254+0000","last_undegraded":"2024-05-07T11:17:23.395254+0000","last_fullsized":"2024-05-07T11:17:23.395254+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":148,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395811+0000","last_change":"2024-05-07T11:17:18.404539+0000","last_active":"2024-05-07T11:17:23.395811+0000","last_peered":"2024-05-07T11:17:23.395811+0000","last_clean":"2024-05-07T11:17:23.395811+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:23.395811+0000","last_undegraded":"2024-05-07T11:17:23.395811+0000","last_fullsized":"2024-05-07T11:17:23.395811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:50.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":398,"reported_epoch":76,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:24.181331+0000","last_change":"2024-05-07T11:17:24.052450+0000","last_active":"2024-05-07T11:17:24.181331+0000","last_peered":"2024-05-07T11:17:24.181331+0000","last_clean":"2024-05-07T11:14:24.363205+0000","last_became_active":"2024-05-07T11:17:19.429221+0000","last_became_peered":"2024-05-07T11:17:19.429221+0000","last_unstale":"2024-05-07T11:17:24.181331+0000","last_undegraded":"2024-05-07T11:17:19.417937+0000","last_fullsized":"2024-05-07T11:17:19.407481+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":11,"num_objects_misplaced":15,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":143021,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":46}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396935+0000","last_change":"2024-05-07T11:17:22.424750+0000","last_active":"2024-05-07T11:17:23.396935+0000","last_peered":"2024-05-07T11:17:23.396935+0000","last_clean":"2024-05-07T11:17:23.396935+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:23.396935+0000","last_undegraded":"2024-05-07T11:17:23.396935+0000","last_fullsized":"2024-05-07T11:17:23.396935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:12.283160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397838+0000","last_change":"2024-05-07T11:17:18.433137+0000","last_active":"2024-05-07T11:17:23.397838+0000","last_peered":"2024-05-07T11:17:23.397838+0000","last_clean":"2024-05-07T11:17:23.397838+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:23.397838+0000","last_undegraded":"2024-05-07T11:17:23.397838+0000","last_fullsized":"2024-05-07T11:17:23.397838+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:40.770823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":297,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393947+0000","last_change":"2024-05-07T11:17:19.439272+0000","last_active":"2024-05-07T11:17:23.393947+0000","last_peered":"2024-05-07T11:17:23.393947+0000","last_clean":"2024-05-07T11:14:24.425940+0000","last_became_active":"2024-05-07T11:17:19.434379+0000","last_became_peered":"2024-05-07T11:17:19.434379+0000","last_unstale":"2024-05-07T11:17:23.393947+0000","last_undegraded":"2024-05-07T11:17:19.403485+0000","last_fullsized":"2024-05-07T11:17:19.397696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397705+0000","last_change":"2024-05-07T11:17:18.431763+0000","last_active":"2024-05-07T11:17:23.397705+0000","last_peered":"2024-05-07T11:17:23.397705+0000","last_clean":"2024-05-07T11:17:23.397705+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:23.397705+0000","last_undegraded":"2024-05-07T11:17:23.397705+0000","last_fullsized":"2024-05-07T11:17:23.397705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:38.234395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394551+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:23.394551+0000","last_peered":"2024-05-07T11:17:23.394551+0000","last_clean":"2024-05-07T11:17:23.394551+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:23.394551+0000","last_undegraded":"2024-05-07T11:17:23.394551+0000","last_fullsized":"2024-05-07T11:17:23.394551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:54.609817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'181","reported_seq":317,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.399296+0000","last_change":"2024-05-07T11:17:23.399296+0000","last_active":"2024-05-07T11:17:23.399296+0000","last_peered":"2024-05-07T11:17:23.399296+0000","last_clean":"2024-05-07T11:17:23.399296+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:23.399296+0000","last_undegraded":"2024-05-07T11:17:23.399296+0000","last_fullsized":"2024-05-07T11:17:23.399296+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:21.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":86,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395081+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:23.395081+0000","last_peered":"2024-05-07T11:17:23.395081+0000","last_clean":"2024-05-07T11:17:23.395081+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:23.395081+0000","last_undegraded":"2024-05-07T11:17:23.395081+0000","last_fullsized":"2024-05-07T11:17:23.395081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:03.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397671+0000","last_change":"2024-05-07T11:17:18.432358+0000","last_active":"2024-05-07T11:17:23.397671+0000","last_peered":"2024-05-07T11:17:23.397671+0000","last_clean":"2024-05-07T11:17:23.397671+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:23.397671+0000","last_undegraded":"2024-05-07T11:17:23.397671+0000","last_fullsized":"2024-05-07T11:17:23.397671+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:36.281521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"63'175","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393858+0000","last_change":"2024-05-07T11:17:22.420080+0000","last_active":"2024-05-07T11:17:23.393858+0000","last_peered":"2024-05-07T11:17:23.393858+0000","last_clean":"2024-05-07T11:17:23.393858+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:23.393858+0000","last_undegraded":"2024-05-07T11:17:23.393858+0000","last_fullsized":"2024-05-07T11:17:23.393858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:41.233935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'38","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397563+0000","last_change":"2024-05-07T11:17:18.459674+0000","last_active":"2024-05-07T11:17:23.397563+0000","last_peered":"2024-05-07T11:17:23.397563+0000","last_clean":"2024-05-07T11:17:23.397563+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:23.397563+0000","last_undegraded":"2024-05-07T11:17:23.397563+0000","last_fullsized":"2024-05-07T11:17:23.397563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:35.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":149,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397844+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:23.397844+0000","last_peered":"2024-05-07T11:17:23.397844+0000","last_clean":"2024-05-07T11:17:23.397844+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:23.397844+0000","last_undegraded":"2024-05-07T11:17:23.397844+0000","last_fullsized":"2024-05-07T11:17:23.397844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:14.650941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'138","reported_seq":276,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393764+0000","last_change":"2024-05-07T11:17:22.417629+0000","last_active":"2024-05-07T11:17:23.393764+0000","last_peered":"2024-05-07T11:17:23.393764+0000","last_clean":"2024-05-07T11:17:23.393764+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:23.393764+0000","last_undegraded":"2024-05-07T11:17:23.393764+0000","last_fullsized":"2024-05-07T11:17:23.393764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:58.760049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'164","reported_seq":495,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.400613+0000","last_change":"2024-05-07T11:17:23.400613+0000","last_active":"2024-05-07T11:17:23.400613+0000","last_peered":"2024-05-07T11:17:23.400613+0000","last_clean":"2024-05-07T11:17:23.400613+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:23.400613+0000","last_undegraded":"2024-05-07T11:17:23.400613+0000","last_fullsized":"2024-05-07T11:17:23.400613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:28.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":193,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397519+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:23.397519+0000","last_peered":"2024-05-07T11:17:23.397519+0000","last_clean":"2024-05-07T11:17:23.397519+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:23.397519+0000","last_undegraded":"2024-05-07T11:17:23.397519+0000","last_fullsized":"2024-05-07T11:17:23.397519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:35.832524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":498,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:23.626703+0000","last_change":"2024-05-07T11:17:23.626897+0000","last_active":"2024-05-07T11:17:23.626703+0000","last_peered":"2024-05-07T11:17:23.626703+0000","last_clean":"2024-05-07T11:14:24.380609+0000","last_became_active":"2024-05-07T11:17:19.432285+0000","last_became_peered":"2024-05-07T11:17:19.432285+0000","last_unstale":"2024-05-07T11:17:23.626703+0000","last_undegraded":"2024-05-07T11:17:23.626703+0000","last_fullsized":"2024-05-07T11:17:19.405108+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":52}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393959+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:23.393959+0000","last_peered":"2024-05-07T11:17:23.393959+0000","last_clean":"2024-05-07T11:17:23.393959+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:23.393959+0000","last_undegraded":"2024-05-07T11:17:23.393959+0000","last_fullsized":"2024-05-07T11:17:23.393959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:46.092532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.395657+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:23.395657+0000","last_peered":"2024-05-07T11:17:23.395657+0000","last_clean":"2024-05-07T11:17:23.395657+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:23.395657+0000","last_undegraded":"2024-05-07T11:17:23.395657+0000","last_fullsized":"2024-05-07T11:17:23.395657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.076287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"63'172","reported_seq":247,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396881+0000","last_change":"2024-05-07T11:17:21.419673+0000","last_active":"2024-05-07T11:17:23.396881+0000","last_peered":"2024-05-07T11:17:23.396881+0000","last_clean":"2024-05-07T11:17:23.396881+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:23.396881+0000","last_undegraded":"2024-05-07T11:17:23.396881+0000","last_fullsized":"2024-05-07T11:17:23.396881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:01.519110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397476+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:23.397476+0000","last_peered":"2024-05-07T11:17:23.397476+0000","last_clean":"2024-05-07T11:17:23.397476+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:23.397476+0000","last_undegraded":"2024-05-07T11:17:23.397476+0000","last_fullsized":"2024-05-07T11:17:23.397476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:45.698283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":231,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.393507+0000","last_change":"2024-05-07T11:17:19.438036+0000","last_active":"2024-05-07T11:17:23.393507+0000","last_peered":"2024-05-07T11:17:23.393507+0000","last_clean":"2024-05-07T11:14:24.381417+0000","last_became_active":"2024-05-07T11:17:19.436774+0000","last_became_peered":"2024-05-07T11:17:19.436774+0000","last_unstale":"2024-05-07T11:17:23.393507+0000","last_undegraded":"2024-05-07T11:17:19.412827+0000","last_fullsized":"2024-05-07T11:17:19.397337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":100,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":45}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":314,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.395790+0000","last_change":"2024-05-07T11:17:19.437422+0000","last_active":"2024-05-07T11:17:23.395790+0000","last_peered":"2024-05-07T11:17:23.395790+0000","last_clean":"2024-05-07T11:14:24.468775+0000","last_became_active":"2024-05-07T11:17:19.432546+0000","last_became_peered":"2024-05-07T11:17:19.432546+0000","last_unstale":"2024-05-07T11:17:23.395790+0000","last_undegraded":"2024-05-07T11:17:19.406490+0000","last_fullsized":"2024-05-07T11:17:19.403425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396766+0000","last_change":"2024-05-07T11:17:18.431271+0000","last_active":"2024-05-07T11:17:23.396766+0000","last_peered":"2024-05-07T11:17:23.396766+0000","last_clean":"2024-05-07T11:17:23.396766+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:23.396766+0000","last_undegraded":"2024-05-07T11:17:23.396766+0000","last_fullsized":"2024-05-07T11:17:23.396766+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":421,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:24.051589+0000","last_change":"2024-05-07T11:17:24.051740+0000","last_active":"2024-05-07T11:17:24.051589+0000","last_peered":"2024-05-07T11:17:24.051589+0000","last_clean":"2024-05-07T11:14:24.298846+0000","last_became_active":"2024-05-07T11:17:19.434163+0000","last_became_peered":"2024-05-07T11:17:19.434163+0000","last_unstale":"2024-05-07T11:17:24.051589+0000","last_undegraded":"2024-05-07T11:17:19.419458+0000","last_fullsized":"2024-05-07T11:17:19.416477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.396990+0000","last_change":"2024-05-07T11:17:18.402834+0000","last_active":"2024-05-07T11:17:23.396990+0000","last_peered":"2024-05-07T11:17:23.396990+0000","last_clean":"2024-05-07T11:17:23.396990+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:23.396990+0000","last_undegraded":"2024-05-07T11:17:23.396990+0000","last_fullsized":"2024-05-07T11:17:23.396990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"63'205","reported_seq":343,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394003+0000","last_change":"2024-05-07T11:17:22.421343+0000","last_active":"2024-05-07T11:17:23.394003+0000","last_peered":"2024-05-07T11:17:23.394003+0000","last_clean":"2024-05-07T11:17:23.394003+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:23.394003+0000","last_undegraded":"2024-05-07T11:17:23.394003+0000","last_fullsized":"2024-05-07T11:17:23.394003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:24.076915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393769+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:23.393769+0000","last_peered":"2024-05-07T11:17:23.393769+0000","last_clean":"2024-05-07T11:17:23.393769+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:23.393769+0000","last_undegraded":"2024-05-07T11:17:23.393769+0000","last_fullsized":"2024-05-07T11:17:23.393769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:53.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'163","reported_seq":296,"reported_epoch":76,"state":"peering","last_fresh":"2024-05-07T11:17:23.394970+0000","last_change":"2024-05-07T11:17:23.394970+0000","last_active":"2024-05-07T11:17:18.395583+0000","last_peered":"2024-05-07T11:17:17.242817+0000","last_clean":"2024-05-07T11:14:24.449814+0000","last_became_active":"2024-05-07T11:14:25.512203+0000","last_became_peered":"2024-05-07T11:14:25.512203+0000","last_unstale":"2024-05-07T11:17:23.394970+0000","last_undegraded":"2024-05-07T11:17:23.394970+0000","last_fullsized":"2024-05-07T11:17:23.394970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394133+0000","last_change":"2024-05-07T11:17:18.555160+0000","last_active":"2024-05-07T11:17:23.394133+0000","last_peered":"2024-05-07T11:17:23.394133+0000","last_clean":"2024-05-07T11:17:23.394133+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:23.394133+0000","last_undegraded":"2024-05-07T11:17:23.394133+0000","last_fullsized":"2024-05-07T11:17:23.394133+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:37.962741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'166","reported_seq":519,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393837+0000","last_change":"2024-05-07T11:17:21.418540+0000","last_active":"2024-05-07T11:17:23.393837+0000","last_peered":"2024-05-07T11:17:23.393837+0000","last_clean":"2024-05-07T11:17:23.393837+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:23.393837+0000","last_undegraded":"2024-05-07T11:17:23.393837+0000","last_fullsized":"2024-05-07T11:17:23.393837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:16.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":157,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397184+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:23.397184+0000","last_peered":"2024-05-07T11:17:23.397184+0000","last_clean":"2024-05-07T11:17:23.397184+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:23.397184+0000","last_undegraded":"2024-05-07T11:17:23.397184+0000","last_fullsized":"2024-05-07T11:17:23.397184+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:17.953399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":300,"reported_epoch":76,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:23.394831+0000","last_change":"2024-05-07T11:17:19.440247+0000","last_active":"2024-05-07T11:17:23.394831+0000","last_peered":"2024-05-07T11:17:23.394831+0000","last_clean":"2024-05-07T11:14:24.442642+0000","last_became_active":"2024-05-07T11:17:19.439763+0000","last_became_peered":"2024-05-07T11:17:19.439763+0000","last_unstale":"2024-05-07T11:17:23.394831+0000","last_undegraded":"2024-05-07T11:17:19.422552+0000","last_fullsized":"2024-05-07T11:17:19.420828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":6},{"shards":"2","objects":51}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.394116+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:23.394116+0000","last_peered":"2024-05-07T11:17:23.394116+0000","last_clean":"2024-05-07T11:17:23.394116+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:23.394116+0000","last_undegraded":"2024-05-07T11:17:23.394116+0000","last_fullsized":"2024-05-07T11:17:23.394116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:24.011380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'169","reported_seq":307,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.393646+0000","last_change":"2024-05-07T11:17:22.416150+0000","last_active":"2024-05-07T11:17:23.393646+0000","last_peered":"2024-05-07T11:17:23.393646+0000","last_clean":"2024-05-07T11:17:23.393646+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:23.393646+0000","last_undegraded":"2024-05-07T11:17:23.393646+0000","last_fullsized":"2024-05-07T11:17:23.393646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:28.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397795+0000","last_change":"2024-05-07T11:17:18.504321+0000","last_active":"2024-05-07T11:17:23.397795+0000","last_peered":"2024-05-07T11:17:23.397795+0000","last_clean":"2024-05-07T11:17:23.397795+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:23.397795+0000","last_undegraded":"2024-05-07T11:17:23.397795+0000","last_fullsized":"2024-05-07T11:17:23.397795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"63'199","reported_seq":595,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:23.874613+0000","last_change":"2024-05-07T11:17:23.874777+0000","last_active":"2024-05-07T11:17:23.874613+0000","last_peered":"2024-05-07T11:17:23.874613+0000","last_clean":"2024-05-07T11:14:24.451073+0000","last_became_active":"2024-05-07T11:17:19.426840+0000","last_became_peered":"2024-05-07T11:17:19.426840+0000","last_unstale":"2024-05-07T11:17:23.874613+0000","last_undegraded":"2024-05-07T11:17:19.398884+0000","last_fullsized":"2024-05-07T11:17:19.397117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":62}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-07T11:17:23.397630+0000","last_change":"2024-05-07T11:17:18.429950+0000","last_active":"2024-05-07T11:17:23.397630+0000","last_peered":"2024-05-07T11:17:23.397630+0000","last_clean":"2024-05-07T11:17:23.397630+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:23.397630+0000","last_undegraded":"2024-05-07T11:17:23.397630+0000","last_fullsized":"2024-05-07T11:17:23.397630+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2328,"num_objects_misplaced":434,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3115,"num_bytes_recovered":10110672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62046208,"data_stored":52021508,"data_compressed":4472281,"data_compressed_allocated":5259264,"data_compressed_original":13680640,"omap_allocated":0,"internal_metadata":0},"log_size":10416,"ondisk_log_size":10416,"up":128,"acting":103,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":428,"ondisk_log_size":428,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87884,"kb_used_data":34492,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94283956,"statfs":{"total":96636764160,"available":96546770944,"internally_reserved":0,"allocated":35319808,"data_stored":57209467,"data_compressed":6730892,"data_compressed_allocated":8085504,"data_compressed_original":38760448,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710723,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68648,"kb_used_data":24412,"kb_used_omap":10,"kb_used_meta":44213,"kb_avail":94303192,"statfs":{"total":96636764160,"available":96566468608,"internally_reserved":0,"allocated":24997888,"data_stored":46562034,"data_compressed":5505454,"data_compressed_allocated":6463488,"data_compressed_original":33083392,"omap_allocated":10404,"internal_metadata":45274972},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49520,"kb_used_data":18344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322320,"statfs":{"total":96636764160,"available":96586055680,"internally_reserved":0,"allocated":18784256,"data_stored":32832218,"data_compressed":4426861,"data_compressed_allocated":5206016,"data_compressed_original":24207360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15187968,"data_stored":12540098,"data_compressed":1440329,"data_compressed_allocated":1683456,"data_compressed_original":4333568,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19030016,"data_stored":16315709,"data_compressed":1057885,"data_compressed_allocated":1261568,"data_compressed_original":3276800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27828224,"data_stored":23165701,"data_compressed":1974067,"data_compressed_allocated":2314240,"data_compressed_original":6070272,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:30.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:30.739 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:30.741 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:30.751 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-05-07T11:17:30.401187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1076,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4597,"num_bytes_recovered":51004951,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11001,"ondisk_log_size":11001,"up":210,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":230,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":202336,"kb_used_data":81840,"kb_used_omap":13,"kb_used_meta":120434,"kb_avail":282913184,"statfs":{"total":289910292480,"available":289703100416,"internally_reserved":0,"allocated":83804160,"data_stored":139847389,"data_compressed":17048821,"data_compressed_allocated":20246528,"data_compressed_original":97673216,"omap_allocated":13594,"internal_metadata":123325158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1252,"num_objects_misplaced":-434,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1460,"num_bytes_recovered":3475983,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002971"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":296,"reported_epoch":79,"state":"peering","last_fresh":"2024-05-07T11:17:26.402440+0000","last_change":"2024-05-07T11:17:26.402440+0000","last_active":"2024-05-07T11:17:18.397196+0000","last_peered":"2024-05-07T11:17:17.245209+0000","last_clean":"2024-05-07T11:14:24.364900+0000","last_became_active":"2024-05-07T11:14:25.513102+0000","last_became_peered":"2024-05-07T11:14:25.513102+0000","last_unstale":"2024-05-07T11:17:26.402440+0000","last_undegraded":"2024-05-07T11:17:26.402440+0000","last_fullsized":"2024-05-07T11:17:26.402440+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'155","reported_seq":301,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403233+0000","last_change":"2024-05-07T11:17:21.419253+0000","last_active":"2024-05-07T11:17:26.403233+0000","last_peered":"2024-05-07T11:17:26.403233+0000","last_clean":"2024-05-07T11:17:26.403233+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:26.403233+0000","last_undegraded":"2024-05-07T11:17:26.403233+0000","last_fullsized":"2024-05-07T11:17:26.403233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:45:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'169","reported_seq":509,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.408003+0000","last_change":"2024-05-07T11:17:26.408003+0000","last_active":"2024-05-07T11:17:26.408003+0000","last_peered":"2024-05-07T11:17:26.408003+0000","last_clean":"2024-05-07T11:17:26.408003+0000","last_became_active":"2024-05-07T11:17:26.407269+0000","last_became_peered":"2024-05-07T11:17:26.407269+0000","last_unstale":"2024-05-07T11:17:26.408003+0000","last_undegraded":"2024-05-07T11:17:26.408003+0000","last_fullsized":"2024-05-07T11:17:26.408003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:01.664780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":75254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":266,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400803+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:26.400803+0000","last_peered":"2024-05-07T11:17:26.400803+0000","last_clean":"2024-05-07T11:17:26.400803+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:26.400803+0000","last_undegraded":"2024-05-07T11:17:26.400803+0000","last_fullsized":"2024-05-07T11:17:26.400803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"63'186","reported_seq":332,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402666+0000","last_change":"2024-05-07T11:17:21.419034+0000","last_active":"2024-05-07T11:17:26.402666+0000","last_peered":"2024-05-07T11:17:26.402666+0000","last_clean":"2024-05-07T11:17:26.402666+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:26.402666+0000","last_undegraded":"2024-05-07T11:17:26.402666+0000","last_fullsized":"2024-05-07T11:17:26.402666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:42.536445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":257,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.400180+0000","last_change":"2024-05-07T11:17:22.419149+0000","last_active":"2024-05-07T11:17:26.400180+0000","last_peered":"2024-05-07T11:17:26.400180+0000","last_clean":"2024-05-07T11:14:24.385916+0000","last_became_active":"2024-05-07T11:17:22.416956+0000","last_became_peered":"2024-05-07T11:17:22.416956+0000","last_unstale":"2024-05-07T11:17:26.400180+0000","last_undegraded":"2024-05-07T11:17:22.411982+0000","last_fullsized":"2024-05-07T11:17:22.411747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":108,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":42}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"63'166","reported_seq":261,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399913+0000","last_change":"2024-05-07T11:17:22.418934+0000","last_active":"2024-05-07T11:17:26.399913+0000","last_peered":"2024-05-07T11:17:26.399913+0000","last_clean":"2024-05-07T11:17:26.399913+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:26.399913+0000","last_undegraded":"2024-05-07T11:17:26.399913+0000","last_fullsized":"2024-05-07T11:17:26.399913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:05.143462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":455,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400835+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:26.400835+0000","last_peered":"2024-05-07T11:17:26.400835+0000","last_clean":"2024-05-07T11:17:26.400835+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:26.400835+0000","last_undegraded":"2024-05-07T11:17:26.400835+0000","last_fullsized":"2024-05-07T11:17:26.400835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:04.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":235,"reported_epoch":79,"state":"peering","last_fresh":"2024-05-07T11:17:25.443661+0000","last_change":"2024-05-07T11:17:27.036289+0000","last_active":"2024-05-07T11:17:27.036289+0000","last_peered":"2024-05-07T11:17:25.443661+0000","last_clean":"2024-05-07T11:14:24.451837+0000","last_became_active":"2024-05-07T11:17:19.435835+0000","last_became_peered":"2024-05-07T11:17:19.435835+0000","last_unstale":"2024-05-07T11:17:25.443661+0000","last_undegraded":"2024-05-07T11:17:25.443661+0000","last_fullsized":"2024-05-07T11:17:19.410369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":631133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"63'156","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403131+0000","last_change":"2024-05-07T11:17:22.416801+0000","last_active":"2024-05-07T11:17:26.403131+0000","last_peered":"2024-05-07T11:17:26.403131+0000","last_clean":"2024-05-07T11:17:26.403131+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:26.403131+0000","last_undegraded":"2024-05-07T11:17:26.403131+0000","last_fullsized":"2024-05-07T11:17:26.403131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:07.028486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'154","reported_seq":442,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400961+0000","last_change":"2024-05-07T11:17:22.419089+0000","last_active":"2024-05-07T11:17:26.400961+0000","last_peered":"2024-05-07T11:17:26.400961+0000","last_clean":"2024-05-07T11:17:26.400961+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:26.400961+0000","last_undegraded":"2024-05-07T11:17:26.400961+0000","last_fullsized":"2024-05-07T11:17:26.400961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:57.833385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":459,"reported_epoch":79,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:26.554445+0000","last_change":"2024-05-07T11:17:26.554588+0000","last_active":"2024-05-07T11:17:26.554445+0000","last_peered":"2024-05-07T11:17:26.554445+0000","last_clean":"2024-05-07T11:14:24.417671+0000","last_became_active":"2024-05-07T11:17:19.435011+0000","last_became_peered":"2024-05-07T11:17:19.435011+0000","last_unstale":"2024-05-07T11:17:26.554445+0000","last_undegraded":"2024-05-07T11:17:26.554445+0000","last_fullsized":"2024-05-07T11:17:19.412423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":89602,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":53}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"63'136","reported_seq":283,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402852+0000","last_change":"2024-05-07T11:17:23.398879+0000","last_active":"2024-05-07T11:17:26.402852+0000","last_peered":"2024-05-07T11:17:26.402852+0000","last_clean":"2024-05-07T11:17:26.402852+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:26.402852+0000","last_undegraded":"2024-05-07T11:17:26.402852+0000","last_fullsized":"2024-05-07T11:17:26.402852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:33:07.091905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'175","reported_seq":525,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.408334+0000","last_change":"2024-05-07T11:17:26.407920+0000","last_active":"2024-05-07T11:17:26.408334+0000","last_peered":"2024-05-07T11:17:26.408334+0000","last_clean":"2024-05-07T11:17:26.408334+0000","last_became_active":"2024-05-07T11:17:26.407342+0000","last_became_peered":"2024-05-07T11:17:26.407342+0000","last_unstale":"2024-05-07T11:17:26.408334+0000","last_undegraded":"2024-05-07T11:17:26.408334+0000","last_fullsized":"2024-05-07T11:17:26.408334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:55:22.847728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":196945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":523,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400015+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:26.400015+0000","last_peered":"2024-05-07T11:17:26.400015+0000","last_clean":"2024-05-07T11:17:26.400015+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:26.400015+0000","last_undegraded":"2024-05-07T11:17:26.400015+0000","last_fullsized":"2024-05-07T11:17:26.400015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:30:48.688430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":260,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.401800+0000","last_change":"2024-05-07T11:17:22.420019+0000","last_active":"2024-05-07T11:17:26.401800+0000","last_peered":"2024-05-07T11:17:26.401800+0000","last_clean":"2024-05-07T11:14:24.378895+0000","last_became_active":"2024-05-07T11:17:22.418850+0000","last_became_peered":"2024-05-07T11:17:22.418850+0000","last_unstale":"2024-05-07T11:17:26.401800+0000","last_undegraded":"2024-05-07T11:17:22.412415+0000","last_fullsized":"2024-05-07T11:17:22.412148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":113,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'161","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400901+0000","last_change":"2024-05-07T11:17:22.416613+0000","last_active":"2024-05-07T11:17:26.400901+0000","last_peered":"2024-05-07T11:17:26.400901+0000","last_clean":"2024-05-07T11:17:26.400901+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:26.400901+0000","last_undegraded":"2024-05-07T11:17:26.400901+0000","last_fullsized":"2024-05-07T11:17:26.400901+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"63'148","reported_seq":294,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403084+0000","last_change":"2024-05-07T11:17:21.418472+0000","last_active":"2024-05-07T11:17:26.403084+0000","last_peered":"2024-05-07T11:17:26.403084+0000","last_clean":"2024-05-07T11:17:26.403084+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:26.403084+0000","last_undegraded":"2024-05-07T11:17:26.403084+0000","last_fullsized":"2024-05-07T11:17:26.403084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:18.184681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'147","reported_seq":229,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400153+0000","last_change":"2024-05-07T11:17:21.418164+0000","last_active":"2024-05-07T11:17:26.400153+0000","last_peered":"2024-05-07T11:17:26.400153+0000","last_clean":"2024-05-07T11:17:26.400153+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:26.400153+0000","last_undegraded":"2024-05-07T11:17:26.400153+0000","last_fullsized":"2024-05-07T11:17:26.400153+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":334,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.400925+0000","last_change":"2024-05-07T11:17:19.439196+0000","last_active":"2024-05-07T11:17:26.400925+0000","last_peered":"2024-05-07T11:17:26.400925+0000","last_clean":"2024-05-07T11:14:24.396282+0000","last_became_active":"2024-05-07T11:17:19.437184+0000","last_became_peered":"2024-05-07T11:17:19.437184+0000","last_unstale":"2024-05-07T11:17:26.400925+0000","last_undegraded":"2024-05-07T11:17:19.422229+0000","last_fullsized":"2024-05-07T11:17:19.419110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":112,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":297,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400252+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:26.400252+0000","last_peered":"2024-05-07T11:17:26.400252+0000","last_clean":"2024-05-07T11:17:26.400252+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:26.400252+0000","last_undegraded":"2024-05-07T11:17:26.400252+0000","last_fullsized":"2024-05-07T11:17:26.400252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":310,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.399857+0000","last_change":"2024-05-07T11:17:19.439396+0000","last_active":"2024-05-07T11:17:26.399857+0000","last_peered":"2024-05-07T11:17:26.399857+0000","last_clean":"2024-05-07T11:14:24.332238+0000","last_became_active":"2024-05-07T11:17:19.434809+0000","last_became_peered":"2024-05-07T11:17:19.434809+0000","last_unstale":"2024-05-07T11:17:26.399857+0000","last_undegraded":"2024-05-07T11:17:19.410512+0000","last_fullsized":"2024-05-07T11:17:19.407581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":101,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":7}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"63'159","reported_seq":239,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399454+0000","last_change":"2024-05-07T11:17:21.418519+0000","last_active":"2024-05-07T11:17:26.399454+0000","last_peered":"2024-05-07T11:17:26.399454+0000","last_clean":"2024-05-07T11:17:26.399454+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:26.399454+0000","last_undegraded":"2024-05-07T11:17:26.399454+0000","last_fullsized":"2024-05-07T11:17:26.399454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"63'169","reported_seq":315,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402518+0000","last_change":"2024-05-07T11:17:21.414896+0000","last_active":"2024-05-07T11:17:26.402518+0000","last_peered":"2024-05-07T11:17:26.402518+0000","last_clean":"2024-05-07T11:17:26.402518+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:26.402518+0000","last_undegraded":"2024-05-07T11:17:26.402518+0000","last_fullsized":"2024-05-07T11:17:26.402518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:52.242314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":294,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403184+0000","last_change":"2024-05-07T11:17:24.407028+0000","last_active":"2024-05-07T11:17:26.403184+0000","last_peered":"2024-05-07T11:17:26.403184+0000","last_clean":"2024-05-07T11:17:26.403184+0000","last_became_active":"2024-05-07T11:17:24.406307+0000","last_became_peered":"2024-05-07T11:17:24.406307+0000","last_unstale":"2024-05-07T11:17:26.403184+0000","last_undegraded":"2024-05-07T11:17:26.403184+0000","last_fullsized":"2024-05-07T11:17:26.403184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:24.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":230897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'195","reported_seq":337,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400507+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:17:26.400507+0000","last_peered":"2024-05-07T11:17:26.400507+0000","last_clean":"2024-05-07T11:17:26.400507+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:26.400507+0000","last_undegraded":"2024-05-07T11:17:26.400507+0000","last_fullsized":"2024-05-07T11:17:26.400507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":279,"reported_epoch":79,"state":"active+recovery_wait+degraded","last_fresh":"2024-05-07T11:17:26.401090+0000","last_change":"2024-05-07T11:17:23.403843+0000","last_active":"2024-05-07T11:17:26.401090+0000","last_peered":"2024-05-07T11:17:26.401090+0000","last_clean":"2024-05-07T11:14:24.294325+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:26.401090+0000","last_undegraded":"2024-05-07T11:17:23.394924+0000","last_fullsized":"2024-05-07T11:17:26.401090+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":91,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":476,"reported_epoch":79,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:27.015247+0000","last_change":"2024-05-07T11:17:27.015404+0000","last_active":"2024-05-07T11:17:27.015247+0000","last_peered":"2024-05-07T11:17:27.015247+0000","last_clean":"2024-05-07T11:14:24.430825+0000","last_became_active":"2024-05-07T11:17:19.436245+0000","last_became_peered":"2024-05-07T11:17:19.436245+0000","last_unstale":"2024-05-07T11:17:27.015247+0000","last_undegraded":"2024-05-07T11:17:27.015247+0000","last_fullsized":"2024-05-07T11:17:19.414331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":211687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":48}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":239,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399735+0000","last_change":"2024-05-07T11:17:24.403807+0000","last_active":"2024-05-07T11:17:26.399735+0000","last_peered":"2024-05-07T11:17:26.399735+0000","last_clean":"2024-05-07T11:17:26.399735+0000","last_became_active":"2024-05-07T11:17:24.403179+0000","last_became_peered":"2024-05-07T11:17:24.403179+0000","last_unstale":"2024-05-07T11:17:26.399735+0000","last_undegraded":"2024-05-07T11:17:26.399735+0000","last_fullsized":"2024-05-07T11:17:26.399735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:15:55.499366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":330,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.400145+0000","last_change":"2024-05-07T11:17:19.439496+0000","last_active":"2024-05-07T11:17:26.400145+0000","last_peered":"2024-05-07T11:17:26.400145+0000","last_clean":"2024-05-07T11:14:24.440580+0000","last_became_active":"2024-05-07T11:17:19.435641+0000","last_became_peered":"2024-05-07T11:17:19.435641+0000","last_unstale":"2024-05-07T11:17:26.400145+0000","last_undegraded":"2024-05-07T11:17:19.416557+0000","last_fullsized":"2024-05-07T11:17:19.412853+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":114,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"63'192","reported_seq":578,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399596+0000","last_change":"2024-05-07T11:17:22.416120+0000","last_active":"2024-05-07T11:17:26.399596+0000","last_peered":"2024-05-07T11:17:26.399596+0000","last_clean":"2024-05-07T11:17:26.399596+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:26.399596+0000","last_undegraded":"2024-05-07T11:17:26.399596+0000","last_fullsized":"2024-05-07T11:17:26.399596+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:13.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"63'185","reported_seq":568,"reported_epoch":79,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:26.805194+0000","last_change":"2024-05-07T11:17:26.805356+0000","last_active":"2024-05-07T11:17:26.805194+0000","last_peered":"2024-05-07T11:17:26.805194+0000","last_clean":"2024-05-07T11:14:24.357156+0000","last_became_active":"2024-05-07T11:17:19.437340+0000","last_became_peered":"2024-05-07T11:17:19.437340+0000","last_unstale":"2024-05-07T11:17:26.805194+0000","last_undegraded":"2024-05-07T11:17:19.420606+0000","last_fullsized":"2024-05-07T11:17:19.414996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":459999,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":56}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'156","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402622+0000","last_change":"2024-05-07T11:17:22.416165+0000","last_active":"2024-05-07T11:17:26.402622+0000","last_peered":"2024-05-07T11:17:26.402622+0000","last_clean":"2024-05-07T11:17:26.402622+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:26.402622+0000","last_undegraded":"2024-05-07T11:17:26.402622+0000","last_fullsized":"2024-05-07T11:17:26.402622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:57.237765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":269,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400651+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:26.400651+0000","last_peered":"2024-05-07T11:17:26.400651+0000","last_clean":"2024-05-07T11:17:26.400651+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:26.400651+0000","last_undegraded":"2024-05-07T11:17:26.400651+0000","last_fullsized":"2024-05-07T11:17:26.400651+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"63'141","reported_seq":287,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403041+0000","last_change":"2024-05-07T11:17:21.419206+0000","last_active":"2024-05-07T11:17:26.403041+0000","last_peered":"2024-05-07T11:17:26.403041+0000","last_clean":"2024-05-07T11:17:26.403041+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:26.403041+0000","last_undegraded":"2024-05-07T11:17:26.403041+0000","last_fullsized":"2024-05-07T11:17:26.403041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:12.679336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399720+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:26.399720+0000","last_peered":"2024-05-07T11:17:26.399720+0000","last_clean":"2024-05-07T11:17:26.399720+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:26.399720+0000","last_undegraded":"2024-05-07T11:17:26.399720+0000","last_fullsized":"2024-05-07T11:17:26.399720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.025763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"63'179","reported_seq":259,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400291+0000","last_change":"2024-05-07T11:17:21.419284+0000","last_active":"2024-05-07T11:17:26.400291+0000","last_peered":"2024-05-07T11:17:26.400291+0000","last_clean":"2024-05-07T11:17:26.400291+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:26.400291+0000","last_undegraded":"2024-05-07T11:17:26.400291+0000","last_fullsized":"2024-05-07T11:17:26.400291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:54.463898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402145+0000","last_change":"2024-05-07T11:17:18.423604+0000","last_active":"2024-05-07T11:17:26.402145+0000","last_peered":"2024-05-07T11:17:26.402145+0000","last_clean":"2024-05-07T11:17:26.402145+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:26.402145+0000","last_undegraded":"2024-05-07T11:17:26.402145+0000","last_fullsized":"2024-05-07T11:17:26.402145+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:45:28.650148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":236,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400727+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:26.400727+0000","last_peered":"2024-05-07T11:17:26.400727+0000","last_clean":"2024-05-07T11:17:26.400727+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:26.400727+0000","last_undegraded":"2024-05-07T11:17:26.400727+0000","last_fullsized":"2024-05-07T11:17:26.400727+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":157,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401379+0000","last_change":"2024-05-07T11:17:18.433027+0000","last_active":"2024-05-07T11:17:26.401379+0000","last_peered":"2024-05-07T11:17:26.401379+0000","last_clean":"2024-05-07T11:17:26.401379+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:26.401379+0000","last_undegraded":"2024-05-07T11:17:26.401379+0000","last_fullsized":"2024-05-07T11:17:26.401379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:47.068504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402746+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:26.402746+0000","last_peered":"2024-05-07T11:17:26.402746+0000","last_clean":"2024-05-07T11:17:26.402746+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:26.402746+0000","last_undegraded":"2024-05-07T11:17:26.402746+0000","last_fullsized":"2024-05-07T11:17:26.402746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:35:51.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'155","reported_seq":421,"reported_epoch":78,"state":"peering","last_fresh":"2024-05-07T11:17:25.877887+0000","last_change":"2024-05-07T11:17:26.400307+0000","last_active":"2024-05-07T11:17:26.400307+0000","last_peered":"2024-05-07T11:17:25.877887+0000","last_clean":"2024-05-07T11:14:24.400453+0000","last_became_active":"2024-05-07T11:17:19.433702+0000","last_became_peered":"2024-05-07T11:17:19.433702+0000","last_unstale":"2024-05-07T11:17:25.877887+0000","last_undegraded":"2024-05-07T11:17:25.877887+0000","last_fullsized":"2024-05-07T11:17:19.399778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":166862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403020+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:26.403020+0000","last_peered":"2024-05-07T11:17:26.403020+0000","last_clean":"2024-05-07T11:17:26.403020+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:26.403020+0000","last_undegraded":"2024-05-07T11:17:26.403020+0000","last_fullsized":"2024-05-07T11:17:26.403020+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:16.479879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'167","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402022+0000","last_change":"2024-05-07T11:17:21.418782+0000","last_active":"2024-05-07T11:17:26.402022+0000","last_peered":"2024-05-07T11:17:26.402022+0000","last_clean":"2024-05-07T11:17:26.402022+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:26.402022+0000","last_undegraded":"2024-05-07T11:17:26.402022+0000","last_fullsized":"2024-05-07T11:17:26.402022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:13.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401717+0000","last_change":"2024-05-07T11:17:22.419069+0000","last_active":"2024-05-07T11:17:26.401717+0000","last_peered":"2024-05-07T11:17:26.401717+0000","last_clean":"2024-05-07T11:17:26.401717+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:26.401717+0000","last_undegraded":"2024-05-07T11:17:26.401717+0000","last_fullsized":"2024-05-07T11:17:26.401717+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:20.890067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":308,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.400630+0000","last_change":"2024-05-07T11:17:19.439572+0000","last_active":"2024-05-07T11:17:26.400630+0000","last_peered":"2024-05-07T11:17:26.400630+0000","last_clean":"2024-05-07T11:14:24.352569+0000","last_became_active":"2024-05-07T11:17:19.437369+0000","last_became_peered":"2024-05-07T11:17:19.437369+0000","last_unstale":"2024-05-07T11:17:26.400630+0000","last_undegraded":"2024-05-07T11:17:19.420446+0000","last_fullsized":"2024-05-07T11:17:19.417984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401371+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:26.401371+0000","last_peered":"2024-05-07T11:17:26.401371+0000","last_clean":"2024-05-07T11:17:26.401371+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:26.401371+0000","last_undegraded":"2024-05-07T11:17:26.401371+0000","last_fullsized":"2024-05-07T11:17:26.401371+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:31:28.580245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"63'164","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399908+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:17:26.399908+0000","last_peered":"2024-05-07T11:17:26.399908+0000","last_clean":"2024-05-07T11:17:26.399908+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:26.399908+0000","last_undegraded":"2024-05-07T11:17:26.399908+0000","last_fullsized":"2024-05-07T11:17:26.399908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399948+0000","last_change":"2024-05-07T11:17:18.450923+0000","last_active":"2024-05-07T11:17:26.399948+0000","last_peered":"2024-05-07T11:17:26.399948+0000","last_clean":"2024-05-07T11:17:26.399948+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:26.399948+0000","last_undegraded":"2024-05-07T11:17:26.399948+0000","last_fullsized":"2024-05-07T11:17:26.399948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:38.864461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"63'172","reported_seq":354,"reported_epoch":79,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:27.042411+0000","last_change":"2024-05-07T11:17:27.016039+0000","last_active":"2024-05-07T11:17:27.042411+0000","last_peered":"2024-05-07T11:17:27.042411+0000","last_clean":"2024-05-07T11:14:24.436962+0000","last_became_active":"2024-05-07T11:17:19.438026+0000","last_became_peered":"2024-05-07T11:17:19.438026+0000","last_unstale":"2024-05-07T11:17:27.042411+0000","last_undegraded":"2024-05-07T11:17:19.423429+0000","last_fullsized":"2024-05-07T11:17:19.419186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":46,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":33286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":142,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401707+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:26.401707+0000","last_peered":"2024-05-07T11:17:26.401707+0000","last_clean":"2024-05-07T11:17:26.401707+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:26.401707+0000","last_undegraded":"2024-05-07T11:17:26.401707+0000","last_fullsized":"2024-05-07T11:17:26.401707+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"63'163","reported_seq":505,"reported_epoch":78,"state":"peering","last_fresh":"2024-05-07T11:17:25.648218+0000","last_change":"2024-05-07T11:17:26.402717+0000","last_active":"2024-05-07T11:17:26.402717+0000","last_peered":"2024-05-07T11:17:25.648218+0000","last_clean":"2024-05-07T11:14:24.493593+0000","last_became_active":"2024-05-07T11:17:19.436403+0000","last_became_peered":"2024-05-07T11:17:19.436403+0000","last_unstale":"2024-05-07T11:17:25.648218+0000","last_undegraded":"2024-05-07T11:17:25.648218+0000","last_fullsized":"2024-05-07T11:17:19.416685+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":119690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401969+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:26.401969+0000","last_peered":"2024-05-07T11:17:26.401969+0000","last_clean":"2024-05-07T11:17:26.401969+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:26.401969+0000","last_undegraded":"2024-05-07T11:17:26.401969+0000","last_fullsized":"2024-05-07T11:17:26.401969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:47.689436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'137","reported_seq":465,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401217+0000","last_change":"2024-05-07T11:17:24.403787+0000","last_active":"2024-05-07T11:17:26.401217+0000","last_peered":"2024-05-07T11:17:26.401217+0000","last_clean":"2024-05-07T11:17:26.401217+0000","last_became_active":"2024-05-07T11:17:24.403279+0000","last_became_peered":"2024-05-07T11:17:24.403279+0000","last_unstale":"2024-05-07T11:17:26.401217+0000","last_undegraded":"2024-05-07T11:17:26.401217+0000","last_fullsized":"2024-05-07T11:17:26.401217+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:42.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":111,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402750+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:26.402750+0000","last_peered":"2024-05-07T11:17:26.402750+0000","last_clean":"2024-05-07T11:17:26.402750+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:26.402750+0000","last_undegraded":"2024-05-07T11:17:26.402750+0000","last_fullsized":"2024-05-07T11:17:26.402750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:59.411938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'141","reported_seq":467,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400846+0000","last_change":"2024-05-07T11:17:22.417126+0000","last_active":"2024-05-07T11:17:26.400846+0000","last_peered":"2024-05-07T11:17:26.400846+0000","last_clean":"2024-05-07T11:17:26.400846+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:26.400846+0000","last_undegraded":"2024-05-07T11:17:26.400846+0000","last_fullsized":"2024-05-07T11:17:26.400846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":351,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401898+0000","last_change":"2024-05-07T11:17:18.433863+0000","last_active":"2024-05-07T11:17:26.401898+0000","last_peered":"2024-05-07T11:17:26.401898+0000","last_clean":"2024-05-07T11:17:26.401898+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:26.401898+0000","last_undegraded":"2024-05-07T11:17:26.401898+0000","last_fullsized":"2024-05-07T11:17:26.401898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:10.515455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400715+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:26.400715+0000","last_peered":"2024-05-07T11:17:26.400715+0000","last_clean":"2024-05-07T11:17:26.400715+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:26.400715+0000","last_undegraded":"2024-05-07T11:17:26.400715+0000","last_fullsized":"2024-05-07T11:17:26.400715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:03:02.539869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399588+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:26.399588+0000","last_peered":"2024-05-07T11:17:26.399588+0000","last_clean":"2024-05-07T11:17:26.399588+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:26.399588+0000","last_undegraded":"2024-05-07T11:17:26.399588+0000","last_fullsized":"2024-05-07T11:17:26.399588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":274,"reported_epoch":79,"state":"active+recovery_wait+degraded","last_fresh":"2024-05-07T11:17:26.401457+0000","last_change":"2024-05-07T11:17:23.403839+0000","last_active":"2024-05-07T11:17:26.401457+0000","last_peered":"2024-05-07T11:17:26.401457+0000","last_clean":"2024-05-07T11:14:24.305202+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:26.401457+0000","last_undegraded":"2024-05-07T11:17:23.396611+0000","last_fullsized":"2024-05-07T11:17:26.401457+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":52}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401804+0000","last_change":"2024-05-07T11:17:18.433452+0000","last_active":"2024-05-07T11:17:26.401804+0000","last_peered":"2024-05-07T11:17:26.401804+0000","last_clean":"2024-05-07T11:17:26.401804+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:26.401804+0000","last_undegraded":"2024-05-07T11:17:26.401804+0000","last_fullsized":"2024-05-07T11:17:26.401804+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:26.663080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":212,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399772+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:17:26.399772+0000","last_peered":"2024-05-07T11:17:26.399772+0000","last_clean":"2024-05-07T11:17:26.399772+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:26.399772+0000","last_undegraded":"2024-05-07T11:17:26.399772+0000","last_fullsized":"2024-05-07T11:17:26.399772+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"63'160","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402773+0000","last_change":"2024-05-07T11:17:24.407000+0000","last_active":"2024-05-07T11:17:26.402773+0000","last_peered":"2024-05-07T11:17:26.402773+0000","last_clean":"2024-05-07T11:17:26.402773+0000","last_became_active":"2024-05-07T11:17:24.406306+0000","last_became_peered":"2024-05-07T11:17:24.406306+0000","last_unstale":"2024-05-07T11:17:26.402773+0000","last_undegraded":"2024-05-07T11:17:26.402773+0000","last_fullsized":"2024-05-07T11:17:26.402773+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:56:56.763708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":402414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399853+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:26.399853+0000","last_peered":"2024-05-07T11:17:26.399853+0000","last_clean":"2024-05-07T11:17:26.399853+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:26.399853+0000","last_undegraded":"2024-05-07T11:17:26.399853+0000","last_fullsized":"2024-05-07T11:17:26.399853+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:20.744525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402263+0000","last_change":"2024-05-07T11:17:18.572639+0000","last_active":"2024-05-07T11:17:26.402263+0000","last_peered":"2024-05-07T11:17:26.402263+0000","last_clean":"2024-05-07T11:17:26.402263+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:26.402263+0000","last_undegraded":"2024-05-07T11:17:26.402263+0000","last_fullsized":"2024-05-07T11:17:26.402263+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:15.538158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":241,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.408479+0000","last_change":"2024-05-07T11:17:26.407965+0000","last_active":"2024-05-07T11:17:26.408479+0000","last_peered":"2024-05-07T11:17:26.408479+0000","last_clean":"2024-05-07T11:17:26.408479+0000","last_became_active":"2024-05-07T11:17:26.407203+0000","last_became_peered":"2024-05-07T11:17:26.407203+0000","last_unstale":"2024-05-07T11:17:26.408479+0000","last_undegraded":"2024-05-07T11:17:26.408479+0000","last_fullsized":"2024-05-07T11:17:26.408479+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:50.842472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":384377,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401803+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:26.401803+0000","last_peered":"2024-05-07T11:17:26.401803+0000","last_clean":"2024-05-07T11:17:26.401803+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:26.401803+0000","last_undegraded":"2024-05-07T11:17:26.401803+0000","last_fullsized":"2024-05-07T11:17:26.401803+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":154,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400566+0000","last_change":"2024-05-07T11:17:18.404539+0000","last_active":"2024-05-07T11:17:26.400566+0000","last_peered":"2024-05-07T11:17:26.400566+0000","last_clean":"2024-05-07T11:17:26.400566+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:26.400566+0000","last_undegraded":"2024-05-07T11:17:26.400566+0000","last_fullsized":"2024-05-07T11:17:26.400566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:50.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":225,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400120+0000","last_change":"2024-05-07T11:17:25.412664+0000","last_active":"2024-05-07T11:17:26.400120+0000","last_peered":"2024-05-07T11:17:26.400120+0000","last_clean":"2024-05-07T11:17:26.400120+0000","last_became_active":"2024-05-07T11:17:25.412026+0000","last_became_peered":"2024-05-07T11:17:25.412026+0000","last_unstale":"2024-05-07T11:17:26.400120+0000","last_undegraded":"2024-05-07T11:17:26.400120+0000","last_fullsized":"2024-05-07T11:17:26.400120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:19:28.465664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":174891,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401809+0000","last_change":"2024-05-07T11:17:22.424750+0000","last_active":"2024-05-07T11:17:26.401809+0000","last_peered":"2024-05-07T11:17:26.401809+0000","last_clean":"2024-05-07T11:17:26.401809+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:26.401809+0000","last_undegraded":"2024-05-07T11:17:26.401809+0000","last_fullsized":"2024-05-07T11:17:26.401809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:12.283160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400199+0000","last_change":"2024-05-07T11:17:18.433137+0000","last_active":"2024-05-07T11:17:26.400199+0000","last_peered":"2024-05-07T11:17:26.400199+0000","last_clean":"2024-05-07T11:17:26.400199+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:26.400199+0000","last_undegraded":"2024-05-07T11:17:26.400199+0000","last_fullsized":"2024-05-07T11:17:26.400199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:40.770823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":303,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.399863+0000","last_change":"2024-05-07T11:17:19.439272+0000","last_active":"2024-05-07T11:17:26.399863+0000","last_peered":"2024-05-07T11:17:26.399863+0000","last_clean":"2024-05-07T11:14:24.425940+0000","last_became_active":"2024-05-07T11:17:19.434379+0000","last_became_peered":"2024-05-07T11:17:19.434379+0000","last_unstale":"2024-05-07T11:17:26.399863+0000","last_undegraded":"2024-05-07T11:17:19.403485+0000","last_fullsized":"2024-05-07T11:17:19.397696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400101+0000","last_change":"2024-05-07T11:17:18.431763+0000","last_active":"2024-05-07T11:17:26.400101+0000","last_peered":"2024-05-07T11:17:26.400101+0000","last_clean":"2024-05-07T11:17:26.400101+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:26.400101+0000","last_undegraded":"2024-05-07T11:17:26.400101+0000","last_fullsized":"2024-05-07T11:17:26.400101+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:38.234395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403248+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:26.403248+0000","last_peered":"2024-05-07T11:17:26.403248+0000","last_clean":"2024-05-07T11:17:26.403248+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:26.403248+0000","last_undegraded":"2024-05-07T11:17:26.403248+0000","last_fullsized":"2024-05-07T11:17:26.403248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:54.609817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'181","reported_seq":323,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402147+0000","last_change":"2024-05-07T11:17:23.399296+0000","last_active":"2024-05-07T11:17:26.402147+0000","last_peered":"2024-05-07T11:17:26.402147+0000","last_clean":"2024-05-07T11:17:26.402147+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:26.402147+0000","last_undegraded":"2024-05-07T11:17:26.402147+0000","last_fullsized":"2024-05-07T11:17:26.402147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:21.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401542+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:26.401542+0000","last_peered":"2024-05-07T11:17:26.401542+0000","last_clean":"2024-05-07T11:17:26.401542+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:26.401542+0000","last_undegraded":"2024-05-07T11:17:26.401542+0000","last_fullsized":"2024-05-07T11:17:26.401542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:03.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400407+0000","last_change":"2024-05-07T11:17:18.432358+0000","last_active":"2024-05-07T11:17:26.400407+0000","last_peered":"2024-05-07T11:17:26.400407+0000","last_clean":"2024-05-07T11:17:26.400407+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:26.400407+0000","last_undegraded":"2024-05-07T11:17:26.400407+0000","last_fullsized":"2024-05-07T11:17:26.400407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:36.281521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"63'175","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400661+0000","last_change":"2024-05-07T11:17:22.420080+0000","last_active":"2024-05-07T11:17:26.400661+0000","last_peered":"2024-05-07T11:17:26.400661+0000","last_clean":"2024-05-07T11:17:26.400661+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:26.400661+0000","last_undegraded":"2024-05-07T11:17:26.400661+0000","last_fullsized":"2024-05-07T11:17:26.400661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:41.233935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'38","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400317+0000","last_change":"2024-05-07T11:17:18.459674+0000","last_active":"2024-05-07T11:17:26.400317+0000","last_peered":"2024-05-07T11:17:26.400317+0000","last_clean":"2024-05-07T11:17:26.400317+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:26.400317+0000","last_undegraded":"2024-05-07T11:17:26.400317+0000","last_fullsized":"2024-05-07T11:17:26.400317+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:35.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":155,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402846+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:26.402846+0000","last_peered":"2024-05-07T11:17:26.402846+0000","last_clean":"2024-05-07T11:17:26.402846+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:26.402846+0000","last_undegraded":"2024-05-07T11:17:26.402846+0000","last_fullsized":"2024-05-07T11:17:26.402846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:14.650941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'138","reported_seq":282,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402265+0000","last_change":"2024-05-07T11:17:22.417629+0000","last_active":"2024-05-07T11:17:26.402265+0000","last_peered":"2024-05-07T11:17:26.402265+0000","last_clean":"2024-05-07T11:17:26.402265+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:26.402265+0000","last_undegraded":"2024-05-07T11:17:26.402265+0000","last_fullsized":"2024-05-07T11:17:26.402265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:58.760049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'164","reported_seq":502,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400221+0000","last_change":"2024-05-07T11:17:23.400613+0000","last_active":"2024-05-07T11:17:26.400221+0000","last_peered":"2024-05-07T11:17:26.400221+0000","last_clean":"2024-05-07T11:17:26.400221+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:26.400221+0000","last_undegraded":"2024-05-07T11:17:26.400221+0000","last_fullsized":"2024-05-07T11:17:26.400221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:28.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":200,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401407+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:26.401407+0000","last_peered":"2024-05-07T11:17:26.401407+0000","last_clean":"2024-05-07T11:17:26.401407+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:26.401407+0000","last_undegraded":"2024-05-07T11:17:26.401407+0000","last_fullsized":"2024-05-07T11:17:26.401407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:35.832524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":220,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399801+0000","last_change":"2024-05-07T11:17:25.413137+0000","last_active":"2024-05-07T11:17:26.399801+0000","last_peered":"2024-05-07T11:17:26.399801+0000","last_clean":"2024-05-07T11:17:26.399801+0000","last_became_active":"2024-05-07T11:17:25.412149+0000","last_became_peered":"2024-05-07T11:17:25.412149+0000","last_unstale":"2024-05-07T11:17:26.399801+0000","last_undegraded":"2024-05-07T11:17:26.399801+0000","last_fullsized":"2024-05-07T11:17:26.399801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:05.259035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402674+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:26.402674+0000","last_peered":"2024-05-07T11:17:26.402674+0000","last_clean":"2024-05-07T11:17:26.402674+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:26.402674+0000","last_undegraded":"2024-05-07T11:17:26.402674+0000","last_fullsized":"2024-05-07T11:17:26.402674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:46.092532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401669+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:26.401669+0000","last_peered":"2024-05-07T11:17:26.401669+0000","last_clean":"2024-05-07T11:17:26.401669+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:26.401669+0000","last_undegraded":"2024-05-07T11:17:26.401669+0000","last_fullsized":"2024-05-07T11:17:26.401669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.076287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"63'172","reported_seq":253,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399454+0000","last_change":"2024-05-07T11:17:21.419673+0000","last_active":"2024-05-07T11:17:26.399454+0000","last_peered":"2024-05-07T11:17:26.399454+0000","last_clean":"2024-05-07T11:17:26.399454+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:26.399454+0000","last_undegraded":"2024-05-07T11:17:26.399454+0000","last_fullsized":"2024-05-07T11:17:26.399454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:01.519110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400659+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:26.400659+0000","last_peered":"2024-05-07T11:17:26.400659+0000","last_clean":"2024-05-07T11:17:26.400659+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:26.400659+0000","last_undegraded":"2024-05-07T11:17:26.400659+0000","last_fullsized":"2024-05-07T11:17:26.400659+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:45.698283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":220,"reported_epoch":79,"state":"peering","last_fresh":"2024-05-07T11:17:26.140679+0000","last_change":"2024-05-07T11:17:27.036190+0000","last_active":"2024-05-07T11:17:27.036190+0000","last_peered":"2024-05-07T11:17:26.140679+0000","last_clean":"2024-05-07T11:14:24.381417+0000","last_became_active":"2024-05-07T11:17:19.436774+0000","last_became_peered":"2024-05-07T11:17:19.436774+0000","last_unstale":"2024-05-07T11:17:26.140679+0000","last_undegraded":"2024-05-07T11:17:26.140679+0000","last_fullsized":"2024-05-07T11:17:19.397337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":311,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.408077+0000","last_change":"2024-05-07T11:17:26.408077+0000","last_active":"2024-05-07T11:17:26.408077+0000","last_peered":"2024-05-07T11:17:26.408077+0000","last_clean":"2024-05-07T11:17:26.408077+0000","last_became_active":"2024-05-07T11:17:26.407230+0000","last_became_peered":"2024-05-07T11:17:26.407230+0000","last_unstale":"2024-05-07T11:17:26.408077+0000","last_undegraded":"2024-05-07T11:17:26.408077+0000","last_fullsized":"2024-05-07T11:17:26.408077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:29.469789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":91096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399511+0000","last_change":"2024-05-07T11:17:18.431271+0000","last_active":"2024-05-07T11:17:26.399511+0000","last_peered":"2024-05-07T11:17:26.399511+0000","last_clean":"2024-05-07T11:17:26.399511+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:26.399511+0000","last_undegraded":"2024-05-07T11:17:26.399511+0000","last_fullsized":"2024-05-07T11:17:26.399511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":225,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400239+0000","last_change":"2024-05-07T11:17:25.403221+0000","last_active":"2024-05-07T11:17:26.400239+0000","last_peered":"2024-05-07T11:17:26.400239+0000","last_clean":"2024-05-07T11:17:26.400239+0000","last_became_active":"2024-05-07T11:17:25.402661+0000","last_became_peered":"2024-05-07T11:17:25.402661+0000","last_unstale":"2024-05-07T11:17:26.400239+0000","last_undegraded":"2024-05-07T11:17:26.400239+0000","last_fullsized":"2024-05-07T11:17:26.400239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:07.574111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399662+0000","last_change":"2024-05-07T11:17:18.402834+0000","last_active":"2024-05-07T11:17:26.399662+0000","last_peered":"2024-05-07T11:17:26.399662+0000","last_clean":"2024-05-07T11:17:26.399662+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:26.399662+0000","last_undegraded":"2024-05-07T11:17:26.399662+0000","last_fullsized":"2024-05-07T11:17:26.399662+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"63'205","reported_seq":349,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402632+0000","last_change":"2024-05-07T11:17:22.421343+0000","last_active":"2024-05-07T11:17:26.402632+0000","last_peered":"2024-05-07T11:17:26.402632+0000","last_clean":"2024-05-07T11:17:26.402632+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:26.402632+0000","last_undegraded":"2024-05-07T11:17:26.402632+0000","last_fullsized":"2024-05-07T11:17:26.402632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:24.076915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402274+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:26.402274+0000","last_peered":"2024-05-07T11:17:26.402274+0000","last_clean":"2024-05-07T11:17:26.402274+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:26.402274+0000","last_undegraded":"2024-05-07T11:17:26.402274+0000","last_fullsized":"2024-05-07T11:17:26.402274+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:53.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'163","reported_seq":308,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402737+0000","last_change":"2024-05-07T11:17:24.407114+0000","last_active":"2024-05-07T11:17:26.402737+0000","last_peered":"2024-05-07T11:17:26.402737+0000","last_clean":"2024-05-07T11:17:26.402737+0000","last_became_active":"2024-05-07T11:17:24.406337+0000","last_became_peered":"2024-05-07T11:17:24.406337+0000","last_unstale":"2024-05-07T11:17:26.402737+0000","last_undegraded":"2024-05-07T11:17:26.402737+0000","last_fullsized":"2024-05-07T11:17:26.402737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:28:35.002816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":280772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402544+0000","last_change":"2024-05-07T11:17:18.555160+0000","last_active":"2024-05-07T11:17:26.402544+0000","last_peered":"2024-05-07T11:17:26.402544+0000","last_clean":"2024-05-07T11:17:26.402544+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:26.402544+0000","last_undegraded":"2024-05-07T11:17:26.402544+0000","last_fullsized":"2024-05-07T11:17:26.402544+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:37.962741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'166","reported_seq":525,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400102+0000","last_change":"2024-05-07T11:17:21.418540+0000","last_active":"2024-05-07T11:17:26.400102+0000","last_peered":"2024-05-07T11:17:26.400102+0000","last_clean":"2024-05-07T11:17:26.400102+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:26.400102+0000","last_undegraded":"2024-05-07T11:17:26.400102+0000","last_fullsized":"2024-05-07T11:17:26.400102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:16.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":163,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401241+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:26.401241+0000","last_peered":"2024-05-07T11:17:26.401241+0000","last_clean":"2024-05-07T11:17:26.401241+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:26.401241+0000","last_undegraded":"2024-05-07T11:17:26.401241+0000","last_fullsized":"2024-05-07T11:17:26.401241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:17.953399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":306,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.400960+0000","last_change":"2024-05-07T11:17:19.440247+0000","last_active":"2024-05-07T11:17:26.400960+0000","last_peered":"2024-05-07T11:17:26.400960+0000","last_clean":"2024-05-07T11:14:24.442642+0000","last_became_active":"2024-05-07T11:17:19.439763+0000","last_became_peered":"2024-05-07T11:17:19.439763+0000","last_unstale":"2024-05-07T11:17:26.400960+0000","last_undegraded":"2024-05-07T11:17:19.422552+0000","last_fullsized":"2024-05-07T11:17:19.420828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":6},{"shards":"2","objects":51}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402986+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:26.402986+0000","last_peered":"2024-05-07T11:17:26.402986+0000","last_clean":"2024-05-07T11:17:26.402986+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:26.402986+0000","last_undegraded":"2024-05-07T11:17:26.402986+0000","last_fullsized":"2024-05-07T11:17:26.402986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:24.011380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'169","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402147+0000","last_change":"2024-05-07T11:17:22.416150+0000","last_active":"2024-05-07T11:17:26.402147+0000","last_peered":"2024-05-07T11:17:26.402147+0000","last_clean":"2024-05-07T11:17:26.402147+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:26.402147+0000","last_undegraded":"2024-05-07T11:17:26.402147+0000","last_fullsized":"2024-05-07T11:17:26.402147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:28.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400504+0000","last_change":"2024-05-07T11:17:18.504321+0000","last_active":"2024-05-07T11:17:26.400504+0000","last_peered":"2024-05-07T11:17:26.400504+0000","last_clean":"2024-05-07T11:17:26.400504+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:26.400504+0000","last_undegraded":"2024-05-07T11:17:26.400504+0000","last_fullsized":"2024-05-07T11:17:26.400504+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"63'199","reported_seq":606,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401546+0000","last_change":"2024-05-07T11:17:25.402468+0000","last_active":"2024-05-07T11:17:26.401546+0000","last_peered":"2024-05-07T11:17:26.401546+0000","last_clean":"2024-05-07T11:17:26.401546+0000","last_became_active":"2024-05-07T11:17:25.401850+0000","last_became_peered":"2024-05-07T11:17:25.401850+0000","last_unstale":"2024-05-07T11:17:26.401546+0000","last_undegraded":"2024-05-07T11:17:26.401546+0000","last_fullsized":"2024-05-07T11:17:26.401546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:19.494294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400780+0000","last_change":"2024-05-07T11:17:18.429950+0000","last_active":"2024-05-07T11:17:26.400780+0000","last_peered":"2024-05-07T11:17:26.400780+0000","last_clean":"2024-05-07T11:17:26.400780+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:26.400780+0000","last_undegraded":"2024-05-07T11:17:26.400780+0000","last_fullsized":"2024-05-07T11:17:26.400780+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1076,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4575,"num_bytes_recovered":13586655,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66179072,"data_stored":55197652,"data_compressed":4987032,"data_compressed_allocated":5869568,"data_compressed_original":15495168,"omap_allocated":0,"internal_metadata":0},"log_size":10416,"ondisk_log_size":10416,"up":128,"acting":116,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":428,"ondisk_log_size":428,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87920,"kb_used_data":34528,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94283920,"statfs":{"total":96636764160,"available":96546734080,"internally_reserved":0,"allocated":35356672,"data_stored":57223987,"data_compressed":6730892,"data_compressed_allocated":8085504,"data_compressed_original":38760448,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710724,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58416,"kb_used_data":26660,"kb_used_omap":10,"kb_used_meta":31733,"kb_avail":94313424,"statfs":{"total":96636764160,"available":96576946176,"internally_reserved":0,"allocated":27299840,"data_stored":48085574,"data_compressed":5684480,"data_compressed_allocated":6696960,"data_compressed_original":33890304,"omap_allocated":10404,"internal_metadata":32495452},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56000,"kb_used_data":20652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94315840,"statfs":{"total":96636764160,"available":96579420160,"internally_reserved":0,"allocated":21147648,"data_stored":34537828,"data_compressed":4633449,"data_compressed_allocated":5464064,"data_compressed_original":25022464,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17117184,"data_stored":14234704,"data_compressed":1776054,"data_compressed_allocated":2060288,"data_compressed_original":5341184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21233664,"data_stored":17797247,"data_compressed":1236911,"data_compressed_allocated":1495040,"data_compressed_original":4083712,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27828224,"data_stored":23165701,"data_compressed":1974067,"data_compressed_allocated":2314240,"data_compressed_original":6070272,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:30.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-07T11:17:31.160 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:31.160 INFO:teuthology.orchestra.run.smithi062.stdout:{"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1076/6966 objects degraded (15.446%), 11 pgs degraded","count":11},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":302,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":83,"num_osds":3,"num_up_osds":3,"osd_up_since":1715080638,"num_in_osds":3,"osd_in_since":1715080349,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":86},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":8},{"state_name":"peering","count":5},{"state_name":"active+undersized+remapped","count":3},{"state_name":"active+recovery_wait+degraded","count":2},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":3483,"data_bytes":68828561,"bytes_used":207192064,"bytes_avail":289703100416,"bytes_total":289910292480,"inactive_pgs_ratio":0.0476190485060215,"degraded_objects":1076,"degraded_total":6966,"degraded_ratio":0.15446454206144128,"recovering_objects_per_sec":364,"recovering_bytes_per_sec":868838,"recovering_keys_per_sec":0,"num_objects_recovered":1460,"num_bytes_recovered":3475983,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4190}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-05-07T11:13:48.949854+0000","services":{}},"progress_events":{}} 2024-05-07T11:17:31.173 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-05-07T11:17:31.174 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:31.476 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:31.477 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:31.487 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-05-07T11:17:31.014084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1076,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4597,"num_bytes_recovered":51004951,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11001,"ondisk_log_size":11001,"up":210,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":230,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":202336,"kb_used_data":81840,"kb_used_omap":13,"kb_used_meta":120434,"kb_avail":282913184,"statfs":{"total":289910292480,"available":289703100416,"internally_reserved":0,"allocated":83804160,"data_stored":139847389,"data_compressed":17048821,"data_compressed_allocated":20246528,"data_compressed_original":97673216,"omap_allocated":13594,"internal_metadata":123325158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1252,"num_objects_misplaced":-434,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1460,"num_bytes_recovered":3475983,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000689"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":296,"reported_epoch":79,"state":"peering","last_fresh":"2024-05-07T11:17:26.402440+0000","last_change":"2024-05-07T11:17:26.402440+0000","last_active":"2024-05-07T11:17:18.397196+0000","last_peered":"2024-05-07T11:17:17.245209+0000","last_clean":"2024-05-07T11:14:24.364900+0000","last_became_active":"2024-05-07T11:14:25.513102+0000","last_became_peered":"2024-05-07T11:14:25.513102+0000","last_unstale":"2024-05-07T11:17:26.402440+0000","last_undegraded":"2024-05-07T11:17:26.402440+0000","last_fullsized":"2024-05-07T11:17:26.402440+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'155","reported_seq":301,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403233+0000","last_change":"2024-05-07T11:17:21.419253+0000","last_active":"2024-05-07T11:17:26.403233+0000","last_peered":"2024-05-07T11:17:26.403233+0000","last_clean":"2024-05-07T11:17:26.403233+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:26.403233+0000","last_undegraded":"2024-05-07T11:17:26.403233+0000","last_fullsized":"2024-05-07T11:17:26.403233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:45:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'169","reported_seq":509,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.408003+0000","last_change":"2024-05-07T11:17:26.408003+0000","last_active":"2024-05-07T11:17:26.408003+0000","last_peered":"2024-05-07T11:17:26.408003+0000","last_clean":"2024-05-07T11:17:26.408003+0000","last_became_active":"2024-05-07T11:17:26.407269+0000","last_became_peered":"2024-05-07T11:17:26.407269+0000","last_unstale":"2024-05-07T11:17:26.408003+0000","last_undegraded":"2024-05-07T11:17:26.408003+0000","last_fullsized":"2024-05-07T11:17:26.408003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:01.664780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":75254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":266,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400803+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:26.400803+0000","last_peered":"2024-05-07T11:17:26.400803+0000","last_clean":"2024-05-07T11:17:26.400803+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:26.400803+0000","last_undegraded":"2024-05-07T11:17:26.400803+0000","last_fullsized":"2024-05-07T11:17:26.400803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"63'186","reported_seq":332,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402666+0000","last_change":"2024-05-07T11:17:21.419034+0000","last_active":"2024-05-07T11:17:26.402666+0000","last_peered":"2024-05-07T11:17:26.402666+0000","last_clean":"2024-05-07T11:17:26.402666+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:26.402666+0000","last_undegraded":"2024-05-07T11:17:26.402666+0000","last_fullsized":"2024-05-07T11:17:26.402666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:42.536445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":257,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.400180+0000","last_change":"2024-05-07T11:17:22.419149+0000","last_active":"2024-05-07T11:17:26.400180+0000","last_peered":"2024-05-07T11:17:26.400180+0000","last_clean":"2024-05-07T11:14:24.385916+0000","last_became_active":"2024-05-07T11:17:22.416956+0000","last_became_peered":"2024-05-07T11:17:22.416956+0000","last_unstale":"2024-05-07T11:17:26.400180+0000","last_undegraded":"2024-05-07T11:17:22.411982+0000","last_fullsized":"2024-05-07T11:17:22.411747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":108,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":42}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"63'166","reported_seq":261,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399913+0000","last_change":"2024-05-07T11:17:22.418934+0000","last_active":"2024-05-07T11:17:26.399913+0000","last_peered":"2024-05-07T11:17:26.399913+0000","last_clean":"2024-05-07T11:17:26.399913+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:26.399913+0000","last_undegraded":"2024-05-07T11:17:26.399913+0000","last_fullsized":"2024-05-07T11:17:26.399913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:05.143462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":455,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400835+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:26.400835+0000","last_peered":"2024-05-07T11:17:26.400835+0000","last_clean":"2024-05-07T11:17:26.400835+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:26.400835+0000","last_undegraded":"2024-05-07T11:17:26.400835+0000","last_fullsized":"2024-05-07T11:17:26.400835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:04.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":235,"reported_epoch":79,"state":"peering","last_fresh":"2024-05-07T11:17:25.443661+0000","last_change":"2024-05-07T11:17:27.036289+0000","last_active":"2024-05-07T11:17:27.036289+0000","last_peered":"2024-05-07T11:17:25.443661+0000","last_clean":"2024-05-07T11:14:24.451837+0000","last_became_active":"2024-05-07T11:17:19.435835+0000","last_became_peered":"2024-05-07T11:17:19.435835+0000","last_unstale":"2024-05-07T11:17:25.443661+0000","last_undegraded":"2024-05-07T11:17:25.443661+0000","last_fullsized":"2024-05-07T11:17:19.410369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":631133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"63'156","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403131+0000","last_change":"2024-05-07T11:17:22.416801+0000","last_active":"2024-05-07T11:17:26.403131+0000","last_peered":"2024-05-07T11:17:26.403131+0000","last_clean":"2024-05-07T11:17:26.403131+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:26.403131+0000","last_undegraded":"2024-05-07T11:17:26.403131+0000","last_fullsized":"2024-05-07T11:17:26.403131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:07.028486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'154","reported_seq":442,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400961+0000","last_change":"2024-05-07T11:17:22.419089+0000","last_active":"2024-05-07T11:17:26.400961+0000","last_peered":"2024-05-07T11:17:26.400961+0000","last_clean":"2024-05-07T11:17:26.400961+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:26.400961+0000","last_undegraded":"2024-05-07T11:17:26.400961+0000","last_fullsized":"2024-05-07T11:17:26.400961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:57.833385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":459,"reported_epoch":79,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:26.554445+0000","last_change":"2024-05-07T11:17:26.554588+0000","last_active":"2024-05-07T11:17:26.554445+0000","last_peered":"2024-05-07T11:17:26.554445+0000","last_clean":"2024-05-07T11:14:24.417671+0000","last_became_active":"2024-05-07T11:17:19.435011+0000","last_became_peered":"2024-05-07T11:17:19.435011+0000","last_unstale":"2024-05-07T11:17:26.554445+0000","last_undegraded":"2024-05-07T11:17:26.554445+0000","last_fullsized":"2024-05-07T11:17:19.412423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":89602,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":53}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"63'136","reported_seq":283,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402852+0000","last_change":"2024-05-07T11:17:23.398879+0000","last_active":"2024-05-07T11:17:26.402852+0000","last_peered":"2024-05-07T11:17:26.402852+0000","last_clean":"2024-05-07T11:17:26.402852+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:26.402852+0000","last_undegraded":"2024-05-07T11:17:26.402852+0000","last_fullsized":"2024-05-07T11:17:26.402852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:33:07.091905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'175","reported_seq":525,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.408334+0000","last_change":"2024-05-07T11:17:26.407920+0000","last_active":"2024-05-07T11:17:26.408334+0000","last_peered":"2024-05-07T11:17:26.408334+0000","last_clean":"2024-05-07T11:17:26.408334+0000","last_became_active":"2024-05-07T11:17:26.407342+0000","last_became_peered":"2024-05-07T11:17:26.407342+0000","last_unstale":"2024-05-07T11:17:26.408334+0000","last_undegraded":"2024-05-07T11:17:26.408334+0000","last_fullsized":"2024-05-07T11:17:26.408334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:55:22.847728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":196945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":523,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400015+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:26.400015+0000","last_peered":"2024-05-07T11:17:26.400015+0000","last_clean":"2024-05-07T11:17:26.400015+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:26.400015+0000","last_undegraded":"2024-05-07T11:17:26.400015+0000","last_fullsized":"2024-05-07T11:17:26.400015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:30:48.688430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":260,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.401800+0000","last_change":"2024-05-07T11:17:22.420019+0000","last_active":"2024-05-07T11:17:26.401800+0000","last_peered":"2024-05-07T11:17:26.401800+0000","last_clean":"2024-05-07T11:14:24.378895+0000","last_became_active":"2024-05-07T11:17:22.418850+0000","last_became_peered":"2024-05-07T11:17:22.418850+0000","last_unstale":"2024-05-07T11:17:26.401800+0000","last_undegraded":"2024-05-07T11:17:22.412415+0000","last_fullsized":"2024-05-07T11:17:22.412148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":113,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'161","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400901+0000","last_change":"2024-05-07T11:17:22.416613+0000","last_active":"2024-05-07T11:17:26.400901+0000","last_peered":"2024-05-07T11:17:26.400901+0000","last_clean":"2024-05-07T11:17:26.400901+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:26.400901+0000","last_undegraded":"2024-05-07T11:17:26.400901+0000","last_fullsized":"2024-05-07T11:17:26.400901+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"63'148","reported_seq":294,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403084+0000","last_change":"2024-05-07T11:17:21.418472+0000","last_active":"2024-05-07T11:17:26.403084+0000","last_peered":"2024-05-07T11:17:26.403084+0000","last_clean":"2024-05-07T11:17:26.403084+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:26.403084+0000","last_undegraded":"2024-05-07T11:17:26.403084+0000","last_fullsized":"2024-05-07T11:17:26.403084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:18.184681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'147","reported_seq":229,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400153+0000","last_change":"2024-05-07T11:17:21.418164+0000","last_active":"2024-05-07T11:17:26.400153+0000","last_peered":"2024-05-07T11:17:26.400153+0000","last_clean":"2024-05-07T11:17:26.400153+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:26.400153+0000","last_undegraded":"2024-05-07T11:17:26.400153+0000","last_fullsized":"2024-05-07T11:17:26.400153+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":334,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.400925+0000","last_change":"2024-05-07T11:17:19.439196+0000","last_active":"2024-05-07T11:17:26.400925+0000","last_peered":"2024-05-07T11:17:26.400925+0000","last_clean":"2024-05-07T11:14:24.396282+0000","last_became_active":"2024-05-07T11:17:19.437184+0000","last_became_peered":"2024-05-07T11:17:19.437184+0000","last_unstale":"2024-05-07T11:17:26.400925+0000","last_undegraded":"2024-05-07T11:17:19.422229+0000","last_fullsized":"2024-05-07T11:17:19.419110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":112,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":297,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400252+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:26.400252+0000","last_peered":"2024-05-07T11:17:26.400252+0000","last_clean":"2024-05-07T11:17:26.400252+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:26.400252+0000","last_undegraded":"2024-05-07T11:17:26.400252+0000","last_fullsized":"2024-05-07T11:17:26.400252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":310,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.399857+0000","last_change":"2024-05-07T11:17:19.439396+0000","last_active":"2024-05-07T11:17:26.399857+0000","last_peered":"2024-05-07T11:17:26.399857+0000","last_clean":"2024-05-07T11:14:24.332238+0000","last_became_active":"2024-05-07T11:17:19.434809+0000","last_became_peered":"2024-05-07T11:17:19.434809+0000","last_unstale":"2024-05-07T11:17:26.399857+0000","last_undegraded":"2024-05-07T11:17:19.410512+0000","last_fullsized":"2024-05-07T11:17:19.407581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":101,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":7}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"63'159","reported_seq":239,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399454+0000","last_change":"2024-05-07T11:17:21.418519+0000","last_active":"2024-05-07T11:17:26.399454+0000","last_peered":"2024-05-07T11:17:26.399454+0000","last_clean":"2024-05-07T11:17:26.399454+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:26.399454+0000","last_undegraded":"2024-05-07T11:17:26.399454+0000","last_fullsized":"2024-05-07T11:17:26.399454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"63'169","reported_seq":315,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402518+0000","last_change":"2024-05-07T11:17:21.414896+0000","last_active":"2024-05-07T11:17:26.402518+0000","last_peered":"2024-05-07T11:17:26.402518+0000","last_clean":"2024-05-07T11:17:26.402518+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:26.402518+0000","last_undegraded":"2024-05-07T11:17:26.402518+0000","last_fullsized":"2024-05-07T11:17:26.402518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:52.242314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":294,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403184+0000","last_change":"2024-05-07T11:17:24.407028+0000","last_active":"2024-05-07T11:17:26.403184+0000","last_peered":"2024-05-07T11:17:26.403184+0000","last_clean":"2024-05-07T11:17:26.403184+0000","last_became_active":"2024-05-07T11:17:24.406307+0000","last_became_peered":"2024-05-07T11:17:24.406307+0000","last_unstale":"2024-05-07T11:17:26.403184+0000","last_undegraded":"2024-05-07T11:17:26.403184+0000","last_fullsized":"2024-05-07T11:17:26.403184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:24.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":230897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'195","reported_seq":337,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400507+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:17:26.400507+0000","last_peered":"2024-05-07T11:17:26.400507+0000","last_clean":"2024-05-07T11:17:26.400507+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:26.400507+0000","last_undegraded":"2024-05-07T11:17:26.400507+0000","last_fullsized":"2024-05-07T11:17:26.400507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":279,"reported_epoch":79,"state":"active+recovery_wait+degraded","last_fresh":"2024-05-07T11:17:26.401090+0000","last_change":"2024-05-07T11:17:23.403843+0000","last_active":"2024-05-07T11:17:26.401090+0000","last_peered":"2024-05-07T11:17:26.401090+0000","last_clean":"2024-05-07T11:14:24.294325+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:26.401090+0000","last_undegraded":"2024-05-07T11:17:23.394924+0000","last_fullsized":"2024-05-07T11:17:26.401090+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":91,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":4},{"shards":"2","objects":43}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":476,"reported_epoch":79,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:27.015247+0000","last_change":"2024-05-07T11:17:27.015404+0000","last_active":"2024-05-07T11:17:27.015247+0000","last_peered":"2024-05-07T11:17:27.015247+0000","last_clean":"2024-05-07T11:14:24.430825+0000","last_became_active":"2024-05-07T11:17:19.436245+0000","last_became_peered":"2024-05-07T11:17:19.436245+0000","last_unstale":"2024-05-07T11:17:27.015247+0000","last_undegraded":"2024-05-07T11:17:27.015247+0000","last_fullsized":"2024-05-07T11:17:19.414331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":211687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":48}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":239,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399735+0000","last_change":"2024-05-07T11:17:24.403807+0000","last_active":"2024-05-07T11:17:26.399735+0000","last_peered":"2024-05-07T11:17:26.399735+0000","last_clean":"2024-05-07T11:17:26.399735+0000","last_became_active":"2024-05-07T11:17:24.403179+0000","last_became_peered":"2024-05-07T11:17:24.403179+0000","last_unstale":"2024-05-07T11:17:26.399735+0000","last_undegraded":"2024-05-07T11:17:26.399735+0000","last_fullsized":"2024-05-07T11:17:26.399735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:15:55.499366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":330,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.400145+0000","last_change":"2024-05-07T11:17:19.439496+0000","last_active":"2024-05-07T11:17:26.400145+0000","last_peered":"2024-05-07T11:17:26.400145+0000","last_clean":"2024-05-07T11:14:24.440580+0000","last_became_active":"2024-05-07T11:17:19.435641+0000","last_became_peered":"2024-05-07T11:17:19.435641+0000","last_unstale":"2024-05-07T11:17:26.400145+0000","last_undegraded":"2024-05-07T11:17:19.416557+0000","last_fullsized":"2024-05-07T11:17:19.412853+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":114,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"63'192","reported_seq":578,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399596+0000","last_change":"2024-05-07T11:17:22.416120+0000","last_active":"2024-05-07T11:17:26.399596+0000","last_peered":"2024-05-07T11:17:26.399596+0000","last_clean":"2024-05-07T11:17:26.399596+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:26.399596+0000","last_undegraded":"2024-05-07T11:17:26.399596+0000","last_fullsized":"2024-05-07T11:17:26.399596+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:13.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"63'185","reported_seq":568,"reported_epoch":79,"state":"active+undersized+remapped","last_fresh":"2024-05-07T11:17:26.805194+0000","last_change":"2024-05-07T11:17:26.805356+0000","last_active":"2024-05-07T11:17:26.805194+0000","last_peered":"2024-05-07T11:17:26.805194+0000","last_clean":"2024-05-07T11:14:24.357156+0000","last_became_active":"2024-05-07T11:17:19.437340+0000","last_became_peered":"2024-05-07T11:17:19.437340+0000","last_unstale":"2024-05-07T11:17:26.805194+0000","last_undegraded":"2024-05-07T11:17:19.420606+0000","last_fullsized":"2024-05-07T11:17:19.414996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":459999,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":56}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'156","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402622+0000","last_change":"2024-05-07T11:17:22.416165+0000","last_active":"2024-05-07T11:17:26.402622+0000","last_peered":"2024-05-07T11:17:26.402622+0000","last_clean":"2024-05-07T11:17:26.402622+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:26.402622+0000","last_undegraded":"2024-05-07T11:17:26.402622+0000","last_fullsized":"2024-05-07T11:17:26.402622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:57.237765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":269,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400651+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:26.400651+0000","last_peered":"2024-05-07T11:17:26.400651+0000","last_clean":"2024-05-07T11:17:26.400651+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:26.400651+0000","last_undegraded":"2024-05-07T11:17:26.400651+0000","last_fullsized":"2024-05-07T11:17:26.400651+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"63'141","reported_seq":287,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403041+0000","last_change":"2024-05-07T11:17:21.419206+0000","last_active":"2024-05-07T11:17:26.403041+0000","last_peered":"2024-05-07T11:17:26.403041+0000","last_clean":"2024-05-07T11:17:26.403041+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:26.403041+0000","last_undegraded":"2024-05-07T11:17:26.403041+0000","last_fullsized":"2024-05-07T11:17:26.403041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:12.679336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399720+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:26.399720+0000","last_peered":"2024-05-07T11:17:26.399720+0000","last_clean":"2024-05-07T11:17:26.399720+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:26.399720+0000","last_undegraded":"2024-05-07T11:17:26.399720+0000","last_fullsized":"2024-05-07T11:17:26.399720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.025763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"63'179","reported_seq":259,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400291+0000","last_change":"2024-05-07T11:17:21.419284+0000","last_active":"2024-05-07T11:17:26.400291+0000","last_peered":"2024-05-07T11:17:26.400291+0000","last_clean":"2024-05-07T11:17:26.400291+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:26.400291+0000","last_undegraded":"2024-05-07T11:17:26.400291+0000","last_fullsized":"2024-05-07T11:17:26.400291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:54.463898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402145+0000","last_change":"2024-05-07T11:17:18.423604+0000","last_active":"2024-05-07T11:17:26.402145+0000","last_peered":"2024-05-07T11:17:26.402145+0000","last_clean":"2024-05-07T11:17:26.402145+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:26.402145+0000","last_undegraded":"2024-05-07T11:17:26.402145+0000","last_fullsized":"2024-05-07T11:17:26.402145+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:45:28.650148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":236,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400727+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:26.400727+0000","last_peered":"2024-05-07T11:17:26.400727+0000","last_clean":"2024-05-07T11:17:26.400727+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:26.400727+0000","last_undegraded":"2024-05-07T11:17:26.400727+0000","last_fullsized":"2024-05-07T11:17:26.400727+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":157,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401379+0000","last_change":"2024-05-07T11:17:18.433027+0000","last_active":"2024-05-07T11:17:26.401379+0000","last_peered":"2024-05-07T11:17:26.401379+0000","last_clean":"2024-05-07T11:17:26.401379+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:26.401379+0000","last_undegraded":"2024-05-07T11:17:26.401379+0000","last_fullsized":"2024-05-07T11:17:26.401379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:47.068504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402746+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:26.402746+0000","last_peered":"2024-05-07T11:17:26.402746+0000","last_clean":"2024-05-07T11:17:26.402746+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:26.402746+0000","last_undegraded":"2024-05-07T11:17:26.402746+0000","last_fullsized":"2024-05-07T11:17:26.402746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:35:51.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'155","reported_seq":421,"reported_epoch":78,"state":"peering","last_fresh":"2024-05-07T11:17:25.877887+0000","last_change":"2024-05-07T11:17:26.400307+0000","last_active":"2024-05-07T11:17:26.400307+0000","last_peered":"2024-05-07T11:17:25.877887+0000","last_clean":"2024-05-07T11:14:24.400453+0000","last_became_active":"2024-05-07T11:17:19.433702+0000","last_became_peered":"2024-05-07T11:17:19.433702+0000","last_unstale":"2024-05-07T11:17:25.877887+0000","last_undegraded":"2024-05-07T11:17:25.877887+0000","last_fullsized":"2024-05-07T11:17:19.399778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":166862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403020+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:26.403020+0000","last_peered":"2024-05-07T11:17:26.403020+0000","last_clean":"2024-05-07T11:17:26.403020+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:26.403020+0000","last_undegraded":"2024-05-07T11:17:26.403020+0000","last_fullsized":"2024-05-07T11:17:26.403020+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:16.479879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'167","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402022+0000","last_change":"2024-05-07T11:17:21.418782+0000","last_active":"2024-05-07T11:17:26.402022+0000","last_peered":"2024-05-07T11:17:26.402022+0000","last_clean":"2024-05-07T11:17:26.402022+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:26.402022+0000","last_undegraded":"2024-05-07T11:17:26.402022+0000","last_fullsized":"2024-05-07T11:17:26.402022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:13.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401717+0000","last_change":"2024-05-07T11:17:22.419069+0000","last_active":"2024-05-07T11:17:26.401717+0000","last_peered":"2024-05-07T11:17:26.401717+0000","last_clean":"2024-05-07T11:17:26.401717+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:26.401717+0000","last_undegraded":"2024-05-07T11:17:26.401717+0000","last_fullsized":"2024-05-07T11:17:26.401717+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:20.890067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":308,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.400630+0000","last_change":"2024-05-07T11:17:19.439572+0000","last_active":"2024-05-07T11:17:26.400630+0000","last_peered":"2024-05-07T11:17:26.400630+0000","last_clean":"2024-05-07T11:14:24.352569+0000","last_became_active":"2024-05-07T11:17:19.437369+0000","last_became_peered":"2024-05-07T11:17:19.437369+0000","last_unstale":"2024-05-07T11:17:26.400630+0000","last_undegraded":"2024-05-07T11:17:19.420446+0000","last_fullsized":"2024-05-07T11:17:19.417984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":5},{"shards":"2","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401371+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:26.401371+0000","last_peered":"2024-05-07T11:17:26.401371+0000","last_clean":"2024-05-07T11:17:26.401371+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:26.401371+0000","last_undegraded":"2024-05-07T11:17:26.401371+0000","last_fullsized":"2024-05-07T11:17:26.401371+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:31:28.580245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"63'164","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399908+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:17:26.399908+0000","last_peered":"2024-05-07T11:17:26.399908+0000","last_clean":"2024-05-07T11:17:26.399908+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:26.399908+0000","last_undegraded":"2024-05-07T11:17:26.399908+0000","last_fullsized":"2024-05-07T11:17:26.399908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399948+0000","last_change":"2024-05-07T11:17:18.450923+0000","last_active":"2024-05-07T11:17:26.399948+0000","last_peered":"2024-05-07T11:17:26.399948+0000","last_clean":"2024-05-07T11:17:26.399948+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:26.399948+0000","last_undegraded":"2024-05-07T11:17:26.399948+0000","last_fullsized":"2024-05-07T11:17:26.399948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:38.864461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"63'172","reported_seq":354,"reported_epoch":79,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:27.042411+0000","last_change":"2024-05-07T11:17:27.016039+0000","last_active":"2024-05-07T11:17:27.042411+0000","last_peered":"2024-05-07T11:17:27.042411+0000","last_clean":"2024-05-07T11:14:24.436962+0000","last_became_active":"2024-05-07T11:17:19.438026+0000","last_became_peered":"2024-05-07T11:17:19.438026+0000","last_unstale":"2024-05-07T11:17:27.042411+0000","last_undegraded":"2024-05-07T11:17:19.423429+0000","last_fullsized":"2024-05-07T11:17:19.419186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":46,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":33286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":142,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401707+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:26.401707+0000","last_peered":"2024-05-07T11:17:26.401707+0000","last_clean":"2024-05-07T11:17:26.401707+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:26.401707+0000","last_undegraded":"2024-05-07T11:17:26.401707+0000","last_fullsized":"2024-05-07T11:17:26.401707+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"63'163","reported_seq":505,"reported_epoch":78,"state":"peering","last_fresh":"2024-05-07T11:17:25.648218+0000","last_change":"2024-05-07T11:17:26.402717+0000","last_active":"2024-05-07T11:17:26.402717+0000","last_peered":"2024-05-07T11:17:25.648218+0000","last_clean":"2024-05-07T11:14:24.493593+0000","last_became_active":"2024-05-07T11:17:19.436403+0000","last_became_peered":"2024-05-07T11:17:19.436403+0000","last_unstale":"2024-05-07T11:17:25.648218+0000","last_undegraded":"2024-05-07T11:17:25.648218+0000","last_fullsized":"2024-05-07T11:17:19.416685+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":119690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401969+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:26.401969+0000","last_peered":"2024-05-07T11:17:26.401969+0000","last_clean":"2024-05-07T11:17:26.401969+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:26.401969+0000","last_undegraded":"2024-05-07T11:17:26.401969+0000","last_fullsized":"2024-05-07T11:17:26.401969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:47.689436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'137","reported_seq":465,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401217+0000","last_change":"2024-05-07T11:17:24.403787+0000","last_active":"2024-05-07T11:17:26.401217+0000","last_peered":"2024-05-07T11:17:26.401217+0000","last_clean":"2024-05-07T11:17:26.401217+0000","last_became_active":"2024-05-07T11:17:24.403279+0000","last_became_peered":"2024-05-07T11:17:24.403279+0000","last_unstale":"2024-05-07T11:17:26.401217+0000","last_undegraded":"2024-05-07T11:17:26.401217+0000","last_fullsized":"2024-05-07T11:17:26.401217+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:42.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":111,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402750+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:26.402750+0000","last_peered":"2024-05-07T11:17:26.402750+0000","last_clean":"2024-05-07T11:17:26.402750+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:26.402750+0000","last_undegraded":"2024-05-07T11:17:26.402750+0000","last_fullsized":"2024-05-07T11:17:26.402750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:59.411938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'141","reported_seq":467,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400846+0000","last_change":"2024-05-07T11:17:22.417126+0000","last_active":"2024-05-07T11:17:26.400846+0000","last_peered":"2024-05-07T11:17:26.400846+0000","last_clean":"2024-05-07T11:17:26.400846+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:26.400846+0000","last_undegraded":"2024-05-07T11:17:26.400846+0000","last_fullsized":"2024-05-07T11:17:26.400846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":351,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401898+0000","last_change":"2024-05-07T11:17:18.433863+0000","last_active":"2024-05-07T11:17:26.401898+0000","last_peered":"2024-05-07T11:17:26.401898+0000","last_clean":"2024-05-07T11:17:26.401898+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:26.401898+0000","last_undegraded":"2024-05-07T11:17:26.401898+0000","last_fullsized":"2024-05-07T11:17:26.401898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:10.515455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400715+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:26.400715+0000","last_peered":"2024-05-07T11:17:26.400715+0000","last_clean":"2024-05-07T11:17:26.400715+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:26.400715+0000","last_undegraded":"2024-05-07T11:17:26.400715+0000","last_fullsized":"2024-05-07T11:17:26.400715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:03:02.539869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399588+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:26.399588+0000","last_peered":"2024-05-07T11:17:26.399588+0000","last_clean":"2024-05-07T11:17:26.399588+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:26.399588+0000","last_undegraded":"2024-05-07T11:17:26.399588+0000","last_fullsized":"2024-05-07T11:17:26.399588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":274,"reported_epoch":79,"state":"active+recovery_wait+degraded","last_fresh":"2024-05-07T11:17:26.401457+0000","last_change":"2024-05-07T11:17:23.403839+0000","last_active":"2024-05-07T11:17:26.401457+0000","last_peered":"2024-05-07T11:17:26.401457+0000","last_clean":"2024-05-07T11:14:24.305202+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:26.401457+0000","last_undegraded":"2024-05-07T11:17:23.396611+0000","last_fullsized":"2024-05-07T11:17:26.401457+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":7},{"shards":"2","objects":52}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401804+0000","last_change":"2024-05-07T11:17:18.433452+0000","last_active":"2024-05-07T11:17:26.401804+0000","last_peered":"2024-05-07T11:17:26.401804+0000","last_clean":"2024-05-07T11:17:26.401804+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:26.401804+0000","last_undegraded":"2024-05-07T11:17:26.401804+0000","last_fullsized":"2024-05-07T11:17:26.401804+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:26.663080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":212,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399772+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:17:26.399772+0000","last_peered":"2024-05-07T11:17:26.399772+0000","last_clean":"2024-05-07T11:17:26.399772+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:26.399772+0000","last_undegraded":"2024-05-07T11:17:26.399772+0000","last_fullsized":"2024-05-07T11:17:26.399772+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"63'160","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402773+0000","last_change":"2024-05-07T11:17:24.407000+0000","last_active":"2024-05-07T11:17:26.402773+0000","last_peered":"2024-05-07T11:17:26.402773+0000","last_clean":"2024-05-07T11:17:26.402773+0000","last_became_active":"2024-05-07T11:17:24.406306+0000","last_became_peered":"2024-05-07T11:17:24.406306+0000","last_unstale":"2024-05-07T11:17:26.402773+0000","last_undegraded":"2024-05-07T11:17:26.402773+0000","last_fullsized":"2024-05-07T11:17:26.402773+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:56:56.763708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":402414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399853+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:26.399853+0000","last_peered":"2024-05-07T11:17:26.399853+0000","last_clean":"2024-05-07T11:17:26.399853+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:26.399853+0000","last_undegraded":"2024-05-07T11:17:26.399853+0000","last_fullsized":"2024-05-07T11:17:26.399853+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:20.744525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402263+0000","last_change":"2024-05-07T11:17:18.572639+0000","last_active":"2024-05-07T11:17:26.402263+0000","last_peered":"2024-05-07T11:17:26.402263+0000","last_clean":"2024-05-07T11:17:26.402263+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:26.402263+0000","last_undegraded":"2024-05-07T11:17:26.402263+0000","last_fullsized":"2024-05-07T11:17:26.402263+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:15.538158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":241,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.408479+0000","last_change":"2024-05-07T11:17:26.407965+0000","last_active":"2024-05-07T11:17:26.408479+0000","last_peered":"2024-05-07T11:17:26.408479+0000","last_clean":"2024-05-07T11:17:26.408479+0000","last_became_active":"2024-05-07T11:17:26.407203+0000","last_became_peered":"2024-05-07T11:17:26.407203+0000","last_unstale":"2024-05-07T11:17:26.408479+0000","last_undegraded":"2024-05-07T11:17:26.408479+0000","last_fullsized":"2024-05-07T11:17:26.408479+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:50.842472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":384377,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401803+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:26.401803+0000","last_peered":"2024-05-07T11:17:26.401803+0000","last_clean":"2024-05-07T11:17:26.401803+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:26.401803+0000","last_undegraded":"2024-05-07T11:17:26.401803+0000","last_fullsized":"2024-05-07T11:17:26.401803+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":154,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400566+0000","last_change":"2024-05-07T11:17:18.404539+0000","last_active":"2024-05-07T11:17:26.400566+0000","last_peered":"2024-05-07T11:17:26.400566+0000","last_clean":"2024-05-07T11:17:26.400566+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:26.400566+0000","last_undegraded":"2024-05-07T11:17:26.400566+0000","last_fullsized":"2024-05-07T11:17:26.400566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:50.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":225,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400120+0000","last_change":"2024-05-07T11:17:25.412664+0000","last_active":"2024-05-07T11:17:26.400120+0000","last_peered":"2024-05-07T11:17:26.400120+0000","last_clean":"2024-05-07T11:17:26.400120+0000","last_became_active":"2024-05-07T11:17:25.412026+0000","last_became_peered":"2024-05-07T11:17:25.412026+0000","last_unstale":"2024-05-07T11:17:26.400120+0000","last_undegraded":"2024-05-07T11:17:26.400120+0000","last_fullsized":"2024-05-07T11:17:26.400120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:19:28.465664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":174891,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401809+0000","last_change":"2024-05-07T11:17:22.424750+0000","last_active":"2024-05-07T11:17:26.401809+0000","last_peered":"2024-05-07T11:17:26.401809+0000","last_clean":"2024-05-07T11:17:26.401809+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:26.401809+0000","last_undegraded":"2024-05-07T11:17:26.401809+0000","last_fullsized":"2024-05-07T11:17:26.401809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:12.283160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400199+0000","last_change":"2024-05-07T11:17:18.433137+0000","last_active":"2024-05-07T11:17:26.400199+0000","last_peered":"2024-05-07T11:17:26.400199+0000","last_clean":"2024-05-07T11:17:26.400199+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:26.400199+0000","last_undegraded":"2024-05-07T11:17:26.400199+0000","last_fullsized":"2024-05-07T11:17:26.400199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:40.770823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":303,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.399863+0000","last_change":"2024-05-07T11:17:19.439272+0000","last_active":"2024-05-07T11:17:26.399863+0000","last_peered":"2024-05-07T11:17:26.399863+0000","last_clean":"2024-05-07T11:14:24.425940+0000","last_became_active":"2024-05-07T11:17:19.434379+0000","last_became_peered":"2024-05-07T11:17:19.434379+0000","last_unstale":"2024-05-07T11:17:26.399863+0000","last_undegraded":"2024-05-07T11:17:19.403485+0000","last_fullsized":"2024-05-07T11:17:19.397696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400101+0000","last_change":"2024-05-07T11:17:18.431763+0000","last_active":"2024-05-07T11:17:26.400101+0000","last_peered":"2024-05-07T11:17:26.400101+0000","last_clean":"2024-05-07T11:17:26.400101+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:26.400101+0000","last_undegraded":"2024-05-07T11:17:26.400101+0000","last_fullsized":"2024-05-07T11:17:26.400101+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:38.234395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.403248+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:26.403248+0000","last_peered":"2024-05-07T11:17:26.403248+0000","last_clean":"2024-05-07T11:17:26.403248+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:26.403248+0000","last_undegraded":"2024-05-07T11:17:26.403248+0000","last_fullsized":"2024-05-07T11:17:26.403248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:54.609817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'181","reported_seq":323,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402147+0000","last_change":"2024-05-07T11:17:23.399296+0000","last_active":"2024-05-07T11:17:26.402147+0000","last_peered":"2024-05-07T11:17:26.402147+0000","last_clean":"2024-05-07T11:17:26.402147+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:26.402147+0000","last_undegraded":"2024-05-07T11:17:26.402147+0000","last_fullsized":"2024-05-07T11:17:26.402147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:21.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401542+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:26.401542+0000","last_peered":"2024-05-07T11:17:26.401542+0000","last_clean":"2024-05-07T11:17:26.401542+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:26.401542+0000","last_undegraded":"2024-05-07T11:17:26.401542+0000","last_fullsized":"2024-05-07T11:17:26.401542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:03.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400407+0000","last_change":"2024-05-07T11:17:18.432358+0000","last_active":"2024-05-07T11:17:26.400407+0000","last_peered":"2024-05-07T11:17:26.400407+0000","last_clean":"2024-05-07T11:17:26.400407+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:26.400407+0000","last_undegraded":"2024-05-07T11:17:26.400407+0000","last_fullsized":"2024-05-07T11:17:26.400407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:36.281521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"63'175","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400661+0000","last_change":"2024-05-07T11:17:22.420080+0000","last_active":"2024-05-07T11:17:26.400661+0000","last_peered":"2024-05-07T11:17:26.400661+0000","last_clean":"2024-05-07T11:17:26.400661+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:26.400661+0000","last_undegraded":"2024-05-07T11:17:26.400661+0000","last_fullsized":"2024-05-07T11:17:26.400661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:41.233935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'38","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400317+0000","last_change":"2024-05-07T11:17:18.459674+0000","last_active":"2024-05-07T11:17:26.400317+0000","last_peered":"2024-05-07T11:17:26.400317+0000","last_clean":"2024-05-07T11:17:26.400317+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:26.400317+0000","last_undegraded":"2024-05-07T11:17:26.400317+0000","last_fullsized":"2024-05-07T11:17:26.400317+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:35.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":155,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402846+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:26.402846+0000","last_peered":"2024-05-07T11:17:26.402846+0000","last_clean":"2024-05-07T11:17:26.402846+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:26.402846+0000","last_undegraded":"2024-05-07T11:17:26.402846+0000","last_fullsized":"2024-05-07T11:17:26.402846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:14.650941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'138","reported_seq":282,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402265+0000","last_change":"2024-05-07T11:17:22.417629+0000","last_active":"2024-05-07T11:17:26.402265+0000","last_peered":"2024-05-07T11:17:26.402265+0000","last_clean":"2024-05-07T11:17:26.402265+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:26.402265+0000","last_undegraded":"2024-05-07T11:17:26.402265+0000","last_fullsized":"2024-05-07T11:17:26.402265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:58.760049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'164","reported_seq":502,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400221+0000","last_change":"2024-05-07T11:17:23.400613+0000","last_active":"2024-05-07T11:17:26.400221+0000","last_peered":"2024-05-07T11:17:26.400221+0000","last_clean":"2024-05-07T11:17:26.400221+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:26.400221+0000","last_undegraded":"2024-05-07T11:17:26.400221+0000","last_fullsized":"2024-05-07T11:17:26.400221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:28.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":200,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401407+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:26.401407+0000","last_peered":"2024-05-07T11:17:26.401407+0000","last_clean":"2024-05-07T11:17:26.401407+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:26.401407+0000","last_undegraded":"2024-05-07T11:17:26.401407+0000","last_fullsized":"2024-05-07T11:17:26.401407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:35.832524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":220,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399801+0000","last_change":"2024-05-07T11:17:25.413137+0000","last_active":"2024-05-07T11:17:26.399801+0000","last_peered":"2024-05-07T11:17:26.399801+0000","last_clean":"2024-05-07T11:17:26.399801+0000","last_became_active":"2024-05-07T11:17:25.412149+0000","last_became_peered":"2024-05-07T11:17:25.412149+0000","last_unstale":"2024-05-07T11:17:26.399801+0000","last_undegraded":"2024-05-07T11:17:26.399801+0000","last_fullsized":"2024-05-07T11:17:26.399801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:05.259035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402674+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:26.402674+0000","last_peered":"2024-05-07T11:17:26.402674+0000","last_clean":"2024-05-07T11:17:26.402674+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:26.402674+0000","last_undegraded":"2024-05-07T11:17:26.402674+0000","last_fullsized":"2024-05-07T11:17:26.402674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:46.092532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401669+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:26.401669+0000","last_peered":"2024-05-07T11:17:26.401669+0000","last_clean":"2024-05-07T11:17:26.401669+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:26.401669+0000","last_undegraded":"2024-05-07T11:17:26.401669+0000","last_fullsized":"2024-05-07T11:17:26.401669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.076287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"63'172","reported_seq":253,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399454+0000","last_change":"2024-05-07T11:17:21.419673+0000","last_active":"2024-05-07T11:17:26.399454+0000","last_peered":"2024-05-07T11:17:26.399454+0000","last_clean":"2024-05-07T11:17:26.399454+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:26.399454+0000","last_undegraded":"2024-05-07T11:17:26.399454+0000","last_fullsized":"2024-05-07T11:17:26.399454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:01.519110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400659+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:26.400659+0000","last_peered":"2024-05-07T11:17:26.400659+0000","last_clean":"2024-05-07T11:17:26.400659+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:26.400659+0000","last_undegraded":"2024-05-07T11:17:26.400659+0000","last_fullsized":"2024-05-07T11:17:26.400659+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:45.698283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":220,"reported_epoch":79,"state":"peering","last_fresh":"2024-05-07T11:17:26.140679+0000","last_change":"2024-05-07T11:17:27.036190+0000","last_active":"2024-05-07T11:17:27.036190+0000","last_peered":"2024-05-07T11:17:26.140679+0000","last_clean":"2024-05-07T11:14:24.381417+0000","last_became_active":"2024-05-07T11:17:19.436774+0000","last_became_peered":"2024-05-07T11:17:19.436774+0000","last_unstale":"2024-05-07T11:17:26.140679+0000","last_undegraded":"2024-05-07T11:17:26.140679+0000","last_fullsized":"2024-05-07T11:17:19.397337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":311,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.408077+0000","last_change":"2024-05-07T11:17:26.408077+0000","last_active":"2024-05-07T11:17:26.408077+0000","last_peered":"2024-05-07T11:17:26.408077+0000","last_clean":"2024-05-07T11:17:26.408077+0000","last_became_active":"2024-05-07T11:17:26.407230+0000","last_became_peered":"2024-05-07T11:17:26.407230+0000","last_unstale":"2024-05-07T11:17:26.408077+0000","last_undegraded":"2024-05-07T11:17:26.408077+0000","last_fullsized":"2024-05-07T11:17:26.408077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:29.469789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":91096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399511+0000","last_change":"2024-05-07T11:17:18.431271+0000","last_active":"2024-05-07T11:17:26.399511+0000","last_peered":"2024-05-07T11:17:26.399511+0000","last_clean":"2024-05-07T11:17:26.399511+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:26.399511+0000","last_undegraded":"2024-05-07T11:17:26.399511+0000","last_fullsized":"2024-05-07T11:17:26.399511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":225,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400239+0000","last_change":"2024-05-07T11:17:25.403221+0000","last_active":"2024-05-07T11:17:26.400239+0000","last_peered":"2024-05-07T11:17:26.400239+0000","last_clean":"2024-05-07T11:17:26.400239+0000","last_became_active":"2024-05-07T11:17:25.402661+0000","last_became_peered":"2024-05-07T11:17:25.402661+0000","last_unstale":"2024-05-07T11:17:26.400239+0000","last_undegraded":"2024-05-07T11:17:26.400239+0000","last_fullsized":"2024-05-07T11:17:26.400239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:07.574111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.399662+0000","last_change":"2024-05-07T11:17:18.402834+0000","last_active":"2024-05-07T11:17:26.399662+0000","last_peered":"2024-05-07T11:17:26.399662+0000","last_clean":"2024-05-07T11:17:26.399662+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:26.399662+0000","last_undegraded":"2024-05-07T11:17:26.399662+0000","last_fullsized":"2024-05-07T11:17:26.399662+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"63'205","reported_seq":349,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402632+0000","last_change":"2024-05-07T11:17:22.421343+0000","last_active":"2024-05-07T11:17:26.402632+0000","last_peered":"2024-05-07T11:17:26.402632+0000","last_clean":"2024-05-07T11:17:26.402632+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:26.402632+0000","last_undegraded":"2024-05-07T11:17:26.402632+0000","last_fullsized":"2024-05-07T11:17:26.402632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:24.076915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402274+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:26.402274+0000","last_peered":"2024-05-07T11:17:26.402274+0000","last_clean":"2024-05-07T11:17:26.402274+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:26.402274+0000","last_undegraded":"2024-05-07T11:17:26.402274+0000","last_fullsized":"2024-05-07T11:17:26.402274+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:53.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'163","reported_seq":308,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402737+0000","last_change":"2024-05-07T11:17:24.407114+0000","last_active":"2024-05-07T11:17:26.402737+0000","last_peered":"2024-05-07T11:17:26.402737+0000","last_clean":"2024-05-07T11:17:26.402737+0000","last_became_active":"2024-05-07T11:17:24.406337+0000","last_became_peered":"2024-05-07T11:17:24.406337+0000","last_unstale":"2024-05-07T11:17:26.402737+0000","last_undegraded":"2024-05-07T11:17:26.402737+0000","last_fullsized":"2024-05-07T11:17:26.402737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:28:35.002816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":280772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402544+0000","last_change":"2024-05-07T11:17:18.555160+0000","last_active":"2024-05-07T11:17:26.402544+0000","last_peered":"2024-05-07T11:17:26.402544+0000","last_clean":"2024-05-07T11:17:26.402544+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:26.402544+0000","last_undegraded":"2024-05-07T11:17:26.402544+0000","last_fullsized":"2024-05-07T11:17:26.402544+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:37.962741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'166","reported_seq":525,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400102+0000","last_change":"2024-05-07T11:17:21.418540+0000","last_active":"2024-05-07T11:17:26.400102+0000","last_peered":"2024-05-07T11:17:26.400102+0000","last_clean":"2024-05-07T11:17:26.400102+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:26.400102+0000","last_undegraded":"2024-05-07T11:17:26.400102+0000","last_fullsized":"2024-05-07T11:17:26.400102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:16.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":163,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401241+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:26.401241+0000","last_peered":"2024-05-07T11:17:26.401241+0000","last_clean":"2024-05-07T11:17:26.401241+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:26.401241+0000","last_undegraded":"2024-05-07T11:17:26.401241+0000","last_fullsized":"2024-05-07T11:17:26.401241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:17.953399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":306,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-05-07T11:17:26.400960+0000","last_change":"2024-05-07T11:17:19.440247+0000","last_active":"2024-05-07T11:17:26.400960+0000","last_peered":"2024-05-07T11:17:26.400960+0000","last_clean":"2024-05-07T11:14:24.442642+0000","last_became_active":"2024-05-07T11:17:19.439763+0000","last_became_peered":"2024-05-07T11:17:19.439763+0000","last_unstale":"2024-05-07T11:17:26.400960+0000","last_undegraded":"2024-05-07T11:17:19.422552+0000","last_fullsized":"2024-05-07T11:17:19.420828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":102,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":6},{"shards":"2","objects":51}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402986+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:26.402986+0000","last_peered":"2024-05-07T11:17:26.402986+0000","last_clean":"2024-05-07T11:17:26.402986+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:26.402986+0000","last_undegraded":"2024-05-07T11:17:26.402986+0000","last_fullsized":"2024-05-07T11:17:26.402986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:24.011380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'169","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.402147+0000","last_change":"2024-05-07T11:17:22.416150+0000","last_active":"2024-05-07T11:17:26.402147+0000","last_peered":"2024-05-07T11:17:26.402147+0000","last_clean":"2024-05-07T11:17:26.402147+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:26.402147+0000","last_undegraded":"2024-05-07T11:17:26.402147+0000","last_fullsized":"2024-05-07T11:17:26.402147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:28.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400504+0000","last_change":"2024-05-07T11:17:18.504321+0000","last_active":"2024-05-07T11:17:26.400504+0000","last_peered":"2024-05-07T11:17:26.400504+0000","last_clean":"2024-05-07T11:17:26.400504+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:26.400504+0000","last_undegraded":"2024-05-07T11:17:26.400504+0000","last_fullsized":"2024-05-07T11:17:26.400504+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"63'199","reported_seq":606,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.401546+0000","last_change":"2024-05-07T11:17:25.402468+0000","last_active":"2024-05-07T11:17:26.401546+0000","last_peered":"2024-05-07T11:17:26.401546+0000","last_clean":"2024-05-07T11:17:26.401546+0000","last_became_active":"2024-05-07T11:17:25.401850+0000","last_became_peered":"2024-05-07T11:17:25.401850+0000","last_unstale":"2024-05-07T11:17:26.401546+0000","last_undegraded":"2024-05-07T11:17:26.401546+0000","last_fullsized":"2024-05-07T11:17:26.401546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:19.494294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-07T11:17:26.400780+0000","last_change":"2024-05-07T11:17:18.429950+0000","last_active":"2024-05-07T11:17:26.400780+0000","last_peered":"2024-05-07T11:17:26.400780+0000","last_clean":"2024-05-07T11:17:26.400780+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:26.400780+0000","last_undegraded":"2024-05-07T11:17:26.400780+0000","last_fullsized":"2024-05-07T11:17:26.400780+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1076,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4575,"num_bytes_recovered":13586655,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66179072,"data_stored":55197652,"data_compressed":4987032,"data_compressed_allocated":5869568,"data_compressed_original":15495168,"omap_allocated":0,"internal_metadata":0},"log_size":10416,"ondisk_log_size":10416,"up":128,"acting":116,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":428,"ondisk_log_size":428,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87920,"kb_used_data":34528,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94283920,"statfs":{"total":96636764160,"available":96546734080,"internally_reserved":0,"allocated":35356672,"data_stored":57223987,"data_compressed":6730892,"data_compressed_allocated":8085504,"data_compressed_original":38760448,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710724,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58416,"kb_used_data":26660,"kb_used_omap":10,"kb_used_meta":31733,"kb_avail":94313424,"statfs":{"total":96636764160,"available":96576946176,"internally_reserved":0,"allocated":27299840,"data_stored":48085574,"data_compressed":5684480,"data_compressed_allocated":6696960,"data_compressed_original":33890304,"omap_allocated":10404,"internal_metadata":32495452},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56000,"kb_used_data":20652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94315840,"statfs":{"total":96636764160,"available":96579420160,"internally_reserved":0,"allocated":21147648,"data_stored":34537828,"data_compressed":4633449,"data_compressed_allocated":5464064,"data_compressed_original":25022464,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17117184,"data_stored":14234704,"data_compressed":1776054,"data_compressed_allocated":2060288,"data_compressed_original":5341184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21233664,"data_stored":17797247,"data_compressed":1236911,"data_compressed_allocated":1495040,"data_compressed_original":4083712,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27828224,"data_stored":23165701,"data_compressed":1974067,"data_compressed_allocated":2314240,"data_compressed_original":6070272,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:34.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:34.811 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:34.823 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-05-07T11:17:33.014410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5827,"num_bytes_recovered":56847285,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11001,"ondisk_log_size":11001,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":209764,"kb_used_data":80944,"kb_used_omap":13,"kb_used_meta":128754,"kb_avail":282905756,"statfs":{"total":289910292480,"available":289695494144,"internally_reserved":0,"allocated":82886656,"data_stored":138383866,"data_compressed":16835133,"data_compressed_allocated":19951616,"data_compressed_original":96677888,"omap_allocated":13594,"internal_metadata":131844838},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1076,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1230,"num_bytes_recovered":5842334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.614907"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":310,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796409+0000","last_change":"2024-05-07T11:17:27.408581+0000","last_active":"2024-05-07T11:17:30.796409+0000","last_peered":"2024-05-07T11:17:30.796409+0000","last_clean":"2024-05-07T11:17:30.796409+0000","last_became_active":"2024-05-07T11:17:27.407668+0000","last_became_peered":"2024-05-07T11:17:27.407668+0000","last_unstale":"2024-05-07T11:17:30.796409+0000","last_undegraded":"2024-05-07T11:17:30.796409+0000","last_fullsized":"2024-05-07T11:17:30.796409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:48:35.134503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":85925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'155","reported_seq":309,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796170+0000","last_change":"2024-05-07T11:17:21.419253+0000","last_active":"2024-05-07T11:17:30.796170+0000","last_peered":"2024-05-07T11:17:30.796170+0000","last_clean":"2024-05-07T11:17:30.796170+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:30.796170+0000","last_undegraded":"2024-05-07T11:17:30.796170+0000","last_fullsized":"2024-05-07T11:17:30.796170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:45:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'169","reported_seq":517,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403992+0000","last_change":"2024-05-07T11:17:26.408003+0000","last_active":"2024-05-07T11:17:30.403992+0000","last_peered":"2024-05-07T11:17:30.403992+0000","last_clean":"2024-05-07T11:17:30.403992+0000","last_became_active":"2024-05-07T11:17:26.407269+0000","last_became_peered":"2024-05-07T11:17:26.407269+0000","last_unstale":"2024-05-07T11:17:30.403992+0000","last_undegraded":"2024-05-07T11:17:30.403992+0000","last_fullsized":"2024-05-07T11:17:30.403992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:01.664780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":75254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":274,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403937+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:30.403937+0000","last_peered":"2024-05-07T11:17:30.403937+0000","last_clean":"2024-05-07T11:17:30.403937+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:30.403937+0000","last_undegraded":"2024-05-07T11:17:30.403937+0000","last_fullsized":"2024-05-07T11:17:30.403937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"63'186","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795678+0000","last_change":"2024-05-07T11:17:21.419034+0000","last_active":"2024-05-07T11:17:30.795678+0000","last_peered":"2024-05-07T11:17:30.795678+0000","last_clean":"2024-05-07T11:17:30.795678+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:30.795678+0000","last_undegraded":"2024-05-07T11:17:30.795678+0000","last_fullsized":"2024-05-07T11:17:30.795678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:42.536445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":488,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.406178+0000","last_change":"2024-05-07T11:17:30.406178+0000","last_active":"2024-05-07T11:17:30.406178+0000","last_peered":"2024-05-07T11:17:30.406178+0000","last_clean":"2024-05-07T11:17:30.406178+0000","last_became_active":"2024-05-07T11:17:30.405536+0000","last_became_peered":"2024-05-07T11:17:30.405536+0000","last_unstale":"2024-05-07T11:17:30.406178+0000","last_undegraded":"2024-05-07T11:17:30.406178+0000","last_fullsized":"2024-05-07T11:17:30.406178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:47.059204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":529421,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"63'166","reported_seq":269,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403641+0000","last_change":"2024-05-07T11:17:22.418934+0000","last_active":"2024-05-07T11:17:30.403641+0000","last_peered":"2024-05-07T11:17:30.403641+0000","last_clean":"2024-05-07T11:17:30.403641+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:30.403641+0000","last_undegraded":"2024-05-07T11:17:30.403641+0000","last_fullsized":"2024-05-07T11:17:30.403641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:05.143462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403262+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:30.403262+0000","last_peered":"2024-05-07T11:17:30.403262+0000","last_clean":"2024-05-07T11:17:30.403262+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:30.403262+0000","last_undegraded":"2024-05-07T11:17:30.403262+0000","last_fullsized":"2024-05-07T11:17:30.403262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:04.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403549+0000","last_change":"2024-05-07T11:17:27.409473+0000","last_active":"2024-05-07T11:17:30.403549+0000","last_peered":"2024-05-07T11:17:30.403549+0000","last_clean":"2024-05-07T11:17:30.403549+0000","last_became_active":"2024-05-07T11:17:27.408650+0000","last_became_peered":"2024-05-07T11:17:27.408650+0000","last_unstale":"2024-05-07T11:17:30.403549+0000","last_undegraded":"2024-05-07T11:17:30.403549+0000","last_fullsized":"2024-05-07T11:17:30.403549+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:11:56.118436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":631133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"63'156","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794731+0000","last_change":"2024-05-07T11:17:22.416801+0000","last_active":"2024-05-07T11:17:30.794731+0000","last_peered":"2024-05-07T11:17:30.794731+0000","last_clean":"2024-05-07T11:17:30.794731+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:30.794731+0000","last_undegraded":"2024-05-07T11:17:30.794731+0000","last_fullsized":"2024-05-07T11:17:30.794731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:07.028486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'154","reported_seq":450,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404098+0000","last_change":"2024-05-07T11:17:22.419089+0000","last_active":"2024-05-07T11:17:30.404098+0000","last_peered":"2024-05-07T11:17:30.404098+0000","last_clean":"2024-05-07T11:17:30.404098+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:30.404098+0000","last_undegraded":"2024-05-07T11:17:30.404098+0000","last_fullsized":"2024-05-07T11:17:30.404098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:57.833385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":280,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796121+0000","last_change":"2024-05-07T11:17:28.404789+0000","last_active":"2024-05-07T11:17:30.796121+0000","last_peered":"2024-05-07T11:17:30.796121+0000","last_clean":"2024-05-07T11:17:30.796121+0000","last_became_active":"2024-05-07T11:17:28.403770+0000","last_became_peered":"2024-05-07T11:17:28.403770+0000","last_unstale":"2024-05-07T11:17:30.796121+0000","last_undegraded":"2024-05-07T11:17:30.796121+0000","last_fullsized":"2024-05-07T11:17:30.796121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:52.521740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":89602,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'136","reported_seq":291,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795785+0000","last_change":"2024-05-07T11:17:23.398879+0000","last_active":"2024-05-07T11:17:30.795785+0000","last_peered":"2024-05-07T11:17:30.795785+0000","last_clean":"2024-05-07T11:17:30.795785+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:30.795785+0000","last_undegraded":"2024-05-07T11:17:30.795785+0000","last_fullsized":"2024-05-07T11:17:30.795785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:33:07.091905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'175","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403781+0000","last_change":"2024-05-07T11:17:26.407920+0000","last_active":"2024-05-07T11:17:30.403781+0000","last_peered":"2024-05-07T11:17:30.403781+0000","last_clean":"2024-05-07T11:17:30.403781+0000","last_became_active":"2024-05-07T11:17:26.407342+0000","last_became_peered":"2024-05-07T11:17:26.407342+0000","last_unstale":"2024-05-07T11:17:30.403781+0000","last_undegraded":"2024-05-07T11:17:30.403781+0000","last_fullsized":"2024-05-07T11:17:30.403781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:55:22.847728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":196945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":531,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403816+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:30.403816+0000","last_peered":"2024-05-07T11:17:30.403816+0000","last_clean":"2024-05-07T11:17:30.403816+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:30.403816+0000","last_undegraded":"2024-05-07T11:17:30.403816+0000","last_fullsized":"2024-05-07T11:17:30.403816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:30:48.688430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":501,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.406594+0000","last_change":"2024-05-07T11:17:30.406594+0000","last_active":"2024-05-07T11:17:30.406594+0000","last_peered":"2024-05-07T11:17:30.406594+0000","last_clean":"2024-05-07T11:17:30.406594+0000","last_became_active":"2024-05-07T11:17:30.405896+0000","last_became_peered":"2024-05-07T11:17:30.405896+0000","last_unstale":"2024-05-07T11:17:30.406594+0000","last_undegraded":"2024-05-07T11:17:30.406594+0000","last_fullsized":"2024-05-07T11:17:30.406594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:53:51.552775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4343464,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'161","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404106+0000","last_change":"2024-05-07T11:17:22.416613+0000","last_active":"2024-05-07T11:17:30.404106+0000","last_peered":"2024-05-07T11:17:30.404106+0000","last_clean":"2024-05-07T11:17:30.404106+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:30.404106+0000","last_undegraded":"2024-05-07T11:17:30.404106+0000","last_fullsized":"2024-05-07T11:17:30.404106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"63'148","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796047+0000","last_change":"2024-05-07T11:17:21.418472+0000","last_active":"2024-05-07T11:17:30.796047+0000","last_peered":"2024-05-07T11:17:30.796047+0000","last_clean":"2024-05-07T11:17:30.796047+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:30.796047+0000","last_undegraded":"2024-05-07T11:17:30.796047+0000","last_fullsized":"2024-05-07T11:17:30.796047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:18.184681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'147","reported_seq":237,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403595+0000","last_change":"2024-05-07T11:17:21.418164+0000","last_active":"2024-05-07T11:17:30.403595+0000","last_peered":"2024-05-07T11:17:30.403595+0000","last_clean":"2024-05-07T11:17:30.403595+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:30.403595+0000","last_undegraded":"2024-05-07T11:17:30.403595+0000","last_fullsized":"2024-05-07T11:17:30.403595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":573,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404075+0000","last_change":"2024-05-07T11:17:29.407762+0000","last_active":"2024-05-07T11:17:30.404075+0000","last_peered":"2024-05-07T11:17:30.404075+0000","last_clean":"2024-05-07T11:17:30.404075+0000","last_became_active":"2024-05-07T11:17:29.407032+0000","last_became_peered":"2024-05-07T11:17:29.407032+0000","last_unstale":"2024-05-07T11:17:30.404075+0000","last_undegraded":"2024-05-07T11:17:30.404075+0000","last_fullsized":"2024-05-07T11:17:30.404075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:55:10.099065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":98139,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":305,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403794+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:30.403794+0000","last_peered":"2024-05-07T11:17:30.403794+0000","last_clean":"2024-05-07T11:17:30.403794+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:30.403794+0000","last_undegraded":"2024-05-07T11:17:30.403794+0000","last_fullsized":"2024-05-07T11:17:30.403794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795900+0000","last_change":"2024-05-07T11:17:29.408512+0000","last_active":"2024-05-07T11:17:30.795900+0000","last_peered":"2024-05-07T11:17:30.795900+0000","last_clean":"2024-05-07T11:17:30.795900+0000","last_became_active":"2024-05-07T11:17:29.407294+0000","last_became_peered":"2024-05-07T11:17:29.407294+0000","last_unstale":"2024-05-07T11:17:30.795900+0000","last_undegraded":"2024-05-07T11:17:30.795900+0000","last_fullsized":"2024-05-07T11:17:30.795900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:30:15.441943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":116557,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'159","reported_seq":247,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402842+0000","last_change":"2024-05-07T11:17:21.418519+0000","last_active":"2024-05-07T11:17:30.402842+0000","last_peered":"2024-05-07T11:17:30.402842+0000","last_clean":"2024-05-07T11:17:30.402842+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:30.402842+0000","last_undegraded":"2024-05-07T11:17:30.402842+0000","last_fullsized":"2024-05-07T11:17:30.402842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"63'169","reported_seq":323,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795399+0000","last_change":"2024-05-07T11:17:21.414896+0000","last_active":"2024-05-07T11:17:30.795399+0000","last_peered":"2024-05-07T11:17:30.795399+0000","last_clean":"2024-05-07T11:17:30.795399+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:30.795399+0000","last_undegraded":"2024-05-07T11:17:30.795399+0000","last_fullsized":"2024-05-07T11:17:30.795399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:52.242314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796018+0000","last_change":"2024-05-07T11:17:24.407028+0000","last_active":"2024-05-07T11:17:30.796018+0000","last_peered":"2024-05-07T11:17:30.796018+0000","last_clean":"2024-05-07T11:17:30.796018+0000","last_became_active":"2024-05-07T11:17:24.406307+0000","last_became_peered":"2024-05-07T11:17:24.406307+0000","last_unstale":"2024-05-07T11:17:30.796018+0000","last_undegraded":"2024-05-07T11:17:30.796018+0000","last_fullsized":"2024-05-07T11:17:30.796018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:24.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":230897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'195","reported_seq":345,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403991+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:17:30.403991+0000","last_peered":"2024-05-07T11:17:30.403991+0000","last_clean":"2024-05-07T11:17:30.403991+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:30.403991+0000","last_undegraded":"2024-05-07T11:17:30.403991+0000","last_fullsized":"2024-05-07T11:17:30.403991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404276+0000","last_change":"2024-05-07T11:17:29.416071+0000","last_active":"2024-05-07T11:17:30.404276+0000","last_peered":"2024-05-07T11:17:30.404276+0000","last_clean":"2024-05-07T11:17:30.404276+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:30.404276+0000","last_undegraded":"2024-05-07T11:17:30.404276+0000","last_fullsized":"2024-05-07T11:17:30.404276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:42.494889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":67681,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":287,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796001+0000","last_change":"2024-05-07T11:17:28.404770+0000","last_active":"2024-05-07T11:17:30.796001+0000","last_peered":"2024-05-07T11:17:30.796001+0000","last_clean":"2024-05-07T11:17:30.796001+0000","last_became_active":"2024-05-07T11:17:28.403782+0000","last_became_peered":"2024-05-07T11:17:28.403782+0000","last_unstale":"2024-05-07T11:17:30.796001+0000","last_undegraded":"2024-05-07T11:17:30.796001+0000","last_fullsized":"2024-05-07T11:17:30.796001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:38.547257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":211687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":247,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403283+0000","last_change":"2024-05-07T11:17:24.403807+0000","last_active":"2024-05-07T11:17:30.403283+0000","last_peered":"2024-05-07T11:17:30.403283+0000","last_clean":"2024-05-07T11:17:30.403283+0000","last_became_active":"2024-05-07T11:17:24.403179+0000","last_became_peered":"2024-05-07T11:17:24.403179+0000","last_unstale":"2024-05-07T11:17:30.403283+0000","last_undegraded":"2024-05-07T11:17:30.403283+0000","last_fullsized":"2024-05-07T11:17:30.403283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:15:55.499366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":323,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795763+0000","last_change":"2024-05-07T11:17:29.409488+0000","last_active":"2024-05-07T11:17:30.795763+0000","last_peered":"2024-05-07T11:17:30.795763+0000","last_clean":"2024-05-07T11:17:30.795763+0000","last_became_active":"2024-05-07T11:17:29.408425+0000","last_became_peered":"2024-05-07T11:17:29.408425+0000","last_unstale":"2024-05-07T11:17:30.795763+0000","last_undegraded":"2024-05-07T11:17:30.795763+0000","last_fullsized":"2024-05-07T11:17:30.795763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:34.508418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":86167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'192","reported_seq":586,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402995+0000","last_change":"2024-05-07T11:17:22.416120+0000","last_active":"2024-05-07T11:17:30.402995+0000","last_peered":"2024-05-07T11:17:30.402995+0000","last_clean":"2024-05-07T11:17:30.402995+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:30.402995+0000","last_undegraded":"2024-05-07T11:17:30.402995+0000","last_fullsized":"2024-05-07T11:17:30.402995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:13.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"63'185","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403405+0000","last_change":"2024-05-07T11:17:28.399808+0000","last_active":"2024-05-07T11:17:30.403405+0000","last_peered":"2024-05-07T11:17:30.403405+0000","last_clean":"2024-05-07T11:17:30.403405+0000","last_became_active":"2024-05-07T11:17:28.398801+0000","last_became_peered":"2024-05-07T11:17:28.398801+0000","last_unstale":"2024-05-07T11:17:30.403405+0000","last_undegraded":"2024-05-07T11:17:30.403405+0000","last_fullsized":"2024-05-07T11:17:30.403405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:34.170387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":459999,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'156","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794879+0000","last_change":"2024-05-07T11:17:22.416165+0000","last_active":"2024-05-07T11:17:30.794879+0000","last_peered":"2024-05-07T11:17:30.794879+0000","last_clean":"2024-05-07T11:17:30.794879+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:30.794879+0000","last_undegraded":"2024-05-07T11:17:30.794879+0000","last_fullsized":"2024-05-07T11:17:30.794879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:57.237765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":277,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404046+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:30.404046+0000","last_peered":"2024-05-07T11:17:30.404046+0000","last_clean":"2024-05-07T11:17:30.404046+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:30.404046+0000","last_undegraded":"2024-05-07T11:17:30.404046+0000","last_fullsized":"2024-05-07T11:17:30.404046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"63'141","reported_seq":295,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796184+0000","last_change":"2024-05-07T11:17:21.419206+0000","last_active":"2024-05-07T11:17:30.796184+0000","last_peered":"2024-05-07T11:17:30.796184+0000","last_clean":"2024-05-07T11:17:30.796184+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:30.796184+0000","last_undegraded":"2024-05-07T11:17:30.796184+0000","last_fullsized":"2024-05-07T11:17:30.796184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:12.679336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403297+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:30.403297+0000","last_peered":"2024-05-07T11:17:30.403297+0000","last_clean":"2024-05-07T11:17:30.403297+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:30.403297+0000","last_undegraded":"2024-05-07T11:17:30.403297+0000","last_fullsized":"2024-05-07T11:17:30.403297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.025763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"63'179","reported_seq":267,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403562+0000","last_change":"2024-05-07T11:17:21.419284+0000","last_active":"2024-05-07T11:17:30.403562+0000","last_peered":"2024-05-07T11:17:30.403562+0000","last_clean":"2024-05-07T11:17:30.403562+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:30.403562+0000","last_undegraded":"2024-05-07T11:17:30.403562+0000","last_fullsized":"2024-05-07T11:17:30.403562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:54.463898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795361+0000","last_change":"2024-05-07T11:17:18.423604+0000","last_active":"2024-05-07T11:17:30.795361+0000","last_peered":"2024-05-07T11:17:30.795361+0000","last_clean":"2024-05-07T11:17:30.795361+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:30.795361+0000","last_undegraded":"2024-05-07T11:17:30.795361+0000","last_fullsized":"2024-05-07T11:17:30.795361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:45:28.650148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":244,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403803+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:30.403803+0000","last_peered":"2024-05-07T11:17:30.403803+0000","last_clean":"2024-05-07T11:17:30.403803+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:30.403803+0000","last_undegraded":"2024-05-07T11:17:30.403803+0000","last_fullsized":"2024-05-07T11:17:30.403803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403673+0000","last_change":"2024-05-07T11:17:18.433027+0000","last_active":"2024-05-07T11:17:30.403673+0000","last_peered":"2024-05-07T11:17:30.403673+0000","last_clean":"2024-05-07T11:17:30.403673+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:30.403673+0000","last_undegraded":"2024-05-07T11:17:30.403673+0000","last_fullsized":"2024-05-07T11:17:30.403673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:47.068504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404359+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:30.404359+0000","last_peered":"2024-05-07T11:17:30.404359+0000","last_clean":"2024-05-07T11:17:30.404359+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:30.404359+0000","last_undegraded":"2024-05-07T11:17:30.404359+0000","last_fullsized":"2024-05-07T11:17:30.404359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:35:51.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'155","reported_seq":435,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403110+0000","last_change":"2024-05-07T11:17:27.404484+0000","last_active":"2024-05-07T11:17:30.403110+0000","last_peered":"2024-05-07T11:17:30.403110+0000","last_clean":"2024-05-07T11:17:30.403110+0000","last_became_active":"2024-05-07T11:17:27.403866+0000","last_became_peered":"2024-05-07T11:17:27.403866+0000","last_unstale":"2024-05-07T11:17:30.403110+0000","last_undegraded":"2024-05-07T11:17:30.403110+0000","last_fullsized":"2024-05-07T11:17:30.403110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:15:32.849874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":166862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795883+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:30.795883+0000","last_peered":"2024-05-07T11:17:30.795883+0000","last_clean":"2024-05-07T11:17:30.795883+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:30.795883+0000","last_undegraded":"2024-05-07T11:17:30.795883+0000","last_fullsized":"2024-05-07T11:17:30.795883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:16.479879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'167","reported_seq":321,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795133+0000","last_change":"2024-05-07T11:17:21.418782+0000","last_active":"2024-05-07T11:17:30.795133+0000","last_peered":"2024-05-07T11:17:30.795133+0000","last_clean":"2024-05-07T11:17:30.795133+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:30.795133+0000","last_undegraded":"2024-05-07T11:17:30.795133+0000","last_fullsized":"2024-05-07T11:17:30.795133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:13.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404754+0000","last_change":"2024-05-07T11:17:22.419069+0000","last_active":"2024-05-07T11:17:30.404754+0000","last_peered":"2024-05-07T11:17:30.404754+0000","last_clean":"2024-05-07T11:17:30.404754+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:30.404754+0000","last_undegraded":"2024-05-07T11:17:30.404754+0000","last_fullsized":"2024-05-07T11:17:30.404754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:20.890067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404443+0000","last_change":"2024-05-07T11:17:29.408348+0000","last_active":"2024-05-07T11:17:30.404443+0000","last_peered":"2024-05-07T11:17:30.404443+0000","last_clean":"2024-05-07T11:17:30.404443+0000","last_became_active":"2024-05-07T11:17:29.407677+0000","last_became_peered":"2024-05-07T11:17:29.407677+0000","last_unstale":"2024-05-07T11:17:30.404443+0000","last_undegraded":"2024-05-07T11:17:30.404443+0000","last_fullsized":"2024-05-07T11:17:30.404443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:02.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":83336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404663+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:30.404663+0000","last_peered":"2024-05-07T11:17:30.404663+0000","last_clean":"2024-05-07T11:17:30.404663+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:30.404663+0000","last_undegraded":"2024-05-07T11:17:30.404663+0000","last_fullsized":"2024-05-07T11:17:30.404663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:31:28.580245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"63'164","reported_seq":314,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403552+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:17:30.403552+0000","last_peered":"2024-05-07T11:17:30.403552+0000","last_clean":"2024-05-07T11:17:30.403552+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:30.403552+0000","last_undegraded":"2024-05-07T11:17:30.403552+0000","last_fullsized":"2024-05-07T11:17:30.403552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403688+0000","last_change":"2024-05-07T11:17:18.450923+0000","last_active":"2024-05-07T11:17:30.403688+0000","last_peered":"2024-05-07T11:17:30.403688+0000","last_clean":"2024-05-07T11:17:30.403688+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:30.403688+0000","last_undegraded":"2024-05-07T11:17:30.403688+0000","last_fullsized":"2024-05-07T11:17:30.403688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:38.864461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"63'172","reported_seq":560,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404209+0000","last_change":"2024-05-07T11:17:28.401492+0000","last_active":"2024-05-07T11:17:30.404209+0000","last_peered":"2024-05-07T11:17:30.404209+0000","last_clean":"2024-05-07T11:17:30.404209+0000","last_became_active":"2024-05-07T11:17:28.400673+0000","last_became_peered":"2024-05-07T11:17:28.400673+0000","last_unstale":"2024-05-07T11:17:30.404209+0000","last_undegraded":"2024-05-07T11:17:30.404209+0000","last_fullsized":"2024-05-07T11:17:30.404209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:41.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":127501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404803+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:30.404803+0000","last_peered":"2024-05-07T11:17:30.404803+0000","last_clean":"2024-05-07T11:17:30.404803+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:30.404803+0000","last_undegraded":"2024-05-07T11:17:30.404803+0000","last_fullsized":"2024-05-07T11:17:30.404803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"63'163","reported_seq":519,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404591+0000","last_change":"2024-05-07T11:17:27.405072+0000","last_active":"2024-05-07T11:17:30.404591+0000","last_peered":"2024-05-07T11:17:30.404591+0000","last_clean":"2024-05-07T11:17:30.404591+0000","last_became_active":"2024-05-07T11:17:27.404340+0000","last_became_peered":"2024-05-07T11:17:27.404340+0000","last_unstale":"2024-05-07T11:17:30.404591+0000","last_undegraded":"2024-05-07T11:17:30.404591+0000","last_fullsized":"2024-05-07T11:17:30.404591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:05:12.602038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":119690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795129+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:30.795129+0000","last_peered":"2024-05-07T11:17:30.795129+0000","last_clean":"2024-05-07T11:17:30.795129+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:30.795129+0000","last_undegraded":"2024-05-07T11:17:30.795129+0000","last_fullsized":"2024-05-07T11:17:30.795129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:47.689436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'137","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403862+0000","last_change":"2024-05-07T11:17:24.403787+0000","last_active":"2024-05-07T11:17:30.403862+0000","last_peered":"2024-05-07T11:17:30.403862+0000","last_clean":"2024-05-07T11:17:30.403862+0000","last_became_active":"2024-05-07T11:17:24.403279+0000","last_became_peered":"2024-05-07T11:17:24.403279+0000","last_unstale":"2024-05-07T11:17:30.403862+0000","last_undegraded":"2024-05-07T11:17:30.403862+0000","last_fullsized":"2024-05-07T11:17:30.403862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:42.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":119,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795539+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:30.795539+0000","last_peered":"2024-05-07T11:17:30.795539+0000","last_clean":"2024-05-07T11:17:30.795539+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:30.795539+0000","last_undegraded":"2024-05-07T11:17:30.795539+0000","last_fullsized":"2024-05-07T11:17:30.795539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:59.411938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'141","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403996+0000","last_change":"2024-05-07T11:17:22.417126+0000","last_active":"2024-05-07T11:17:30.403996+0000","last_peered":"2024-05-07T11:17:30.403996+0000","last_clean":"2024-05-07T11:17:30.403996+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:30.403996+0000","last_undegraded":"2024-05-07T11:17:30.403996+0000","last_fullsized":"2024-05-07T11:17:30.403996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":359,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404346+0000","last_change":"2024-05-07T11:17:18.433863+0000","last_active":"2024-05-07T11:17:30.404346+0000","last_peered":"2024-05-07T11:17:30.404346+0000","last_clean":"2024-05-07T11:17:30.404346+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:30.404346+0000","last_undegraded":"2024-05-07T11:17:30.404346+0000","last_fullsized":"2024-05-07T11:17:30.404346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:10.515455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404385+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:30.404385+0000","last_peered":"2024-05-07T11:17:30.404385+0000","last_clean":"2024-05-07T11:17:30.404385+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:30.404385+0000","last_undegraded":"2024-05-07T11:17:30.404385+0000","last_fullsized":"2024-05-07T11:17:30.404385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:03:02.539869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403061+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:30.403061+0000","last_peered":"2024-05-07T11:17:30.403061+0000","last_clean":"2024-05-07T11:17:30.403061+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:30.403061+0000","last_undegraded":"2024-05-07T11:17:30.403061+0000","last_fullsized":"2024-05-07T11:17:30.403061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404654+0000","last_change":"2024-05-07T11:17:29.231999+0000","last_active":"2024-05-07T11:17:30.404654+0000","last_peered":"2024-05-07T11:17:30.404654+0000","last_clean":"2024-05-07T11:17:30.404654+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:30.404654+0000","last_undegraded":"2024-05-07T11:17:30.404654+0000","last_fullsized":"2024-05-07T11:17:30.404654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:37.451106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":138308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404219+0000","last_change":"2024-05-07T11:17:18.433452+0000","last_active":"2024-05-07T11:17:30.404219+0000","last_peered":"2024-05-07T11:17:30.404219+0000","last_clean":"2024-05-07T11:17:30.404219+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:30.404219+0000","last_undegraded":"2024-05-07T11:17:30.404219+0000","last_fullsized":"2024-05-07T11:17:30.404219+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:26.663080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":220,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403281+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:17:30.403281+0000","last_peered":"2024-05-07T11:17:30.403281+0000","last_clean":"2024-05-07T11:17:30.403281+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:30.403281+0000","last_undegraded":"2024-05-07T11:17:30.403281+0000","last_fullsized":"2024-05-07T11:17:30.403281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"63'160","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795913+0000","last_change":"2024-05-07T11:17:24.407000+0000","last_active":"2024-05-07T11:17:30.795913+0000","last_peered":"2024-05-07T11:17:30.795913+0000","last_clean":"2024-05-07T11:17:30.795913+0000","last_became_active":"2024-05-07T11:17:24.406306+0000","last_became_peered":"2024-05-07T11:17:24.406306+0000","last_unstale":"2024-05-07T11:17:30.795913+0000","last_undegraded":"2024-05-07T11:17:30.795913+0000","last_fullsized":"2024-05-07T11:17:30.795913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:56:56.763708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":402414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403560+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:30.403560+0000","last_peered":"2024-05-07T11:17:30.403560+0000","last_clean":"2024-05-07T11:17:30.403560+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:30.403560+0000","last_undegraded":"2024-05-07T11:17:30.403560+0000","last_fullsized":"2024-05-07T11:17:30.403560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:20.744525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795119+0000","last_change":"2024-05-07T11:17:18.572639+0000","last_active":"2024-05-07T11:17:30.795119+0000","last_peered":"2024-05-07T11:17:30.795119+0000","last_clean":"2024-05-07T11:17:30.795119+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:30.795119+0000","last_undegraded":"2024-05-07T11:17:30.795119+0000","last_fullsized":"2024-05-07T11:17:30.795119+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:15.538158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403967+0000","last_change":"2024-05-07T11:17:26.407965+0000","last_active":"2024-05-07T11:17:30.403967+0000","last_peered":"2024-05-07T11:17:30.403967+0000","last_clean":"2024-05-07T11:17:30.403967+0000","last_became_active":"2024-05-07T11:17:26.407203+0000","last_became_peered":"2024-05-07T11:17:26.407203+0000","last_unstale":"2024-05-07T11:17:30.403967+0000","last_undegraded":"2024-05-07T11:17:30.403967+0000","last_fullsized":"2024-05-07T11:17:30.403967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:50.842472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":384377,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404866+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:30.404866+0000","last_peered":"2024-05-07T11:17:30.404866+0000","last_clean":"2024-05-07T11:17:30.404866+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:30.404866+0000","last_undegraded":"2024-05-07T11:17:30.404866+0000","last_fullsized":"2024-05-07T11:17:30.404866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":162,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404316+0000","last_change":"2024-05-07T11:17:18.404539+0000","last_active":"2024-05-07T11:17:30.404316+0000","last_peered":"2024-05-07T11:17:30.404316+0000","last_clean":"2024-05-07T11:17:30.404316+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:30.404316+0000","last_undegraded":"2024-05-07T11:17:30.404316+0000","last_fullsized":"2024-05-07T11:17:30.404316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:50.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":233,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403988+0000","last_change":"2024-05-07T11:17:25.412664+0000","last_active":"2024-05-07T11:17:30.403988+0000","last_peered":"2024-05-07T11:17:30.403988+0000","last_clean":"2024-05-07T11:17:30.403988+0000","last_became_active":"2024-05-07T11:17:25.412026+0000","last_became_peered":"2024-05-07T11:17:25.412026+0000","last_unstale":"2024-05-07T11:17:30.403988+0000","last_undegraded":"2024-05-07T11:17:30.403988+0000","last_fullsized":"2024-05-07T11:17:30.403988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:19:28.465664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":174891,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404777+0000","last_change":"2024-05-07T11:17:22.424750+0000","last_active":"2024-05-07T11:17:30.404777+0000","last_peered":"2024-05-07T11:17:30.404777+0000","last_clean":"2024-05-07T11:17:30.404777+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:30.404777+0000","last_undegraded":"2024-05-07T11:17:30.404777+0000","last_fullsized":"2024-05-07T11:17:30.404777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:12.283160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404113+0000","last_change":"2024-05-07T11:17:18.433137+0000","last_active":"2024-05-07T11:17:30.404113+0000","last_peered":"2024-05-07T11:17:30.404113+0000","last_clean":"2024-05-07T11:17:30.404113+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:30.404113+0000","last_undegraded":"2024-05-07T11:17:30.404113+0000","last_fullsized":"2024-05-07T11:17:30.404113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:40.770823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":296,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795321+0000","last_change":"2024-05-07T11:17:29.408764+0000","last_active":"2024-05-07T11:17:30.795321+0000","last_peered":"2024-05-07T11:17:30.795321+0000","last_clean":"2024-05-07T11:17:30.795321+0000","last_became_active":"2024-05-07T11:17:29.407296+0000","last_became_peered":"2024-05-07T11:17:29.407296+0000","last_unstale":"2024-05-07T11:17:30.795321+0000","last_undegraded":"2024-05-07T11:17:30.795321+0000","last_fullsized":"2024-05-07T11:17:30.795321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:34:42.615088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":74509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403776+0000","last_change":"2024-05-07T11:17:18.431763+0000","last_active":"2024-05-07T11:17:30.403776+0000","last_peered":"2024-05-07T11:17:30.403776+0000","last_clean":"2024-05-07T11:17:30.403776+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:30.403776+0000","last_undegraded":"2024-05-07T11:17:30.403776+0000","last_fullsized":"2024-05-07T11:17:30.403776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:38.234395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":125,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796383+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:30.796383+0000","last_peered":"2024-05-07T11:17:30.796383+0000","last_clean":"2024-05-07T11:17:30.796383+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:30.796383+0000","last_undegraded":"2024-05-07T11:17:30.796383+0000","last_fullsized":"2024-05-07T11:17:30.796383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:54.609817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'181","reported_seq":331,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795311+0000","last_change":"2024-05-07T11:17:23.399296+0000","last_active":"2024-05-07T11:17:30.795311+0000","last_peered":"2024-05-07T11:17:30.795311+0000","last_clean":"2024-05-07T11:17:30.795311+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:30.795311+0000","last_undegraded":"2024-05-07T11:17:30.795311+0000","last_fullsized":"2024-05-07T11:17:30.795311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:21.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":100,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404018+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:30.404018+0000","last_peered":"2024-05-07T11:17:30.404018+0000","last_clean":"2024-05-07T11:17:30.404018+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:30.404018+0000","last_undegraded":"2024-05-07T11:17:30.404018+0000","last_fullsized":"2024-05-07T11:17:30.404018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:03.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403832+0000","last_change":"2024-05-07T11:17:18.432358+0000","last_active":"2024-05-07T11:17:30.403832+0000","last_peered":"2024-05-07T11:17:30.403832+0000","last_clean":"2024-05-07T11:17:30.403832+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:30.403832+0000","last_undegraded":"2024-05-07T11:17:30.403832+0000","last_fullsized":"2024-05-07T11:17:30.403832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:36.281521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"63'175","reported_seq":285,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403129+0000","last_change":"2024-05-07T11:17:22.420080+0000","last_active":"2024-05-07T11:17:30.403129+0000","last_peered":"2024-05-07T11:17:30.403129+0000","last_clean":"2024-05-07T11:17:30.403129+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:30.403129+0000","last_undegraded":"2024-05-07T11:17:30.403129+0000","last_fullsized":"2024-05-07T11:17:30.403129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:41.233935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'38","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403696+0000","last_change":"2024-05-07T11:17:18.459674+0000","last_active":"2024-05-07T11:17:30.403696+0000","last_peered":"2024-05-07T11:17:30.403696+0000","last_clean":"2024-05-07T11:17:30.403696+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:30.403696+0000","last_undegraded":"2024-05-07T11:17:30.403696+0000","last_fullsized":"2024-05-07T11:17:30.403696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:35.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404514+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:30.404514+0000","last_peered":"2024-05-07T11:17:30.404514+0000","last_clean":"2024-05-07T11:17:30.404514+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:30.404514+0000","last_undegraded":"2024-05-07T11:17:30.404514+0000","last_fullsized":"2024-05-07T11:17:30.404514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:14.650941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'138","reported_seq":290,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794688+0000","last_change":"2024-05-07T11:17:22.417629+0000","last_active":"2024-05-07T11:17:30.794688+0000","last_peered":"2024-05-07T11:17:30.794688+0000","last_clean":"2024-05-07T11:17:30.794688+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:30.794688+0000","last_undegraded":"2024-05-07T11:17:30.794688+0000","last_fullsized":"2024-05-07T11:17:30.794688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:58.760049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'164","reported_seq":510,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403556+0000","last_change":"2024-05-07T11:17:23.400613+0000","last_active":"2024-05-07T11:17:30.403556+0000","last_peered":"2024-05-07T11:17:30.403556+0000","last_clean":"2024-05-07T11:17:30.403556+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:30.403556+0000","last_undegraded":"2024-05-07T11:17:30.403556+0000","last_fullsized":"2024-05-07T11:17:30.403556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:28.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":208,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404486+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:30.404486+0000","last_peered":"2024-05-07T11:17:30.404486+0000","last_clean":"2024-05-07T11:17:30.404486+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:30.404486+0000","last_undegraded":"2024-05-07T11:17:30.404486+0000","last_fullsized":"2024-05-07T11:17:30.404486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:35.832524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":228,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403482+0000","last_change":"2024-05-07T11:17:25.413137+0000","last_active":"2024-05-07T11:17:30.403482+0000","last_peered":"2024-05-07T11:17:30.403482+0000","last_clean":"2024-05-07T11:17:30.403482+0000","last_became_active":"2024-05-07T11:17:25.412149+0000","last_became_peered":"2024-05-07T11:17:25.412149+0000","last_unstale":"2024-05-07T11:17:30.403482+0000","last_undegraded":"2024-05-07T11:17:30.403482+0000","last_fullsized":"2024-05-07T11:17:30.403482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:05.259035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795725+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:30.795725+0000","last_peered":"2024-05-07T11:17:30.795725+0000","last_clean":"2024-05-07T11:17:30.795725+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:30.795725+0000","last_undegraded":"2024-05-07T11:17:30.795725+0000","last_fullsized":"2024-05-07T11:17:30.795725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:46.092532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404461+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:30.404461+0000","last_peered":"2024-05-07T11:17:30.404461+0000","last_clean":"2024-05-07T11:17:30.404461+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:30.404461+0000","last_undegraded":"2024-05-07T11:17:30.404461+0000","last_fullsized":"2024-05-07T11:17:30.404461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.076287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"63'172","reported_seq":261,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402830+0000","last_change":"2024-05-07T11:17:21.419673+0000","last_active":"2024-05-07T11:17:30.402830+0000","last_peered":"2024-05-07T11:17:30.402830+0000","last_clean":"2024-05-07T11:17:30.402830+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:30.402830+0000","last_undegraded":"2024-05-07T11:17:30.402830+0000","last_fullsized":"2024-05-07T11:17:30.402830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:01.519110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403713+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:30.403713+0000","last_peered":"2024-05-07T11:17:30.403713+0000","last_clean":"2024-05-07T11:17:30.403713+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:30.403713+0000","last_undegraded":"2024-05-07T11:17:30.403713+0000","last_fullsized":"2024-05-07T11:17:30.403713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:45.698283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":234,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403625+0000","last_change":"2024-05-07T11:17:27.408792+0000","last_active":"2024-05-07T11:17:30.403625+0000","last_peered":"2024-05-07T11:17:30.403625+0000","last_clean":"2024-05-07T11:17:30.403625+0000","last_became_active":"2024-05-07T11:17:27.407792+0000","last_became_peered":"2024-05-07T11:17:27.407792+0000","last_unstale":"2024-05-07T11:17:30.403625+0000","last_undegraded":"2024-05-07T11:17:30.403625+0000","last_fullsized":"2024-05-07T11:17:30.403625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":319,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796036+0000","last_change":"2024-05-07T11:17:26.408077+0000","last_active":"2024-05-07T11:17:30.796036+0000","last_peered":"2024-05-07T11:17:30.796036+0000","last_clean":"2024-05-07T11:17:30.796036+0000","last_became_active":"2024-05-07T11:17:26.407230+0000","last_became_peered":"2024-05-07T11:17:26.407230+0000","last_unstale":"2024-05-07T11:17:30.796036+0000","last_undegraded":"2024-05-07T11:17:30.796036+0000","last_fullsized":"2024-05-07T11:17:30.796036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:29.469789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":91096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402939+0000","last_change":"2024-05-07T11:17:18.431271+0000","last_active":"2024-05-07T11:17:30.402939+0000","last_peered":"2024-05-07T11:17:30.402939+0000","last_clean":"2024-05-07T11:17:30.402939+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:30.402939+0000","last_undegraded":"2024-05-07T11:17:30.402939+0000","last_fullsized":"2024-05-07T11:17:30.402939+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":233,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403514+0000","last_change":"2024-05-07T11:17:25.403221+0000","last_active":"2024-05-07T11:17:30.403514+0000","last_peered":"2024-05-07T11:17:30.403514+0000","last_clean":"2024-05-07T11:17:30.403514+0000","last_became_active":"2024-05-07T11:17:25.402661+0000","last_became_peered":"2024-05-07T11:17:25.402661+0000","last_unstale":"2024-05-07T11:17:30.403514+0000","last_undegraded":"2024-05-07T11:17:30.403514+0000","last_fullsized":"2024-05-07T11:17:30.403514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:07.574111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403047+0000","last_change":"2024-05-07T11:17:18.402834+0000","last_active":"2024-05-07T11:17:30.403047+0000","last_peered":"2024-05-07T11:17:30.403047+0000","last_clean":"2024-05-07T11:17:30.403047+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:30.403047+0000","last_undegraded":"2024-05-07T11:17:30.403047+0000","last_fullsized":"2024-05-07T11:17:30.403047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"63'205","reported_seq":357,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794925+0000","last_change":"2024-05-07T11:17:22.421343+0000","last_active":"2024-05-07T11:17:30.794925+0000","last_peered":"2024-05-07T11:17:30.794925+0000","last_clean":"2024-05-07T11:17:30.794925+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:30.794925+0000","last_undegraded":"2024-05-07T11:17:30.794925+0000","last_fullsized":"2024-05-07T11:17:30.794925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:24.076915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795839+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:30.795839+0000","last_peered":"2024-05-07T11:17:30.795839+0000","last_clean":"2024-05-07T11:17:30.795839+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:30.795839+0000","last_undegraded":"2024-05-07T11:17:30.795839+0000","last_fullsized":"2024-05-07T11:17:30.795839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:53.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'163","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795930+0000","last_change":"2024-05-07T11:17:24.407114+0000","last_active":"2024-05-07T11:17:30.795930+0000","last_peered":"2024-05-07T11:17:30.795930+0000","last_clean":"2024-05-07T11:17:30.795930+0000","last_became_active":"2024-05-07T11:17:24.406337+0000","last_became_peered":"2024-05-07T11:17:24.406337+0000","last_unstale":"2024-05-07T11:17:30.795930+0000","last_undegraded":"2024-05-07T11:17:30.795930+0000","last_fullsized":"2024-05-07T11:17:30.795930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:28:35.002816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":280772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795500+0000","last_change":"2024-05-07T11:17:18.555160+0000","last_active":"2024-05-07T11:17:30.795500+0000","last_peered":"2024-05-07T11:17:30.795500+0000","last_clean":"2024-05-07T11:17:30.795500+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:30.795500+0000","last_undegraded":"2024-05-07T11:17:30.795500+0000","last_fullsized":"2024-05-07T11:17:30.795500+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:37.962741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'166","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403479+0000","last_change":"2024-05-07T11:17:21.418540+0000","last_active":"2024-05-07T11:17:30.403479+0000","last_peered":"2024-05-07T11:17:30.403479+0000","last_clean":"2024-05-07T11:17:30.403479+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:30.403479+0000","last_undegraded":"2024-05-07T11:17:30.403479+0000","last_fullsized":"2024-05-07T11:17:30.403479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:16.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":171,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404368+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:30.404368+0000","last_peered":"2024-05-07T11:17:30.404368+0000","last_clean":"2024-05-07T11:17:30.404368+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:30.404368+0000","last_undegraded":"2024-05-07T11:17:30.404368+0000","last_fullsized":"2024-05-07T11:17:30.404368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:17.953399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.407286+0000","last_change":"2024-05-07T11:17:30.407286+0000","last_active":"2024-05-07T11:17:30.407286+0000","last_peered":"2024-05-07T11:17:30.407286+0000","last_clean":"2024-05-07T11:17:30.407286+0000","last_became_active":"2024-05-07T11:17:30.406353+0000","last_became_peered":"2024-05-07T11:17:30.406353+0000","last_unstale":"2024-05-07T11:17:30.407286+0000","last_undegraded":"2024-05-07T11:17:30.407286+0000","last_fullsized":"2024-05-07T11:17:30.407286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:51.684426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":124612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795798+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:30.795798+0000","last_peered":"2024-05-07T11:17:30.795798+0000","last_clean":"2024-05-07T11:17:30.795798+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:30.795798+0000","last_undegraded":"2024-05-07T11:17:30.795798+0000","last_fullsized":"2024-05-07T11:17:30.795798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:24.011380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'169","reported_seq":321,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794835+0000","last_change":"2024-05-07T11:17:22.416150+0000","last_active":"2024-05-07T11:17:30.794835+0000","last_peered":"2024-05-07T11:17:30.794835+0000","last_clean":"2024-05-07T11:17:30.794835+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:30.794835+0000","last_undegraded":"2024-05-07T11:17:30.794835+0000","last_fullsized":"2024-05-07T11:17:30.794835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:28.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403986+0000","last_change":"2024-05-07T11:17:18.504321+0000","last_active":"2024-05-07T11:17:30.403986+0000","last_peered":"2024-05-07T11:17:30.403986+0000","last_clean":"2024-05-07T11:17:30.403986+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:30.403986+0000","last_undegraded":"2024-05-07T11:17:30.403986+0000","last_fullsized":"2024-05-07T11:17:30.403986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"63'199","reported_seq":614,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403820+0000","last_change":"2024-05-07T11:17:25.402468+0000","last_active":"2024-05-07T11:17:30.403820+0000","last_peered":"2024-05-07T11:17:30.403820+0000","last_clean":"2024-05-07T11:17:30.403820+0000","last_became_active":"2024-05-07T11:17:25.401850+0000","last_became_peered":"2024-05-07T11:17:25.401850+0000","last_unstale":"2024-05-07T11:17:30.403820+0000","last_undegraded":"2024-05-07T11:17:30.403820+0000","last_fullsized":"2024-05-07T11:17:30.403820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:19.494294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403872+0000","last_change":"2024-05-07T11:17:18.429950+0000","last_active":"2024-05-07T11:17:30.403872+0000","last_peered":"2024-05-07T11:17:30.403872+0000","last_clean":"2024-05-07T11:17:30.403872+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:30.403872+0000","last_undegraded":"2024-05-07T11:17:30.403872+0000","last_fullsized":"2024-05-07T11:17:30.403872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5805,"num_bytes_recovered":19428989,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64405504,"data_stored":53099596,"data_compressed":4611280,"data_compressed_allocated":5402624,"data_compressed_original":14118912,"omap_allocated":0,"internal_metadata":0},"log_size":10416,"ondisk_log_size":10416,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":428,"ondisk_log_size":428,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84172,"kb_used_data":30776,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94287668,"statfs":{"total":96636764160,"available":96550572032,"internally_reserved":0,"allocated":31514624,"data_stored":54276063,"data_compressed":6326260,"data_compressed_allocated":7593984,"data_compressed_original":37191680,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710725,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":23060,"kb_used_omap":10,"kb_used_meta":35893,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":23613440,"data_stored":43695842,"data_compressed":5536379,"data_compressed_allocated":6516736,"data_compressed_original":33533952,"omap_allocated":10404,"internal_metadata":36755292},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66612,"kb_used_data":27108,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305228,"statfs":{"total":96636764160,"available":96568553472,"internally_reserved":0,"allocated":27758592,"data_stored":40411961,"data_compressed":4972494,"data_compressed_allocated":5840896,"data_compressed_original":25952256,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22953984,"data_stored":19509974,"data_compressed":1953035,"data_compressed_allocated":2265088,"data_compressed_original":5890048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17506304,"data_stored":13389680,"data_compressed":1088810,"data_compressed_allocated":1314816,"data_compressed_original":3727360,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23945216,"data_stored":20199942,"data_compressed":1569435,"data_compressed_allocated":1822720,"data_compressed_original":4501504,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:34.829 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-07T11:17:34.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-05-07T11:17:35.183 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-07T11:17:35.194 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-07T11:17:35.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:35.501 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:35.503 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:35.513 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-05-07T11:17:35.015009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5827,"num_bytes_recovered":56847285,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11001,"ondisk_log_size":11001,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":209764,"kb_used_data":80944,"kb_used_omap":13,"kb_used_meta":128754,"kb_avail":282905756,"statfs":{"total":289910292480,"available":289695494144,"internally_reserved":0,"allocated":82886656,"data_stored":138383866,"data_compressed":16835133,"data_compressed_allocated":19951616,"data_compressed_original":96677888,"omap_allocated":13594,"internal_metadata":131844838},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1076,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1230,"num_bytes_recovered":5842334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.619589"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":310,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796409+0000","last_change":"2024-05-07T11:17:27.408581+0000","last_active":"2024-05-07T11:17:30.796409+0000","last_peered":"2024-05-07T11:17:30.796409+0000","last_clean":"2024-05-07T11:17:30.796409+0000","last_became_active":"2024-05-07T11:17:27.407668+0000","last_became_peered":"2024-05-07T11:17:27.407668+0000","last_unstale":"2024-05-07T11:17:30.796409+0000","last_undegraded":"2024-05-07T11:17:30.796409+0000","last_fullsized":"2024-05-07T11:17:30.796409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:48:35.134503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":85925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'155","reported_seq":309,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796170+0000","last_change":"2024-05-07T11:17:21.419253+0000","last_active":"2024-05-07T11:17:30.796170+0000","last_peered":"2024-05-07T11:17:30.796170+0000","last_clean":"2024-05-07T11:17:30.796170+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:30.796170+0000","last_undegraded":"2024-05-07T11:17:30.796170+0000","last_fullsized":"2024-05-07T11:17:30.796170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:45:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'169","reported_seq":517,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403992+0000","last_change":"2024-05-07T11:17:26.408003+0000","last_active":"2024-05-07T11:17:30.403992+0000","last_peered":"2024-05-07T11:17:30.403992+0000","last_clean":"2024-05-07T11:17:30.403992+0000","last_became_active":"2024-05-07T11:17:26.407269+0000","last_became_peered":"2024-05-07T11:17:26.407269+0000","last_unstale":"2024-05-07T11:17:30.403992+0000","last_undegraded":"2024-05-07T11:17:30.403992+0000","last_fullsized":"2024-05-07T11:17:30.403992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:01.664780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":75254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":274,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403937+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:30.403937+0000","last_peered":"2024-05-07T11:17:30.403937+0000","last_clean":"2024-05-07T11:17:30.403937+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:30.403937+0000","last_undegraded":"2024-05-07T11:17:30.403937+0000","last_fullsized":"2024-05-07T11:17:30.403937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"63'186","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795678+0000","last_change":"2024-05-07T11:17:21.419034+0000","last_active":"2024-05-07T11:17:30.795678+0000","last_peered":"2024-05-07T11:17:30.795678+0000","last_clean":"2024-05-07T11:17:30.795678+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:30.795678+0000","last_undegraded":"2024-05-07T11:17:30.795678+0000","last_fullsized":"2024-05-07T11:17:30.795678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:42.536445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":488,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.406178+0000","last_change":"2024-05-07T11:17:30.406178+0000","last_active":"2024-05-07T11:17:30.406178+0000","last_peered":"2024-05-07T11:17:30.406178+0000","last_clean":"2024-05-07T11:17:30.406178+0000","last_became_active":"2024-05-07T11:17:30.405536+0000","last_became_peered":"2024-05-07T11:17:30.405536+0000","last_unstale":"2024-05-07T11:17:30.406178+0000","last_undegraded":"2024-05-07T11:17:30.406178+0000","last_fullsized":"2024-05-07T11:17:30.406178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:47.059204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":529421,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"63'166","reported_seq":269,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403641+0000","last_change":"2024-05-07T11:17:22.418934+0000","last_active":"2024-05-07T11:17:30.403641+0000","last_peered":"2024-05-07T11:17:30.403641+0000","last_clean":"2024-05-07T11:17:30.403641+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:30.403641+0000","last_undegraded":"2024-05-07T11:17:30.403641+0000","last_fullsized":"2024-05-07T11:17:30.403641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:05.143462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403262+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:30.403262+0000","last_peered":"2024-05-07T11:17:30.403262+0000","last_clean":"2024-05-07T11:17:30.403262+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:30.403262+0000","last_undegraded":"2024-05-07T11:17:30.403262+0000","last_fullsized":"2024-05-07T11:17:30.403262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:04.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403549+0000","last_change":"2024-05-07T11:17:27.409473+0000","last_active":"2024-05-07T11:17:30.403549+0000","last_peered":"2024-05-07T11:17:30.403549+0000","last_clean":"2024-05-07T11:17:30.403549+0000","last_became_active":"2024-05-07T11:17:27.408650+0000","last_became_peered":"2024-05-07T11:17:27.408650+0000","last_unstale":"2024-05-07T11:17:30.403549+0000","last_undegraded":"2024-05-07T11:17:30.403549+0000","last_fullsized":"2024-05-07T11:17:30.403549+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:11:56.118436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":631133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"63'156","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794731+0000","last_change":"2024-05-07T11:17:22.416801+0000","last_active":"2024-05-07T11:17:30.794731+0000","last_peered":"2024-05-07T11:17:30.794731+0000","last_clean":"2024-05-07T11:17:30.794731+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:30.794731+0000","last_undegraded":"2024-05-07T11:17:30.794731+0000","last_fullsized":"2024-05-07T11:17:30.794731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:07.028486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'154","reported_seq":450,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404098+0000","last_change":"2024-05-07T11:17:22.419089+0000","last_active":"2024-05-07T11:17:30.404098+0000","last_peered":"2024-05-07T11:17:30.404098+0000","last_clean":"2024-05-07T11:17:30.404098+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:30.404098+0000","last_undegraded":"2024-05-07T11:17:30.404098+0000","last_fullsized":"2024-05-07T11:17:30.404098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:57.833385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":280,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796121+0000","last_change":"2024-05-07T11:17:28.404789+0000","last_active":"2024-05-07T11:17:30.796121+0000","last_peered":"2024-05-07T11:17:30.796121+0000","last_clean":"2024-05-07T11:17:30.796121+0000","last_became_active":"2024-05-07T11:17:28.403770+0000","last_became_peered":"2024-05-07T11:17:28.403770+0000","last_unstale":"2024-05-07T11:17:30.796121+0000","last_undegraded":"2024-05-07T11:17:30.796121+0000","last_fullsized":"2024-05-07T11:17:30.796121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:52.521740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":89602,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'136","reported_seq":291,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795785+0000","last_change":"2024-05-07T11:17:23.398879+0000","last_active":"2024-05-07T11:17:30.795785+0000","last_peered":"2024-05-07T11:17:30.795785+0000","last_clean":"2024-05-07T11:17:30.795785+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:30.795785+0000","last_undegraded":"2024-05-07T11:17:30.795785+0000","last_fullsized":"2024-05-07T11:17:30.795785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:33:07.091905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'175","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403781+0000","last_change":"2024-05-07T11:17:26.407920+0000","last_active":"2024-05-07T11:17:30.403781+0000","last_peered":"2024-05-07T11:17:30.403781+0000","last_clean":"2024-05-07T11:17:30.403781+0000","last_became_active":"2024-05-07T11:17:26.407342+0000","last_became_peered":"2024-05-07T11:17:26.407342+0000","last_unstale":"2024-05-07T11:17:30.403781+0000","last_undegraded":"2024-05-07T11:17:30.403781+0000","last_fullsized":"2024-05-07T11:17:30.403781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:55:22.847728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":196945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":531,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403816+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:30.403816+0000","last_peered":"2024-05-07T11:17:30.403816+0000","last_clean":"2024-05-07T11:17:30.403816+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:30.403816+0000","last_undegraded":"2024-05-07T11:17:30.403816+0000","last_fullsized":"2024-05-07T11:17:30.403816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:30:48.688430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":501,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.406594+0000","last_change":"2024-05-07T11:17:30.406594+0000","last_active":"2024-05-07T11:17:30.406594+0000","last_peered":"2024-05-07T11:17:30.406594+0000","last_clean":"2024-05-07T11:17:30.406594+0000","last_became_active":"2024-05-07T11:17:30.405896+0000","last_became_peered":"2024-05-07T11:17:30.405896+0000","last_unstale":"2024-05-07T11:17:30.406594+0000","last_undegraded":"2024-05-07T11:17:30.406594+0000","last_fullsized":"2024-05-07T11:17:30.406594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:53:51.552775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4343464,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'161","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404106+0000","last_change":"2024-05-07T11:17:22.416613+0000","last_active":"2024-05-07T11:17:30.404106+0000","last_peered":"2024-05-07T11:17:30.404106+0000","last_clean":"2024-05-07T11:17:30.404106+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:30.404106+0000","last_undegraded":"2024-05-07T11:17:30.404106+0000","last_fullsized":"2024-05-07T11:17:30.404106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"63'148","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796047+0000","last_change":"2024-05-07T11:17:21.418472+0000","last_active":"2024-05-07T11:17:30.796047+0000","last_peered":"2024-05-07T11:17:30.796047+0000","last_clean":"2024-05-07T11:17:30.796047+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:30.796047+0000","last_undegraded":"2024-05-07T11:17:30.796047+0000","last_fullsized":"2024-05-07T11:17:30.796047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:18.184681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'147","reported_seq":237,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403595+0000","last_change":"2024-05-07T11:17:21.418164+0000","last_active":"2024-05-07T11:17:30.403595+0000","last_peered":"2024-05-07T11:17:30.403595+0000","last_clean":"2024-05-07T11:17:30.403595+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:30.403595+0000","last_undegraded":"2024-05-07T11:17:30.403595+0000","last_fullsized":"2024-05-07T11:17:30.403595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":573,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404075+0000","last_change":"2024-05-07T11:17:29.407762+0000","last_active":"2024-05-07T11:17:30.404075+0000","last_peered":"2024-05-07T11:17:30.404075+0000","last_clean":"2024-05-07T11:17:30.404075+0000","last_became_active":"2024-05-07T11:17:29.407032+0000","last_became_peered":"2024-05-07T11:17:29.407032+0000","last_unstale":"2024-05-07T11:17:30.404075+0000","last_undegraded":"2024-05-07T11:17:30.404075+0000","last_fullsized":"2024-05-07T11:17:30.404075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:55:10.099065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":98139,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":305,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403794+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:30.403794+0000","last_peered":"2024-05-07T11:17:30.403794+0000","last_clean":"2024-05-07T11:17:30.403794+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:30.403794+0000","last_undegraded":"2024-05-07T11:17:30.403794+0000","last_fullsized":"2024-05-07T11:17:30.403794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795900+0000","last_change":"2024-05-07T11:17:29.408512+0000","last_active":"2024-05-07T11:17:30.795900+0000","last_peered":"2024-05-07T11:17:30.795900+0000","last_clean":"2024-05-07T11:17:30.795900+0000","last_became_active":"2024-05-07T11:17:29.407294+0000","last_became_peered":"2024-05-07T11:17:29.407294+0000","last_unstale":"2024-05-07T11:17:30.795900+0000","last_undegraded":"2024-05-07T11:17:30.795900+0000","last_fullsized":"2024-05-07T11:17:30.795900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:30:15.441943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":116557,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'159","reported_seq":247,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402842+0000","last_change":"2024-05-07T11:17:21.418519+0000","last_active":"2024-05-07T11:17:30.402842+0000","last_peered":"2024-05-07T11:17:30.402842+0000","last_clean":"2024-05-07T11:17:30.402842+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:30.402842+0000","last_undegraded":"2024-05-07T11:17:30.402842+0000","last_fullsized":"2024-05-07T11:17:30.402842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"63'169","reported_seq":323,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795399+0000","last_change":"2024-05-07T11:17:21.414896+0000","last_active":"2024-05-07T11:17:30.795399+0000","last_peered":"2024-05-07T11:17:30.795399+0000","last_clean":"2024-05-07T11:17:30.795399+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:30.795399+0000","last_undegraded":"2024-05-07T11:17:30.795399+0000","last_fullsized":"2024-05-07T11:17:30.795399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:52.242314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796018+0000","last_change":"2024-05-07T11:17:24.407028+0000","last_active":"2024-05-07T11:17:30.796018+0000","last_peered":"2024-05-07T11:17:30.796018+0000","last_clean":"2024-05-07T11:17:30.796018+0000","last_became_active":"2024-05-07T11:17:24.406307+0000","last_became_peered":"2024-05-07T11:17:24.406307+0000","last_unstale":"2024-05-07T11:17:30.796018+0000","last_undegraded":"2024-05-07T11:17:30.796018+0000","last_fullsized":"2024-05-07T11:17:30.796018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:24.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":230897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'195","reported_seq":345,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403991+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:17:30.403991+0000","last_peered":"2024-05-07T11:17:30.403991+0000","last_clean":"2024-05-07T11:17:30.403991+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:30.403991+0000","last_undegraded":"2024-05-07T11:17:30.403991+0000","last_fullsized":"2024-05-07T11:17:30.403991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404276+0000","last_change":"2024-05-07T11:17:29.416071+0000","last_active":"2024-05-07T11:17:30.404276+0000","last_peered":"2024-05-07T11:17:30.404276+0000","last_clean":"2024-05-07T11:17:30.404276+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:30.404276+0000","last_undegraded":"2024-05-07T11:17:30.404276+0000","last_fullsized":"2024-05-07T11:17:30.404276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:42.494889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":67681,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":287,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796001+0000","last_change":"2024-05-07T11:17:28.404770+0000","last_active":"2024-05-07T11:17:30.796001+0000","last_peered":"2024-05-07T11:17:30.796001+0000","last_clean":"2024-05-07T11:17:30.796001+0000","last_became_active":"2024-05-07T11:17:28.403782+0000","last_became_peered":"2024-05-07T11:17:28.403782+0000","last_unstale":"2024-05-07T11:17:30.796001+0000","last_undegraded":"2024-05-07T11:17:30.796001+0000","last_fullsized":"2024-05-07T11:17:30.796001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:38.547257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":211687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":247,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403283+0000","last_change":"2024-05-07T11:17:24.403807+0000","last_active":"2024-05-07T11:17:30.403283+0000","last_peered":"2024-05-07T11:17:30.403283+0000","last_clean":"2024-05-07T11:17:30.403283+0000","last_became_active":"2024-05-07T11:17:24.403179+0000","last_became_peered":"2024-05-07T11:17:24.403179+0000","last_unstale":"2024-05-07T11:17:30.403283+0000","last_undegraded":"2024-05-07T11:17:30.403283+0000","last_fullsized":"2024-05-07T11:17:30.403283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:15:55.499366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":323,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795763+0000","last_change":"2024-05-07T11:17:29.409488+0000","last_active":"2024-05-07T11:17:30.795763+0000","last_peered":"2024-05-07T11:17:30.795763+0000","last_clean":"2024-05-07T11:17:30.795763+0000","last_became_active":"2024-05-07T11:17:29.408425+0000","last_became_peered":"2024-05-07T11:17:29.408425+0000","last_unstale":"2024-05-07T11:17:30.795763+0000","last_undegraded":"2024-05-07T11:17:30.795763+0000","last_fullsized":"2024-05-07T11:17:30.795763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:34.508418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":86167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'192","reported_seq":586,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402995+0000","last_change":"2024-05-07T11:17:22.416120+0000","last_active":"2024-05-07T11:17:30.402995+0000","last_peered":"2024-05-07T11:17:30.402995+0000","last_clean":"2024-05-07T11:17:30.402995+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:30.402995+0000","last_undegraded":"2024-05-07T11:17:30.402995+0000","last_fullsized":"2024-05-07T11:17:30.402995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:13.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"63'185","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403405+0000","last_change":"2024-05-07T11:17:28.399808+0000","last_active":"2024-05-07T11:17:30.403405+0000","last_peered":"2024-05-07T11:17:30.403405+0000","last_clean":"2024-05-07T11:17:30.403405+0000","last_became_active":"2024-05-07T11:17:28.398801+0000","last_became_peered":"2024-05-07T11:17:28.398801+0000","last_unstale":"2024-05-07T11:17:30.403405+0000","last_undegraded":"2024-05-07T11:17:30.403405+0000","last_fullsized":"2024-05-07T11:17:30.403405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:34.170387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":459999,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'156","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794879+0000","last_change":"2024-05-07T11:17:22.416165+0000","last_active":"2024-05-07T11:17:30.794879+0000","last_peered":"2024-05-07T11:17:30.794879+0000","last_clean":"2024-05-07T11:17:30.794879+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:30.794879+0000","last_undegraded":"2024-05-07T11:17:30.794879+0000","last_fullsized":"2024-05-07T11:17:30.794879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:57.237765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":277,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404046+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:30.404046+0000","last_peered":"2024-05-07T11:17:30.404046+0000","last_clean":"2024-05-07T11:17:30.404046+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:30.404046+0000","last_undegraded":"2024-05-07T11:17:30.404046+0000","last_fullsized":"2024-05-07T11:17:30.404046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"63'141","reported_seq":295,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796184+0000","last_change":"2024-05-07T11:17:21.419206+0000","last_active":"2024-05-07T11:17:30.796184+0000","last_peered":"2024-05-07T11:17:30.796184+0000","last_clean":"2024-05-07T11:17:30.796184+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:30.796184+0000","last_undegraded":"2024-05-07T11:17:30.796184+0000","last_fullsized":"2024-05-07T11:17:30.796184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:12.679336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403297+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:30.403297+0000","last_peered":"2024-05-07T11:17:30.403297+0000","last_clean":"2024-05-07T11:17:30.403297+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:30.403297+0000","last_undegraded":"2024-05-07T11:17:30.403297+0000","last_fullsized":"2024-05-07T11:17:30.403297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.025763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"63'179","reported_seq":267,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403562+0000","last_change":"2024-05-07T11:17:21.419284+0000","last_active":"2024-05-07T11:17:30.403562+0000","last_peered":"2024-05-07T11:17:30.403562+0000","last_clean":"2024-05-07T11:17:30.403562+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:30.403562+0000","last_undegraded":"2024-05-07T11:17:30.403562+0000","last_fullsized":"2024-05-07T11:17:30.403562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:54.463898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795361+0000","last_change":"2024-05-07T11:17:18.423604+0000","last_active":"2024-05-07T11:17:30.795361+0000","last_peered":"2024-05-07T11:17:30.795361+0000","last_clean":"2024-05-07T11:17:30.795361+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:30.795361+0000","last_undegraded":"2024-05-07T11:17:30.795361+0000","last_fullsized":"2024-05-07T11:17:30.795361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:45:28.650148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":244,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403803+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:30.403803+0000","last_peered":"2024-05-07T11:17:30.403803+0000","last_clean":"2024-05-07T11:17:30.403803+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:30.403803+0000","last_undegraded":"2024-05-07T11:17:30.403803+0000","last_fullsized":"2024-05-07T11:17:30.403803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403673+0000","last_change":"2024-05-07T11:17:18.433027+0000","last_active":"2024-05-07T11:17:30.403673+0000","last_peered":"2024-05-07T11:17:30.403673+0000","last_clean":"2024-05-07T11:17:30.403673+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:30.403673+0000","last_undegraded":"2024-05-07T11:17:30.403673+0000","last_fullsized":"2024-05-07T11:17:30.403673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:47.068504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404359+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:30.404359+0000","last_peered":"2024-05-07T11:17:30.404359+0000","last_clean":"2024-05-07T11:17:30.404359+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:30.404359+0000","last_undegraded":"2024-05-07T11:17:30.404359+0000","last_fullsized":"2024-05-07T11:17:30.404359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:35:51.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'155","reported_seq":435,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403110+0000","last_change":"2024-05-07T11:17:27.404484+0000","last_active":"2024-05-07T11:17:30.403110+0000","last_peered":"2024-05-07T11:17:30.403110+0000","last_clean":"2024-05-07T11:17:30.403110+0000","last_became_active":"2024-05-07T11:17:27.403866+0000","last_became_peered":"2024-05-07T11:17:27.403866+0000","last_unstale":"2024-05-07T11:17:30.403110+0000","last_undegraded":"2024-05-07T11:17:30.403110+0000","last_fullsized":"2024-05-07T11:17:30.403110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:15:32.849874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":166862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795883+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:30.795883+0000","last_peered":"2024-05-07T11:17:30.795883+0000","last_clean":"2024-05-07T11:17:30.795883+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:30.795883+0000","last_undegraded":"2024-05-07T11:17:30.795883+0000","last_fullsized":"2024-05-07T11:17:30.795883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:16.479879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'167","reported_seq":321,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795133+0000","last_change":"2024-05-07T11:17:21.418782+0000","last_active":"2024-05-07T11:17:30.795133+0000","last_peered":"2024-05-07T11:17:30.795133+0000","last_clean":"2024-05-07T11:17:30.795133+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:30.795133+0000","last_undegraded":"2024-05-07T11:17:30.795133+0000","last_fullsized":"2024-05-07T11:17:30.795133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:13.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404754+0000","last_change":"2024-05-07T11:17:22.419069+0000","last_active":"2024-05-07T11:17:30.404754+0000","last_peered":"2024-05-07T11:17:30.404754+0000","last_clean":"2024-05-07T11:17:30.404754+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:30.404754+0000","last_undegraded":"2024-05-07T11:17:30.404754+0000","last_fullsized":"2024-05-07T11:17:30.404754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:20.890067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404443+0000","last_change":"2024-05-07T11:17:29.408348+0000","last_active":"2024-05-07T11:17:30.404443+0000","last_peered":"2024-05-07T11:17:30.404443+0000","last_clean":"2024-05-07T11:17:30.404443+0000","last_became_active":"2024-05-07T11:17:29.407677+0000","last_became_peered":"2024-05-07T11:17:29.407677+0000","last_unstale":"2024-05-07T11:17:30.404443+0000","last_undegraded":"2024-05-07T11:17:30.404443+0000","last_fullsized":"2024-05-07T11:17:30.404443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:02.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":83336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404663+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:30.404663+0000","last_peered":"2024-05-07T11:17:30.404663+0000","last_clean":"2024-05-07T11:17:30.404663+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:30.404663+0000","last_undegraded":"2024-05-07T11:17:30.404663+0000","last_fullsized":"2024-05-07T11:17:30.404663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:31:28.580245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"63'164","reported_seq":314,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403552+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:17:30.403552+0000","last_peered":"2024-05-07T11:17:30.403552+0000","last_clean":"2024-05-07T11:17:30.403552+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:30.403552+0000","last_undegraded":"2024-05-07T11:17:30.403552+0000","last_fullsized":"2024-05-07T11:17:30.403552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403688+0000","last_change":"2024-05-07T11:17:18.450923+0000","last_active":"2024-05-07T11:17:30.403688+0000","last_peered":"2024-05-07T11:17:30.403688+0000","last_clean":"2024-05-07T11:17:30.403688+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:30.403688+0000","last_undegraded":"2024-05-07T11:17:30.403688+0000","last_fullsized":"2024-05-07T11:17:30.403688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:38.864461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"63'172","reported_seq":560,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404209+0000","last_change":"2024-05-07T11:17:28.401492+0000","last_active":"2024-05-07T11:17:30.404209+0000","last_peered":"2024-05-07T11:17:30.404209+0000","last_clean":"2024-05-07T11:17:30.404209+0000","last_became_active":"2024-05-07T11:17:28.400673+0000","last_became_peered":"2024-05-07T11:17:28.400673+0000","last_unstale":"2024-05-07T11:17:30.404209+0000","last_undegraded":"2024-05-07T11:17:30.404209+0000","last_fullsized":"2024-05-07T11:17:30.404209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:41.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":127501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404803+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:30.404803+0000","last_peered":"2024-05-07T11:17:30.404803+0000","last_clean":"2024-05-07T11:17:30.404803+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:30.404803+0000","last_undegraded":"2024-05-07T11:17:30.404803+0000","last_fullsized":"2024-05-07T11:17:30.404803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"63'163","reported_seq":519,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404591+0000","last_change":"2024-05-07T11:17:27.405072+0000","last_active":"2024-05-07T11:17:30.404591+0000","last_peered":"2024-05-07T11:17:30.404591+0000","last_clean":"2024-05-07T11:17:30.404591+0000","last_became_active":"2024-05-07T11:17:27.404340+0000","last_became_peered":"2024-05-07T11:17:27.404340+0000","last_unstale":"2024-05-07T11:17:30.404591+0000","last_undegraded":"2024-05-07T11:17:30.404591+0000","last_fullsized":"2024-05-07T11:17:30.404591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:05:12.602038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":119690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795129+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:30.795129+0000","last_peered":"2024-05-07T11:17:30.795129+0000","last_clean":"2024-05-07T11:17:30.795129+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:30.795129+0000","last_undegraded":"2024-05-07T11:17:30.795129+0000","last_fullsized":"2024-05-07T11:17:30.795129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:47.689436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'137","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403862+0000","last_change":"2024-05-07T11:17:24.403787+0000","last_active":"2024-05-07T11:17:30.403862+0000","last_peered":"2024-05-07T11:17:30.403862+0000","last_clean":"2024-05-07T11:17:30.403862+0000","last_became_active":"2024-05-07T11:17:24.403279+0000","last_became_peered":"2024-05-07T11:17:24.403279+0000","last_unstale":"2024-05-07T11:17:30.403862+0000","last_undegraded":"2024-05-07T11:17:30.403862+0000","last_fullsized":"2024-05-07T11:17:30.403862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:42.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":119,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795539+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:30.795539+0000","last_peered":"2024-05-07T11:17:30.795539+0000","last_clean":"2024-05-07T11:17:30.795539+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:30.795539+0000","last_undegraded":"2024-05-07T11:17:30.795539+0000","last_fullsized":"2024-05-07T11:17:30.795539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:59.411938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'141","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403996+0000","last_change":"2024-05-07T11:17:22.417126+0000","last_active":"2024-05-07T11:17:30.403996+0000","last_peered":"2024-05-07T11:17:30.403996+0000","last_clean":"2024-05-07T11:17:30.403996+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:30.403996+0000","last_undegraded":"2024-05-07T11:17:30.403996+0000","last_fullsized":"2024-05-07T11:17:30.403996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":359,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404346+0000","last_change":"2024-05-07T11:17:18.433863+0000","last_active":"2024-05-07T11:17:30.404346+0000","last_peered":"2024-05-07T11:17:30.404346+0000","last_clean":"2024-05-07T11:17:30.404346+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:30.404346+0000","last_undegraded":"2024-05-07T11:17:30.404346+0000","last_fullsized":"2024-05-07T11:17:30.404346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:10.515455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404385+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:30.404385+0000","last_peered":"2024-05-07T11:17:30.404385+0000","last_clean":"2024-05-07T11:17:30.404385+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:30.404385+0000","last_undegraded":"2024-05-07T11:17:30.404385+0000","last_fullsized":"2024-05-07T11:17:30.404385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:03:02.539869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403061+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:30.403061+0000","last_peered":"2024-05-07T11:17:30.403061+0000","last_clean":"2024-05-07T11:17:30.403061+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:30.403061+0000","last_undegraded":"2024-05-07T11:17:30.403061+0000","last_fullsized":"2024-05-07T11:17:30.403061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404654+0000","last_change":"2024-05-07T11:17:29.231999+0000","last_active":"2024-05-07T11:17:30.404654+0000","last_peered":"2024-05-07T11:17:30.404654+0000","last_clean":"2024-05-07T11:17:30.404654+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:30.404654+0000","last_undegraded":"2024-05-07T11:17:30.404654+0000","last_fullsized":"2024-05-07T11:17:30.404654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:37.451106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":138308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404219+0000","last_change":"2024-05-07T11:17:18.433452+0000","last_active":"2024-05-07T11:17:30.404219+0000","last_peered":"2024-05-07T11:17:30.404219+0000","last_clean":"2024-05-07T11:17:30.404219+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:30.404219+0000","last_undegraded":"2024-05-07T11:17:30.404219+0000","last_fullsized":"2024-05-07T11:17:30.404219+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:26.663080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":220,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403281+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:17:30.403281+0000","last_peered":"2024-05-07T11:17:30.403281+0000","last_clean":"2024-05-07T11:17:30.403281+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:30.403281+0000","last_undegraded":"2024-05-07T11:17:30.403281+0000","last_fullsized":"2024-05-07T11:17:30.403281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"63'160","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795913+0000","last_change":"2024-05-07T11:17:24.407000+0000","last_active":"2024-05-07T11:17:30.795913+0000","last_peered":"2024-05-07T11:17:30.795913+0000","last_clean":"2024-05-07T11:17:30.795913+0000","last_became_active":"2024-05-07T11:17:24.406306+0000","last_became_peered":"2024-05-07T11:17:24.406306+0000","last_unstale":"2024-05-07T11:17:30.795913+0000","last_undegraded":"2024-05-07T11:17:30.795913+0000","last_fullsized":"2024-05-07T11:17:30.795913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:56:56.763708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":402414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403560+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:30.403560+0000","last_peered":"2024-05-07T11:17:30.403560+0000","last_clean":"2024-05-07T11:17:30.403560+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:30.403560+0000","last_undegraded":"2024-05-07T11:17:30.403560+0000","last_fullsized":"2024-05-07T11:17:30.403560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:20.744525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795119+0000","last_change":"2024-05-07T11:17:18.572639+0000","last_active":"2024-05-07T11:17:30.795119+0000","last_peered":"2024-05-07T11:17:30.795119+0000","last_clean":"2024-05-07T11:17:30.795119+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:30.795119+0000","last_undegraded":"2024-05-07T11:17:30.795119+0000","last_fullsized":"2024-05-07T11:17:30.795119+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:15.538158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403967+0000","last_change":"2024-05-07T11:17:26.407965+0000","last_active":"2024-05-07T11:17:30.403967+0000","last_peered":"2024-05-07T11:17:30.403967+0000","last_clean":"2024-05-07T11:17:30.403967+0000","last_became_active":"2024-05-07T11:17:26.407203+0000","last_became_peered":"2024-05-07T11:17:26.407203+0000","last_unstale":"2024-05-07T11:17:30.403967+0000","last_undegraded":"2024-05-07T11:17:30.403967+0000","last_fullsized":"2024-05-07T11:17:30.403967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:50.842472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":384377,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404866+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:30.404866+0000","last_peered":"2024-05-07T11:17:30.404866+0000","last_clean":"2024-05-07T11:17:30.404866+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:30.404866+0000","last_undegraded":"2024-05-07T11:17:30.404866+0000","last_fullsized":"2024-05-07T11:17:30.404866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":162,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404316+0000","last_change":"2024-05-07T11:17:18.404539+0000","last_active":"2024-05-07T11:17:30.404316+0000","last_peered":"2024-05-07T11:17:30.404316+0000","last_clean":"2024-05-07T11:17:30.404316+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:30.404316+0000","last_undegraded":"2024-05-07T11:17:30.404316+0000","last_fullsized":"2024-05-07T11:17:30.404316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:50.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":233,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403988+0000","last_change":"2024-05-07T11:17:25.412664+0000","last_active":"2024-05-07T11:17:30.403988+0000","last_peered":"2024-05-07T11:17:30.403988+0000","last_clean":"2024-05-07T11:17:30.403988+0000","last_became_active":"2024-05-07T11:17:25.412026+0000","last_became_peered":"2024-05-07T11:17:25.412026+0000","last_unstale":"2024-05-07T11:17:30.403988+0000","last_undegraded":"2024-05-07T11:17:30.403988+0000","last_fullsized":"2024-05-07T11:17:30.403988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:19:28.465664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":174891,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404777+0000","last_change":"2024-05-07T11:17:22.424750+0000","last_active":"2024-05-07T11:17:30.404777+0000","last_peered":"2024-05-07T11:17:30.404777+0000","last_clean":"2024-05-07T11:17:30.404777+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:30.404777+0000","last_undegraded":"2024-05-07T11:17:30.404777+0000","last_fullsized":"2024-05-07T11:17:30.404777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:12.283160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404113+0000","last_change":"2024-05-07T11:17:18.433137+0000","last_active":"2024-05-07T11:17:30.404113+0000","last_peered":"2024-05-07T11:17:30.404113+0000","last_clean":"2024-05-07T11:17:30.404113+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:30.404113+0000","last_undegraded":"2024-05-07T11:17:30.404113+0000","last_fullsized":"2024-05-07T11:17:30.404113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:40.770823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":296,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795321+0000","last_change":"2024-05-07T11:17:29.408764+0000","last_active":"2024-05-07T11:17:30.795321+0000","last_peered":"2024-05-07T11:17:30.795321+0000","last_clean":"2024-05-07T11:17:30.795321+0000","last_became_active":"2024-05-07T11:17:29.407296+0000","last_became_peered":"2024-05-07T11:17:29.407296+0000","last_unstale":"2024-05-07T11:17:30.795321+0000","last_undegraded":"2024-05-07T11:17:30.795321+0000","last_fullsized":"2024-05-07T11:17:30.795321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:34:42.615088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":74509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403776+0000","last_change":"2024-05-07T11:17:18.431763+0000","last_active":"2024-05-07T11:17:30.403776+0000","last_peered":"2024-05-07T11:17:30.403776+0000","last_clean":"2024-05-07T11:17:30.403776+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:30.403776+0000","last_undegraded":"2024-05-07T11:17:30.403776+0000","last_fullsized":"2024-05-07T11:17:30.403776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:38.234395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":125,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796383+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:30.796383+0000","last_peered":"2024-05-07T11:17:30.796383+0000","last_clean":"2024-05-07T11:17:30.796383+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:30.796383+0000","last_undegraded":"2024-05-07T11:17:30.796383+0000","last_fullsized":"2024-05-07T11:17:30.796383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:54.609817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'181","reported_seq":331,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795311+0000","last_change":"2024-05-07T11:17:23.399296+0000","last_active":"2024-05-07T11:17:30.795311+0000","last_peered":"2024-05-07T11:17:30.795311+0000","last_clean":"2024-05-07T11:17:30.795311+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:30.795311+0000","last_undegraded":"2024-05-07T11:17:30.795311+0000","last_fullsized":"2024-05-07T11:17:30.795311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:21.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":100,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404018+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:30.404018+0000","last_peered":"2024-05-07T11:17:30.404018+0000","last_clean":"2024-05-07T11:17:30.404018+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:30.404018+0000","last_undegraded":"2024-05-07T11:17:30.404018+0000","last_fullsized":"2024-05-07T11:17:30.404018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:03.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403832+0000","last_change":"2024-05-07T11:17:18.432358+0000","last_active":"2024-05-07T11:17:30.403832+0000","last_peered":"2024-05-07T11:17:30.403832+0000","last_clean":"2024-05-07T11:17:30.403832+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:30.403832+0000","last_undegraded":"2024-05-07T11:17:30.403832+0000","last_fullsized":"2024-05-07T11:17:30.403832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:36.281521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"63'175","reported_seq":285,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403129+0000","last_change":"2024-05-07T11:17:22.420080+0000","last_active":"2024-05-07T11:17:30.403129+0000","last_peered":"2024-05-07T11:17:30.403129+0000","last_clean":"2024-05-07T11:17:30.403129+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:30.403129+0000","last_undegraded":"2024-05-07T11:17:30.403129+0000","last_fullsized":"2024-05-07T11:17:30.403129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:41.233935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'38","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403696+0000","last_change":"2024-05-07T11:17:18.459674+0000","last_active":"2024-05-07T11:17:30.403696+0000","last_peered":"2024-05-07T11:17:30.403696+0000","last_clean":"2024-05-07T11:17:30.403696+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:30.403696+0000","last_undegraded":"2024-05-07T11:17:30.403696+0000","last_fullsized":"2024-05-07T11:17:30.403696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:35.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404514+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:30.404514+0000","last_peered":"2024-05-07T11:17:30.404514+0000","last_clean":"2024-05-07T11:17:30.404514+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:30.404514+0000","last_undegraded":"2024-05-07T11:17:30.404514+0000","last_fullsized":"2024-05-07T11:17:30.404514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:14.650941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'138","reported_seq":290,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794688+0000","last_change":"2024-05-07T11:17:22.417629+0000","last_active":"2024-05-07T11:17:30.794688+0000","last_peered":"2024-05-07T11:17:30.794688+0000","last_clean":"2024-05-07T11:17:30.794688+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:30.794688+0000","last_undegraded":"2024-05-07T11:17:30.794688+0000","last_fullsized":"2024-05-07T11:17:30.794688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:58.760049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'164","reported_seq":510,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403556+0000","last_change":"2024-05-07T11:17:23.400613+0000","last_active":"2024-05-07T11:17:30.403556+0000","last_peered":"2024-05-07T11:17:30.403556+0000","last_clean":"2024-05-07T11:17:30.403556+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:30.403556+0000","last_undegraded":"2024-05-07T11:17:30.403556+0000","last_fullsized":"2024-05-07T11:17:30.403556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:28.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":208,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404486+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:30.404486+0000","last_peered":"2024-05-07T11:17:30.404486+0000","last_clean":"2024-05-07T11:17:30.404486+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:30.404486+0000","last_undegraded":"2024-05-07T11:17:30.404486+0000","last_fullsized":"2024-05-07T11:17:30.404486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:35.832524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":228,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403482+0000","last_change":"2024-05-07T11:17:25.413137+0000","last_active":"2024-05-07T11:17:30.403482+0000","last_peered":"2024-05-07T11:17:30.403482+0000","last_clean":"2024-05-07T11:17:30.403482+0000","last_became_active":"2024-05-07T11:17:25.412149+0000","last_became_peered":"2024-05-07T11:17:25.412149+0000","last_unstale":"2024-05-07T11:17:30.403482+0000","last_undegraded":"2024-05-07T11:17:30.403482+0000","last_fullsized":"2024-05-07T11:17:30.403482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:05.259035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795725+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:30.795725+0000","last_peered":"2024-05-07T11:17:30.795725+0000","last_clean":"2024-05-07T11:17:30.795725+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:30.795725+0000","last_undegraded":"2024-05-07T11:17:30.795725+0000","last_fullsized":"2024-05-07T11:17:30.795725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:46.092532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404461+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:30.404461+0000","last_peered":"2024-05-07T11:17:30.404461+0000","last_clean":"2024-05-07T11:17:30.404461+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:30.404461+0000","last_undegraded":"2024-05-07T11:17:30.404461+0000","last_fullsized":"2024-05-07T11:17:30.404461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.076287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"63'172","reported_seq":261,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402830+0000","last_change":"2024-05-07T11:17:21.419673+0000","last_active":"2024-05-07T11:17:30.402830+0000","last_peered":"2024-05-07T11:17:30.402830+0000","last_clean":"2024-05-07T11:17:30.402830+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:30.402830+0000","last_undegraded":"2024-05-07T11:17:30.402830+0000","last_fullsized":"2024-05-07T11:17:30.402830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:01.519110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403713+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:30.403713+0000","last_peered":"2024-05-07T11:17:30.403713+0000","last_clean":"2024-05-07T11:17:30.403713+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:30.403713+0000","last_undegraded":"2024-05-07T11:17:30.403713+0000","last_fullsized":"2024-05-07T11:17:30.403713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:45.698283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":234,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403625+0000","last_change":"2024-05-07T11:17:27.408792+0000","last_active":"2024-05-07T11:17:30.403625+0000","last_peered":"2024-05-07T11:17:30.403625+0000","last_clean":"2024-05-07T11:17:30.403625+0000","last_became_active":"2024-05-07T11:17:27.407792+0000","last_became_peered":"2024-05-07T11:17:27.407792+0000","last_unstale":"2024-05-07T11:17:30.403625+0000","last_undegraded":"2024-05-07T11:17:30.403625+0000","last_fullsized":"2024-05-07T11:17:30.403625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":319,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796036+0000","last_change":"2024-05-07T11:17:26.408077+0000","last_active":"2024-05-07T11:17:30.796036+0000","last_peered":"2024-05-07T11:17:30.796036+0000","last_clean":"2024-05-07T11:17:30.796036+0000","last_became_active":"2024-05-07T11:17:26.407230+0000","last_became_peered":"2024-05-07T11:17:26.407230+0000","last_unstale":"2024-05-07T11:17:30.796036+0000","last_undegraded":"2024-05-07T11:17:30.796036+0000","last_fullsized":"2024-05-07T11:17:30.796036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:29.469789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":91096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402939+0000","last_change":"2024-05-07T11:17:18.431271+0000","last_active":"2024-05-07T11:17:30.402939+0000","last_peered":"2024-05-07T11:17:30.402939+0000","last_clean":"2024-05-07T11:17:30.402939+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:30.402939+0000","last_undegraded":"2024-05-07T11:17:30.402939+0000","last_fullsized":"2024-05-07T11:17:30.402939+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":233,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403514+0000","last_change":"2024-05-07T11:17:25.403221+0000","last_active":"2024-05-07T11:17:30.403514+0000","last_peered":"2024-05-07T11:17:30.403514+0000","last_clean":"2024-05-07T11:17:30.403514+0000","last_became_active":"2024-05-07T11:17:25.402661+0000","last_became_peered":"2024-05-07T11:17:25.402661+0000","last_unstale":"2024-05-07T11:17:30.403514+0000","last_undegraded":"2024-05-07T11:17:30.403514+0000","last_fullsized":"2024-05-07T11:17:30.403514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:07.574111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403047+0000","last_change":"2024-05-07T11:17:18.402834+0000","last_active":"2024-05-07T11:17:30.403047+0000","last_peered":"2024-05-07T11:17:30.403047+0000","last_clean":"2024-05-07T11:17:30.403047+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:30.403047+0000","last_undegraded":"2024-05-07T11:17:30.403047+0000","last_fullsized":"2024-05-07T11:17:30.403047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"63'205","reported_seq":357,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794925+0000","last_change":"2024-05-07T11:17:22.421343+0000","last_active":"2024-05-07T11:17:30.794925+0000","last_peered":"2024-05-07T11:17:30.794925+0000","last_clean":"2024-05-07T11:17:30.794925+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:30.794925+0000","last_undegraded":"2024-05-07T11:17:30.794925+0000","last_fullsized":"2024-05-07T11:17:30.794925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:24.076915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795839+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:30.795839+0000","last_peered":"2024-05-07T11:17:30.795839+0000","last_clean":"2024-05-07T11:17:30.795839+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:30.795839+0000","last_undegraded":"2024-05-07T11:17:30.795839+0000","last_fullsized":"2024-05-07T11:17:30.795839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:53.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'163","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795930+0000","last_change":"2024-05-07T11:17:24.407114+0000","last_active":"2024-05-07T11:17:30.795930+0000","last_peered":"2024-05-07T11:17:30.795930+0000","last_clean":"2024-05-07T11:17:30.795930+0000","last_became_active":"2024-05-07T11:17:24.406337+0000","last_became_peered":"2024-05-07T11:17:24.406337+0000","last_unstale":"2024-05-07T11:17:30.795930+0000","last_undegraded":"2024-05-07T11:17:30.795930+0000","last_fullsized":"2024-05-07T11:17:30.795930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:28:35.002816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":280772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795500+0000","last_change":"2024-05-07T11:17:18.555160+0000","last_active":"2024-05-07T11:17:30.795500+0000","last_peered":"2024-05-07T11:17:30.795500+0000","last_clean":"2024-05-07T11:17:30.795500+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:30.795500+0000","last_undegraded":"2024-05-07T11:17:30.795500+0000","last_fullsized":"2024-05-07T11:17:30.795500+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:37.962741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'166","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403479+0000","last_change":"2024-05-07T11:17:21.418540+0000","last_active":"2024-05-07T11:17:30.403479+0000","last_peered":"2024-05-07T11:17:30.403479+0000","last_clean":"2024-05-07T11:17:30.403479+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:30.403479+0000","last_undegraded":"2024-05-07T11:17:30.403479+0000","last_fullsized":"2024-05-07T11:17:30.403479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:16.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":171,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404368+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:30.404368+0000","last_peered":"2024-05-07T11:17:30.404368+0000","last_clean":"2024-05-07T11:17:30.404368+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:30.404368+0000","last_undegraded":"2024-05-07T11:17:30.404368+0000","last_fullsized":"2024-05-07T11:17:30.404368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:17.953399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.407286+0000","last_change":"2024-05-07T11:17:30.407286+0000","last_active":"2024-05-07T11:17:30.407286+0000","last_peered":"2024-05-07T11:17:30.407286+0000","last_clean":"2024-05-07T11:17:30.407286+0000","last_became_active":"2024-05-07T11:17:30.406353+0000","last_became_peered":"2024-05-07T11:17:30.406353+0000","last_unstale":"2024-05-07T11:17:30.407286+0000","last_undegraded":"2024-05-07T11:17:30.407286+0000","last_fullsized":"2024-05-07T11:17:30.407286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:51.684426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":124612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795798+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:30.795798+0000","last_peered":"2024-05-07T11:17:30.795798+0000","last_clean":"2024-05-07T11:17:30.795798+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:30.795798+0000","last_undegraded":"2024-05-07T11:17:30.795798+0000","last_fullsized":"2024-05-07T11:17:30.795798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:24.011380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'169","reported_seq":321,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794835+0000","last_change":"2024-05-07T11:17:22.416150+0000","last_active":"2024-05-07T11:17:30.794835+0000","last_peered":"2024-05-07T11:17:30.794835+0000","last_clean":"2024-05-07T11:17:30.794835+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:30.794835+0000","last_undegraded":"2024-05-07T11:17:30.794835+0000","last_fullsized":"2024-05-07T11:17:30.794835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:28.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403986+0000","last_change":"2024-05-07T11:17:18.504321+0000","last_active":"2024-05-07T11:17:30.403986+0000","last_peered":"2024-05-07T11:17:30.403986+0000","last_clean":"2024-05-07T11:17:30.403986+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:30.403986+0000","last_undegraded":"2024-05-07T11:17:30.403986+0000","last_fullsized":"2024-05-07T11:17:30.403986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"63'199","reported_seq":614,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403820+0000","last_change":"2024-05-07T11:17:25.402468+0000","last_active":"2024-05-07T11:17:30.403820+0000","last_peered":"2024-05-07T11:17:30.403820+0000","last_clean":"2024-05-07T11:17:30.403820+0000","last_became_active":"2024-05-07T11:17:25.401850+0000","last_became_peered":"2024-05-07T11:17:25.401850+0000","last_unstale":"2024-05-07T11:17:30.403820+0000","last_undegraded":"2024-05-07T11:17:30.403820+0000","last_fullsized":"2024-05-07T11:17:30.403820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:19.494294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403872+0000","last_change":"2024-05-07T11:17:18.429950+0000","last_active":"2024-05-07T11:17:30.403872+0000","last_peered":"2024-05-07T11:17:30.403872+0000","last_clean":"2024-05-07T11:17:30.403872+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:30.403872+0000","last_undegraded":"2024-05-07T11:17:30.403872+0000","last_fullsized":"2024-05-07T11:17:30.403872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5805,"num_bytes_recovered":19428989,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64405504,"data_stored":53099596,"data_compressed":4611280,"data_compressed_allocated":5402624,"data_compressed_original":14118912,"omap_allocated":0,"internal_metadata":0},"log_size":10416,"ondisk_log_size":10416,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":428,"ondisk_log_size":428,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84172,"kb_used_data":30776,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94287668,"statfs":{"total":96636764160,"available":96550572032,"internally_reserved":0,"allocated":31514624,"data_stored":54276063,"data_compressed":6326260,"data_compressed_allocated":7593984,"data_compressed_original":37191680,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710725,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":23060,"kb_used_omap":10,"kb_used_meta":35893,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":23613440,"data_stored":43695842,"data_compressed":5536379,"data_compressed_allocated":6516736,"data_compressed_original":33533952,"omap_allocated":10404,"internal_metadata":36755292},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66612,"kb_used_data":27108,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305228,"statfs":{"total":96636764160,"available":96568553472,"internally_reserved":0,"allocated":27758592,"data_stored":40411961,"data_compressed":4972494,"data_compressed_allocated":5840896,"data_compressed_original":25952256,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22953984,"data_stored":19509974,"data_compressed":1953035,"data_compressed_allocated":2265088,"data_compressed_original":5890048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17506304,"data_stored":13389680,"data_compressed":1088810,"data_compressed_allocated":1314816,"data_compressed_original":3727360,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23945216,"data_stored":20199942,"data_compressed":1569435,"data_compressed_allocated":1822720,"data_compressed_original":4501504,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:35.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:35.861 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:35.862 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:35.872 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-05-07T11:17:35.015009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5827,"num_bytes_recovered":56847285,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11001,"ondisk_log_size":11001,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":209764,"kb_used_data":80944,"kb_used_omap":13,"kb_used_meta":128754,"kb_avail":282905756,"statfs":{"total":289910292480,"available":289695494144,"internally_reserved":0,"allocated":82886656,"data_stored":138383866,"data_compressed":16835133,"data_compressed_allocated":19951616,"data_compressed_original":96677888,"omap_allocated":13594,"internal_metadata":131844838},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1076,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1230,"num_bytes_recovered":5842334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.619589"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":310,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796409+0000","last_change":"2024-05-07T11:17:27.408581+0000","last_active":"2024-05-07T11:17:30.796409+0000","last_peered":"2024-05-07T11:17:30.796409+0000","last_clean":"2024-05-07T11:17:30.796409+0000","last_became_active":"2024-05-07T11:17:27.407668+0000","last_became_peered":"2024-05-07T11:17:27.407668+0000","last_unstale":"2024-05-07T11:17:30.796409+0000","last_undegraded":"2024-05-07T11:17:30.796409+0000","last_fullsized":"2024-05-07T11:17:30.796409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:48:35.134503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":85925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'155","reported_seq":309,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796170+0000","last_change":"2024-05-07T11:17:21.419253+0000","last_active":"2024-05-07T11:17:30.796170+0000","last_peered":"2024-05-07T11:17:30.796170+0000","last_clean":"2024-05-07T11:17:30.796170+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:30.796170+0000","last_undegraded":"2024-05-07T11:17:30.796170+0000","last_fullsized":"2024-05-07T11:17:30.796170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:45:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'169","reported_seq":517,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403992+0000","last_change":"2024-05-07T11:17:26.408003+0000","last_active":"2024-05-07T11:17:30.403992+0000","last_peered":"2024-05-07T11:17:30.403992+0000","last_clean":"2024-05-07T11:17:30.403992+0000","last_became_active":"2024-05-07T11:17:26.407269+0000","last_became_peered":"2024-05-07T11:17:26.407269+0000","last_unstale":"2024-05-07T11:17:30.403992+0000","last_undegraded":"2024-05-07T11:17:30.403992+0000","last_fullsized":"2024-05-07T11:17:30.403992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:01.664780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":75254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":274,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403937+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:30.403937+0000","last_peered":"2024-05-07T11:17:30.403937+0000","last_clean":"2024-05-07T11:17:30.403937+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:30.403937+0000","last_undegraded":"2024-05-07T11:17:30.403937+0000","last_fullsized":"2024-05-07T11:17:30.403937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"63'186","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795678+0000","last_change":"2024-05-07T11:17:21.419034+0000","last_active":"2024-05-07T11:17:30.795678+0000","last_peered":"2024-05-07T11:17:30.795678+0000","last_clean":"2024-05-07T11:17:30.795678+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:30.795678+0000","last_undegraded":"2024-05-07T11:17:30.795678+0000","last_fullsized":"2024-05-07T11:17:30.795678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:42.536445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":488,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.406178+0000","last_change":"2024-05-07T11:17:30.406178+0000","last_active":"2024-05-07T11:17:30.406178+0000","last_peered":"2024-05-07T11:17:30.406178+0000","last_clean":"2024-05-07T11:17:30.406178+0000","last_became_active":"2024-05-07T11:17:30.405536+0000","last_became_peered":"2024-05-07T11:17:30.405536+0000","last_unstale":"2024-05-07T11:17:30.406178+0000","last_undegraded":"2024-05-07T11:17:30.406178+0000","last_fullsized":"2024-05-07T11:17:30.406178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:47.059204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":529421,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"63'166","reported_seq":269,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403641+0000","last_change":"2024-05-07T11:17:22.418934+0000","last_active":"2024-05-07T11:17:30.403641+0000","last_peered":"2024-05-07T11:17:30.403641+0000","last_clean":"2024-05-07T11:17:30.403641+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:30.403641+0000","last_undegraded":"2024-05-07T11:17:30.403641+0000","last_fullsized":"2024-05-07T11:17:30.403641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:05.143462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403262+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:30.403262+0000","last_peered":"2024-05-07T11:17:30.403262+0000","last_clean":"2024-05-07T11:17:30.403262+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:30.403262+0000","last_undegraded":"2024-05-07T11:17:30.403262+0000","last_fullsized":"2024-05-07T11:17:30.403262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:04.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403549+0000","last_change":"2024-05-07T11:17:27.409473+0000","last_active":"2024-05-07T11:17:30.403549+0000","last_peered":"2024-05-07T11:17:30.403549+0000","last_clean":"2024-05-07T11:17:30.403549+0000","last_became_active":"2024-05-07T11:17:27.408650+0000","last_became_peered":"2024-05-07T11:17:27.408650+0000","last_unstale":"2024-05-07T11:17:30.403549+0000","last_undegraded":"2024-05-07T11:17:30.403549+0000","last_fullsized":"2024-05-07T11:17:30.403549+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:11:56.118436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":631133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"63'156","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794731+0000","last_change":"2024-05-07T11:17:22.416801+0000","last_active":"2024-05-07T11:17:30.794731+0000","last_peered":"2024-05-07T11:17:30.794731+0000","last_clean":"2024-05-07T11:17:30.794731+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:30.794731+0000","last_undegraded":"2024-05-07T11:17:30.794731+0000","last_fullsized":"2024-05-07T11:17:30.794731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:07.028486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'154","reported_seq":450,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404098+0000","last_change":"2024-05-07T11:17:22.419089+0000","last_active":"2024-05-07T11:17:30.404098+0000","last_peered":"2024-05-07T11:17:30.404098+0000","last_clean":"2024-05-07T11:17:30.404098+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:30.404098+0000","last_undegraded":"2024-05-07T11:17:30.404098+0000","last_fullsized":"2024-05-07T11:17:30.404098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:57.833385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":280,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796121+0000","last_change":"2024-05-07T11:17:28.404789+0000","last_active":"2024-05-07T11:17:30.796121+0000","last_peered":"2024-05-07T11:17:30.796121+0000","last_clean":"2024-05-07T11:17:30.796121+0000","last_became_active":"2024-05-07T11:17:28.403770+0000","last_became_peered":"2024-05-07T11:17:28.403770+0000","last_unstale":"2024-05-07T11:17:30.796121+0000","last_undegraded":"2024-05-07T11:17:30.796121+0000","last_fullsized":"2024-05-07T11:17:30.796121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:52.521740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":89602,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'136","reported_seq":291,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795785+0000","last_change":"2024-05-07T11:17:23.398879+0000","last_active":"2024-05-07T11:17:30.795785+0000","last_peered":"2024-05-07T11:17:30.795785+0000","last_clean":"2024-05-07T11:17:30.795785+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:30.795785+0000","last_undegraded":"2024-05-07T11:17:30.795785+0000","last_fullsized":"2024-05-07T11:17:30.795785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:33:07.091905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'175","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403781+0000","last_change":"2024-05-07T11:17:26.407920+0000","last_active":"2024-05-07T11:17:30.403781+0000","last_peered":"2024-05-07T11:17:30.403781+0000","last_clean":"2024-05-07T11:17:30.403781+0000","last_became_active":"2024-05-07T11:17:26.407342+0000","last_became_peered":"2024-05-07T11:17:26.407342+0000","last_unstale":"2024-05-07T11:17:30.403781+0000","last_undegraded":"2024-05-07T11:17:30.403781+0000","last_fullsized":"2024-05-07T11:17:30.403781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:55:22.847728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":196945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":531,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403816+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:30.403816+0000","last_peered":"2024-05-07T11:17:30.403816+0000","last_clean":"2024-05-07T11:17:30.403816+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:30.403816+0000","last_undegraded":"2024-05-07T11:17:30.403816+0000","last_fullsized":"2024-05-07T11:17:30.403816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:30:48.688430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":501,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.406594+0000","last_change":"2024-05-07T11:17:30.406594+0000","last_active":"2024-05-07T11:17:30.406594+0000","last_peered":"2024-05-07T11:17:30.406594+0000","last_clean":"2024-05-07T11:17:30.406594+0000","last_became_active":"2024-05-07T11:17:30.405896+0000","last_became_peered":"2024-05-07T11:17:30.405896+0000","last_unstale":"2024-05-07T11:17:30.406594+0000","last_undegraded":"2024-05-07T11:17:30.406594+0000","last_fullsized":"2024-05-07T11:17:30.406594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:53:51.552775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4343464,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'161","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404106+0000","last_change":"2024-05-07T11:17:22.416613+0000","last_active":"2024-05-07T11:17:30.404106+0000","last_peered":"2024-05-07T11:17:30.404106+0000","last_clean":"2024-05-07T11:17:30.404106+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:30.404106+0000","last_undegraded":"2024-05-07T11:17:30.404106+0000","last_fullsized":"2024-05-07T11:17:30.404106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"63'148","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796047+0000","last_change":"2024-05-07T11:17:21.418472+0000","last_active":"2024-05-07T11:17:30.796047+0000","last_peered":"2024-05-07T11:17:30.796047+0000","last_clean":"2024-05-07T11:17:30.796047+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:30.796047+0000","last_undegraded":"2024-05-07T11:17:30.796047+0000","last_fullsized":"2024-05-07T11:17:30.796047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:18.184681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'147","reported_seq":237,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403595+0000","last_change":"2024-05-07T11:17:21.418164+0000","last_active":"2024-05-07T11:17:30.403595+0000","last_peered":"2024-05-07T11:17:30.403595+0000","last_clean":"2024-05-07T11:17:30.403595+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:30.403595+0000","last_undegraded":"2024-05-07T11:17:30.403595+0000","last_fullsized":"2024-05-07T11:17:30.403595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":573,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404075+0000","last_change":"2024-05-07T11:17:29.407762+0000","last_active":"2024-05-07T11:17:30.404075+0000","last_peered":"2024-05-07T11:17:30.404075+0000","last_clean":"2024-05-07T11:17:30.404075+0000","last_became_active":"2024-05-07T11:17:29.407032+0000","last_became_peered":"2024-05-07T11:17:29.407032+0000","last_unstale":"2024-05-07T11:17:30.404075+0000","last_undegraded":"2024-05-07T11:17:30.404075+0000","last_fullsized":"2024-05-07T11:17:30.404075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:55:10.099065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":98139,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":305,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403794+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:30.403794+0000","last_peered":"2024-05-07T11:17:30.403794+0000","last_clean":"2024-05-07T11:17:30.403794+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:30.403794+0000","last_undegraded":"2024-05-07T11:17:30.403794+0000","last_fullsized":"2024-05-07T11:17:30.403794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795900+0000","last_change":"2024-05-07T11:17:29.408512+0000","last_active":"2024-05-07T11:17:30.795900+0000","last_peered":"2024-05-07T11:17:30.795900+0000","last_clean":"2024-05-07T11:17:30.795900+0000","last_became_active":"2024-05-07T11:17:29.407294+0000","last_became_peered":"2024-05-07T11:17:29.407294+0000","last_unstale":"2024-05-07T11:17:30.795900+0000","last_undegraded":"2024-05-07T11:17:30.795900+0000","last_fullsized":"2024-05-07T11:17:30.795900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:30:15.441943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":116557,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'159","reported_seq":247,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402842+0000","last_change":"2024-05-07T11:17:21.418519+0000","last_active":"2024-05-07T11:17:30.402842+0000","last_peered":"2024-05-07T11:17:30.402842+0000","last_clean":"2024-05-07T11:17:30.402842+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:30.402842+0000","last_undegraded":"2024-05-07T11:17:30.402842+0000","last_fullsized":"2024-05-07T11:17:30.402842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"63'169","reported_seq":323,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795399+0000","last_change":"2024-05-07T11:17:21.414896+0000","last_active":"2024-05-07T11:17:30.795399+0000","last_peered":"2024-05-07T11:17:30.795399+0000","last_clean":"2024-05-07T11:17:30.795399+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:30.795399+0000","last_undegraded":"2024-05-07T11:17:30.795399+0000","last_fullsized":"2024-05-07T11:17:30.795399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:52.242314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796018+0000","last_change":"2024-05-07T11:17:24.407028+0000","last_active":"2024-05-07T11:17:30.796018+0000","last_peered":"2024-05-07T11:17:30.796018+0000","last_clean":"2024-05-07T11:17:30.796018+0000","last_became_active":"2024-05-07T11:17:24.406307+0000","last_became_peered":"2024-05-07T11:17:24.406307+0000","last_unstale":"2024-05-07T11:17:30.796018+0000","last_undegraded":"2024-05-07T11:17:30.796018+0000","last_fullsized":"2024-05-07T11:17:30.796018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:24.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":230897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'195","reported_seq":345,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403991+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:17:30.403991+0000","last_peered":"2024-05-07T11:17:30.403991+0000","last_clean":"2024-05-07T11:17:30.403991+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:30.403991+0000","last_undegraded":"2024-05-07T11:17:30.403991+0000","last_fullsized":"2024-05-07T11:17:30.403991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404276+0000","last_change":"2024-05-07T11:17:29.416071+0000","last_active":"2024-05-07T11:17:30.404276+0000","last_peered":"2024-05-07T11:17:30.404276+0000","last_clean":"2024-05-07T11:17:30.404276+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:30.404276+0000","last_undegraded":"2024-05-07T11:17:30.404276+0000","last_fullsized":"2024-05-07T11:17:30.404276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:42.494889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":67681,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":287,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796001+0000","last_change":"2024-05-07T11:17:28.404770+0000","last_active":"2024-05-07T11:17:30.796001+0000","last_peered":"2024-05-07T11:17:30.796001+0000","last_clean":"2024-05-07T11:17:30.796001+0000","last_became_active":"2024-05-07T11:17:28.403782+0000","last_became_peered":"2024-05-07T11:17:28.403782+0000","last_unstale":"2024-05-07T11:17:30.796001+0000","last_undegraded":"2024-05-07T11:17:30.796001+0000","last_fullsized":"2024-05-07T11:17:30.796001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:38.547257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":211687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":247,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403283+0000","last_change":"2024-05-07T11:17:24.403807+0000","last_active":"2024-05-07T11:17:30.403283+0000","last_peered":"2024-05-07T11:17:30.403283+0000","last_clean":"2024-05-07T11:17:30.403283+0000","last_became_active":"2024-05-07T11:17:24.403179+0000","last_became_peered":"2024-05-07T11:17:24.403179+0000","last_unstale":"2024-05-07T11:17:30.403283+0000","last_undegraded":"2024-05-07T11:17:30.403283+0000","last_fullsized":"2024-05-07T11:17:30.403283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:15:55.499366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":323,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795763+0000","last_change":"2024-05-07T11:17:29.409488+0000","last_active":"2024-05-07T11:17:30.795763+0000","last_peered":"2024-05-07T11:17:30.795763+0000","last_clean":"2024-05-07T11:17:30.795763+0000","last_became_active":"2024-05-07T11:17:29.408425+0000","last_became_peered":"2024-05-07T11:17:29.408425+0000","last_unstale":"2024-05-07T11:17:30.795763+0000","last_undegraded":"2024-05-07T11:17:30.795763+0000","last_fullsized":"2024-05-07T11:17:30.795763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:34.508418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":86167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'192","reported_seq":586,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402995+0000","last_change":"2024-05-07T11:17:22.416120+0000","last_active":"2024-05-07T11:17:30.402995+0000","last_peered":"2024-05-07T11:17:30.402995+0000","last_clean":"2024-05-07T11:17:30.402995+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:30.402995+0000","last_undegraded":"2024-05-07T11:17:30.402995+0000","last_fullsized":"2024-05-07T11:17:30.402995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:13.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"63'185","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403405+0000","last_change":"2024-05-07T11:17:28.399808+0000","last_active":"2024-05-07T11:17:30.403405+0000","last_peered":"2024-05-07T11:17:30.403405+0000","last_clean":"2024-05-07T11:17:30.403405+0000","last_became_active":"2024-05-07T11:17:28.398801+0000","last_became_peered":"2024-05-07T11:17:28.398801+0000","last_unstale":"2024-05-07T11:17:30.403405+0000","last_undegraded":"2024-05-07T11:17:30.403405+0000","last_fullsized":"2024-05-07T11:17:30.403405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:34.170387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":459999,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'156","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794879+0000","last_change":"2024-05-07T11:17:22.416165+0000","last_active":"2024-05-07T11:17:30.794879+0000","last_peered":"2024-05-07T11:17:30.794879+0000","last_clean":"2024-05-07T11:17:30.794879+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:30.794879+0000","last_undegraded":"2024-05-07T11:17:30.794879+0000","last_fullsized":"2024-05-07T11:17:30.794879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:57.237765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":277,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404046+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:30.404046+0000","last_peered":"2024-05-07T11:17:30.404046+0000","last_clean":"2024-05-07T11:17:30.404046+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:30.404046+0000","last_undegraded":"2024-05-07T11:17:30.404046+0000","last_fullsized":"2024-05-07T11:17:30.404046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"63'141","reported_seq":295,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796184+0000","last_change":"2024-05-07T11:17:21.419206+0000","last_active":"2024-05-07T11:17:30.796184+0000","last_peered":"2024-05-07T11:17:30.796184+0000","last_clean":"2024-05-07T11:17:30.796184+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:30.796184+0000","last_undegraded":"2024-05-07T11:17:30.796184+0000","last_fullsized":"2024-05-07T11:17:30.796184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:12.679336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403297+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:30.403297+0000","last_peered":"2024-05-07T11:17:30.403297+0000","last_clean":"2024-05-07T11:17:30.403297+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:30.403297+0000","last_undegraded":"2024-05-07T11:17:30.403297+0000","last_fullsized":"2024-05-07T11:17:30.403297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.025763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"63'179","reported_seq":267,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403562+0000","last_change":"2024-05-07T11:17:21.419284+0000","last_active":"2024-05-07T11:17:30.403562+0000","last_peered":"2024-05-07T11:17:30.403562+0000","last_clean":"2024-05-07T11:17:30.403562+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:30.403562+0000","last_undegraded":"2024-05-07T11:17:30.403562+0000","last_fullsized":"2024-05-07T11:17:30.403562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:54.463898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795361+0000","last_change":"2024-05-07T11:17:18.423604+0000","last_active":"2024-05-07T11:17:30.795361+0000","last_peered":"2024-05-07T11:17:30.795361+0000","last_clean":"2024-05-07T11:17:30.795361+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:30.795361+0000","last_undegraded":"2024-05-07T11:17:30.795361+0000","last_fullsized":"2024-05-07T11:17:30.795361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:45:28.650148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":244,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403803+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:30.403803+0000","last_peered":"2024-05-07T11:17:30.403803+0000","last_clean":"2024-05-07T11:17:30.403803+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:30.403803+0000","last_undegraded":"2024-05-07T11:17:30.403803+0000","last_fullsized":"2024-05-07T11:17:30.403803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403673+0000","last_change":"2024-05-07T11:17:18.433027+0000","last_active":"2024-05-07T11:17:30.403673+0000","last_peered":"2024-05-07T11:17:30.403673+0000","last_clean":"2024-05-07T11:17:30.403673+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:30.403673+0000","last_undegraded":"2024-05-07T11:17:30.403673+0000","last_fullsized":"2024-05-07T11:17:30.403673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:47.068504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404359+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:30.404359+0000","last_peered":"2024-05-07T11:17:30.404359+0000","last_clean":"2024-05-07T11:17:30.404359+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:30.404359+0000","last_undegraded":"2024-05-07T11:17:30.404359+0000","last_fullsized":"2024-05-07T11:17:30.404359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:35:51.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'155","reported_seq":435,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403110+0000","last_change":"2024-05-07T11:17:27.404484+0000","last_active":"2024-05-07T11:17:30.403110+0000","last_peered":"2024-05-07T11:17:30.403110+0000","last_clean":"2024-05-07T11:17:30.403110+0000","last_became_active":"2024-05-07T11:17:27.403866+0000","last_became_peered":"2024-05-07T11:17:27.403866+0000","last_unstale":"2024-05-07T11:17:30.403110+0000","last_undegraded":"2024-05-07T11:17:30.403110+0000","last_fullsized":"2024-05-07T11:17:30.403110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:15:32.849874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":166862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795883+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:30.795883+0000","last_peered":"2024-05-07T11:17:30.795883+0000","last_clean":"2024-05-07T11:17:30.795883+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:30.795883+0000","last_undegraded":"2024-05-07T11:17:30.795883+0000","last_fullsized":"2024-05-07T11:17:30.795883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:16.479879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'167","reported_seq":321,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795133+0000","last_change":"2024-05-07T11:17:21.418782+0000","last_active":"2024-05-07T11:17:30.795133+0000","last_peered":"2024-05-07T11:17:30.795133+0000","last_clean":"2024-05-07T11:17:30.795133+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:30.795133+0000","last_undegraded":"2024-05-07T11:17:30.795133+0000","last_fullsized":"2024-05-07T11:17:30.795133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:13.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404754+0000","last_change":"2024-05-07T11:17:22.419069+0000","last_active":"2024-05-07T11:17:30.404754+0000","last_peered":"2024-05-07T11:17:30.404754+0000","last_clean":"2024-05-07T11:17:30.404754+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:30.404754+0000","last_undegraded":"2024-05-07T11:17:30.404754+0000","last_fullsized":"2024-05-07T11:17:30.404754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:20.890067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404443+0000","last_change":"2024-05-07T11:17:29.408348+0000","last_active":"2024-05-07T11:17:30.404443+0000","last_peered":"2024-05-07T11:17:30.404443+0000","last_clean":"2024-05-07T11:17:30.404443+0000","last_became_active":"2024-05-07T11:17:29.407677+0000","last_became_peered":"2024-05-07T11:17:29.407677+0000","last_unstale":"2024-05-07T11:17:30.404443+0000","last_undegraded":"2024-05-07T11:17:30.404443+0000","last_fullsized":"2024-05-07T11:17:30.404443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:02.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":83336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404663+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:30.404663+0000","last_peered":"2024-05-07T11:17:30.404663+0000","last_clean":"2024-05-07T11:17:30.404663+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:30.404663+0000","last_undegraded":"2024-05-07T11:17:30.404663+0000","last_fullsized":"2024-05-07T11:17:30.404663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:31:28.580245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"63'164","reported_seq":314,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403552+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:17:30.403552+0000","last_peered":"2024-05-07T11:17:30.403552+0000","last_clean":"2024-05-07T11:17:30.403552+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:30.403552+0000","last_undegraded":"2024-05-07T11:17:30.403552+0000","last_fullsized":"2024-05-07T11:17:30.403552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403688+0000","last_change":"2024-05-07T11:17:18.450923+0000","last_active":"2024-05-07T11:17:30.403688+0000","last_peered":"2024-05-07T11:17:30.403688+0000","last_clean":"2024-05-07T11:17:30.403688+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:30.403688+0000","last_undegraded":"2024-05-07T11:17:30.403688+0000","last_fullsized":"2024-05-07T11:17:30.403688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:38.864461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"63'172","reported_seq":560,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404209+0000","last_change":"2024-05-07T11:17:28.401492+0000","last_active":"2024-05-07T11:17:30.404209+0000","last_peered":"2024-05-07T11:17:30.404209+0000","last_clean":"2024-05-07T11:17:30.404209+0000","last_became_active":"2024-05-07T11:17:28.400673+0000","last_became_peered":"2024-05-07T11:17:28.400673+0000","last_unstale":"2024-05-07T11:17:30.404209+0000","last_undegraded":"2024-05-07T11:17:30.404209+0000","last_fullsized":"2024-05-07T11:17:30.404209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:41.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":127501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404803+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:30.404803+0000","last_peered":"2024-05-07T11:17:30.404803+0000","last_clean":"2024-05-07T11:17:30.404803+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:30.404803+0000","last_undegraded":"2024-05-07T11:17:30.404803+0000","last_fullsized":"2024-05-07T11:17:30.404803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"63'163","reported_seq":519,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404591+0000","last_change":"2024-05-07T11:17:27.405072+0000","last_active":"2024-05-07T11:17:30.404591+0000","last_peered":"2024-05-07T11:17:30.404591+0000","last_clean":"2024-05-07T11:17:30.404591+0000","last_became_active":"2024-05-07T11:17:27.404340+0000","last_became_peered":"2024-05-07T11:17:27.404340+0000","last_unstale":"2024-05-07T11:17:30.404591+0000","last_undegraded":"2024-05-07T11:17:30.404591+0000","last_fullsized":"2024-05-07T11:17:30.404591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:05:12.602038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":119690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795129+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:30.795129+0000","last_peered":"2024-05-07T11:17:30.795129+0000","last_clean":"2024-05-07T11:17:30.795129+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:30.795129+0000","last_undegraded":"2024-05-07T11:17:30.795129+0000","last_fullsized":"2024-05-07T11:17:30.795129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:47.689436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'137","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403862+0000","last_change":"2024-05-07T11:17:24.403787+0000","last_active":"2024-05-07T11:17:30.403862+0000","last_peered":"2024-05-07T11:17:30.403862+0000","last_clean":"2024-05-07T11:17:30.403862+0000","last_became_active":"2024-05-07T11:17:24.403279+0000","last_became_peered":"2024-05-07T11:17:24.403279+0000","last_unstale":"2024-05-07T11:17:30.403862+0000","last_undegraded":"2024-05-07T11:17:30.403862+0000","last_fullsized":"2024-05-07T11:17:30.403862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:42.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":119,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795539+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:30.795539+0000","last_peered":"2024-05-07T11:17:30.795539+0000","last_clean":"2024-05-07T11:17:30.795539+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:30.795539+0000","last_undegraded":"2024-05-07T11:17:30.795539+0000","last_fullsized":"2024-05-07T11:17:30.795539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:59.411938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'141","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403996+0000","last_change":"2024-05-07T11:17:22.417126+0000","last_active":"2024-05-07T11:17:30.403996+0000","last_peered":"2024-05-07T11:17:30.403996+0000","last_clean":"2024-05-07T11:17:30.403996+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:30.403996+0000","last_undegraded":"2024-05-07T11:17:30.403996+0000","last_fullsized":"2024-05-07T11:17:30.403996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":359,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404346+0000","last_change":"2024-05-07T11:17:18.433863+0000","last_active":"2024-05-07T11:17:30.404346+0000","last_peered":"2024-05-07T11:17:30.404346+0000","last_clean":"2024-05-07T11:17:30.404346+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:30.404346+0000","last_undegraded":"2024-05-07T11:17:30.404346+0000","last_fullsized":"2024-05-07T11:17:30.404346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:10.515455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404385+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:30.404385+0000","last_peered":"2024-05-07T11:17:30.404385+0000","last_clean":"2024-05-07T11:17:30.404385+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:30.404385+0000","last_undegraded":"2024-05-07T11:17:30.404385+0000","last_fullsized":"2024-05-07T11:17:30.404385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:03:02.539869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403061+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:30.403061+0000","last_peered":"2024-05-07T11:17:30.403061+0000","last_clean":"2024-05-07T11:17:30.403061+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:30.403061+0000","last_undegraded":"2024-05-07T11:17:30.403061+0000","last_fullsized":"2024-05-07T11:17:30.403061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404654+0000","last_change":"2024-05-07T11:17:29.231999+0000","last_active":"2024-05-07T11:17:30.404654+0000","last_peered":"2024-05-07T11:17:30.404654+0000","last_clean":"2024-05-07T11:17:30.404654+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:30.404654+0000","last_undegraded":"2024-05-07T11:17:30.404654+0000","last_fullsized":"2024-05-07T11:17:30.404654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:37.451106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":138308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404219+0000","last_change":"2024-05-07T11:17:18.433452+0000","last_active":"2024-05-07T11:17:30.404219+0000","last_peered":"2024-05-07T11:17:30.404219+0000","last_clean":"2024-05-07T11:17:30.404219+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:30.404219+0000","last_undegraded":"2024-05-07T11:17:30.404219+0000","last_fullsized":"2024-05-07T11:17:30.404219+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:26.663080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":220,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403281+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:17:30.403281+0000","last_peered":"2024-05-07T11:17:30.403281+0000","last_clean":"2024-05-07T11:17:30.403281+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:30.403281+0000","last_undegraded":"2024-05-07T11:17:30.403281+0000","last_fullsized":"2024-05-07T11:17:30.403281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"63'160","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795913+0000","last_change":"2024-05-07T11:17:24.407000+0000","last_active":"2024-05-07T11:17:30.795913+0000","last_peered":"2024-05-07T11:17:30.795913+0000","last_clean":"2024-05-07T11:17:30.795913+0000","last_became_active":"2024-05-07T11:17:24.406306+0000","last_became_peered":"2024-05-07T11:17:24.406306+0000","last_unstale":"2024-05-07T11:17:30.795913+0000","last_undegraded":"2024-05-07T11:17:30.795913+0000","last_fullsized":"2024-05-07T11:17:30.795913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:56:56.763708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":402414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403560+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:30.403560+0000","last_peered":"2024-05-07T11:17:30.403560+0000","last_clean":"2024-05-07T11:17:30.403560+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:30.403560+0000","last_undegraded":"2024-05-07T11:17:30.403560+0000","last_fullsized":"2024-05-07T11:17:30.403560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:20.744525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795119+0000","last_change":"2024-05-07T11:17:18.572639+0000","last_active":"2024-05-07T11:17:30.795119+0000","last_peered":"2024-05-07T11:17:30.795119+0000","last_clean":"2024-05-07T11:17:30.795119+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:30.795119+0000","last_undegraded":"2024-05-07T11:17:30.795119+0000","last_fullsized":"2024-05-07T11:17:30.795119+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:15.538158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403967+0000","last_change":"2024-05-07T11:17:26.407965+0000","last_active":"2024-05-07T11:17:30.403967+0000","last_peered":"2024-05-07T11:17:30.403967+0000","last_clean":"2024-05-07T11:17:30.403967+0000","last_became_active":"2024-05-07T11:17:26.407203+0000","last_became_peered":"2024-05-07T11:17:26.407203+0000","last_unstale":"2024-05-07T11:17:30.403967+0000","last_undegraded":"2024-05-07T11:17:30.403967+0000","last_fullsized":"2024-05-07T11:17:30.403967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:50.842472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":384377,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404866+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:30.404866+0000","last_peered":"2024-05-07T11:17:30.404866+0000","last_clean":"2024-05-07T11:17:30.404866+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:30.404866+0000","last_undegraded":"2024-05-07T11:17:30.404866+0000","last_fullsized":"2024-05-07T11:17:30.404866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":162,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404316+0000","last_change":"2024-05-07T11:17:18.404539+0000","last_active":"2024-05-07T11:17:30.404316+0000","last_peered":"2024-05-07T11:17:30.404316+0000","last_clean":"2024-05-07T11:17:30.404316+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:30.404316+0000","last_undegraded":"2024-05-07T11:17:30.404316+0000","last_fullsized":"2024-05-07T11:17:30.404316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:50.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":233,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403988+0000","last_change":"2024-05-07T11:17:25.412664+0000","last_active":"2024-05-07T11:17:30.403988+0000","last_peered":"2024-05-07T11:17:30.403988+0000","last_clean":"2024-05-07T11:17:30.403988+0000","last_became_active":"2024-05-07T11:17:25.412026+0000","last_became_peered":"2024-05-07T11:17:25.412026+0000","last_unstale":"2024-05-07T11:17:30.403988+0000","last_undegraded":"2024-05-07T11:17:30.403988+0000","last_fullsized":"2024-05-07T11:17:30.403988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:19:28.465664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":174891,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404777+0000","last_change":"2024-05-07T11:17:22.424750+0000","last_active":"2024-05-07T11:17:30.404777+0000","last_peered":"2024-05-07T11:17:30.404777+0000","last_clean":"2024-05-07T11:17:30.404777+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:30.404777+0000","last_undegraded":"2024-05-07T11:17:30.404777+0000","last_fullsized":"2024-05-07T11:17:30.404777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:12.283160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404113+0000","last_change":"2024-05-07T11:17:18.433137+0000","last_active":"2024-05-07T11:17:30.404113+0000","last_peered":"2024-05-07T11:17:30.404113+0000","last_clean":"2024-05-07T11:17:30.404113+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:30.404113+0000","last_undegraded":"2024-05-07T11:17:30.404113+0000","last_fullsized":"2024-05-07T11:17:30.404113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:40.770823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":296,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795321+0000","last_change":"2024-05-07T11:17:29.408764+0000","last_active":"2024-05-07T11:17:30.795321+0000","last_peered":"2024-05-07T11:17:30.795321+0000","last_clean":"2024-05-07T11:17:30.795321+0000","last_became_active":"2024-05-07T11:17:29.407296+0000","last_became_peered":"2024-05-07T11:17:29.407296+0000","last_unstale":"2024-05-07T11:17:30.795321+0000","last_undegraded":"2024-05-07T11:17:30.795321+0000","last_fullsized":"2024-05-07T11:17:30.795321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:34:42.615088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":74509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403776+0000","last_change":"2024-05-07T11:17:18.431763+0000","last_active":"2024-05-07T11:17:30.403776+0000","last_peered":"2024-05-07T11:17:30.403776+0000","last_clean":"2024-05-07T11:17:30.403776+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:30.403776+0000","last_undegraded":"2024-05-07T11:17:30.403776+0000","last_fullsized":"2024-05-07T11:17:30.403776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:38.234395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":125,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796383+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:30.796383+0000","last_peered":"2024-05-07T11:17:30.796383+0000","last_clean":"2024-05-07T11:17:30.796383+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:30.796383+0000","last_undegraded":"2024-05-07T11:17:30.796383+0000","last_fullsized":"2024-05-07T11:17:30.796383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:54.609817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'181","reported_seq":331,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795311+0000","last_change":"2024-05-07T11:17:23.399296+0000","last_active":"2024-05-07T11:17:30.795311+0000","last_peered":"2024-05-07T11:17:30.795311+0000","last_clean":"2024-05-07T11:17:30.795311+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:30.795311+0000","last_undegraded":"2024-05-07T11:17:30.795311+0000","last_fullsized":"2024-05-07T11:17:30.795311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:21.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":100,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404018+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:30.404018+0000","last_peered":"2024-05-07T11:17:30.404018+0000","last_clean":"2024-05-07T11:17:30.404018+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:30.404018+0000","last_undegraded":"2024-05-07T11:17:30.404018+0000","last_fullsized":"2024-05-07T11:17:30.404018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:03.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403832+0000","last_change":"2024-05-07T11:17:18.432358+0000","last_active":"2024-05-07T11:17:30.403832+0000","last_peered":"2024-05-07T11:17:30.403832+0000","last_clean":"2024-05-07T11:17:30.403832+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:30.403832+0000","last_undegraded":"2024-05-07T11:17:30.403832+0000","last_fullsized":"2024-05-07T11:17:30.403832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:36.281521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"63'175","reported_seq":285,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403129+0000","last_change":"2024-05-07T11:17:22.420080+0000","last_active":"2024-05-07T11:17:30.403129+0000","last_peered":"2024-05-07T11:17:30.403129+0000","last_clean":"2024-05-07T11:17:30.403129+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:30.403129+0000","last_undegraded":"2024-05-07T11:17:30.403129+0000","last_fullsized":"2024-05-07T11:17:30.403129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:41.233935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'38","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403696+0000","last_change":"2024-05-07T11:17:18.459674+0000","last_active":"2024-05-07T11:17:30.403696+0000","last_peered":"2024-05-07T11:17:30.403696+0000","last_clean":"2024-05-07T11:17:30.403696+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:30.403696+0000","last_undegraded":"2024-05-07T11:17:30.403696+0000","last_fullsized":"2024-05-07T11:17:30.403696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:35.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404514+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:30.404514+0000","last_peered":"2024-05-07T11:17:30.404514+0000","last_clean":"2024-05-07T11:17:30.404514+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:30.404514+0000","last_undegraded":"2024-05-07T11:17:30.404514+0000","last_fullsized":"2024-05-07T11:17:30.404514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:14.650941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'138","reported_seq":290,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794688+0000","last_change":"2024-05-07T11:17:22.417629+0000","last_active":"2024-05-07T11:17:30.794688+0000","last_peered":"2024-05-07T11:17:30.794688+0000","last_clean":"2024-05-07T11:17:30.794688+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:30.794688+0000","last_undegraded":"2024-05-07T11:17:30.794688+0000","last_fullsized":"2024-05-07T11:17:30.794688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:58.760049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'164","reported_seq":510,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403556+0000","last_change":"2024-05-07T11:17:23.400613+0000","last_active":"2024-05-07T11:17:30.403556+0000","last_peered":"2024-05-07T11:17:30.403556+0000","last_clean":"2024-05-07T11:17:30.403556+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:30.403556+0000","last_undegraded":"2024-05-07T11:17:30.403556+0000","last_fullsized":"2024-05-07T11:17:30.403556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:28.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":208,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404486+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:30.404486+0000","last_peered":"2024-05-07T11:17:30.404486+0000","last_clean":"2024-05-07T11:17:30.404486+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:30.404486+0000","last_undegraded":"2024-05-07T11:17:30.404486+0000","last_fullsized":"2024-05-07T11:17:30.404486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:35.832524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":228,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403482+0000","last_change":"2024-05-07T11:17:25.413137+0000","last_active":"2024-05-07T11:17:30.403482+0000","last_peered":"2024-05-07T11:17:30.403482+0000","last_clean":"2024-05-07T11:17:30.403482+0000","last_became_active":"2024-05-07T11:17:25.412149+0000","last_became_peered":"2024-05-07T11:17:25.412149+0000","last_unstale":"2024-05-07T11:17:30.403482+0000","last_undegraded":"2024-05-07T11:17:30.403482+0000","last_fullsized":"2024-05-07T11:17:30.403482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:05.259035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795725+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:30.795725+0000","last_peered":"2024-05-07T11:17:30.795725+0000","last_clean":"2024-05-07T11:17:30.795725+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:30.795725+0000","last_undegraded":"2024-05-07T11:17:30.795725+0000","last_fullsized":"2024-05-07T11:17:30.795725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:46.092532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404461+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:30.404461+0000","last_peered":"2024-05-07T11:17:30.404461+0000","last_clean":"2024-05-07T11:17:30.404461+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:30.404461+0000","last_undegraded":"2024-05-07T11:17:30.404461+0000","last_fullsized":"2024-05-07T11:17:30.404461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.076287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"63'172","reported_seq":261,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402830+0000","last_change":"2024-05-07T11:17:21.419673+0000","last_active":"2024-05-07T11:17:30.402830+0000","last_peered":"2024-05-07T11:17:30.402830+0000","last_clean":"2024-05-07T11:17:30.402830+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:30.402830+0000","last_undegraded":"2024-05-07T11:17:30.402830+0000","last_fullsized":"2024-05-07T11:17:30.402830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:01.519110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403713+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:30.403713+0000","last_peered":"2024-05-07T11:17:30.403713+0000","last_clean":"2024-05-07T11:17:30.403713+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:30.403713+0000","last_undegraded":"2024-05-07T11:17:30.403713+0000","last_fullsized":"2024-05-07T11:17:30.403713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:45.698283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":234,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403625+0000","last_change":"2024-05-07T11:17:27.408792+0000","last_active":"2024-05-07T11:17:30.403625+0000","last_peered":"2024-05-07T11:17:30.403625+0000","last_clean":"2024-05-07T11:17:30.403625+0000","last_became_active":"2024-05-07T11:17:27.407792+0000","last_became_peered":"2024-05-07T11:17:27.407792+0000","last_unstale":"2024-05-07T11:17:30.403625+0000","last_undegraded":"2024-05-07T11:17:30.403625+0000","last_fullsized":"2024-05-07T11:17:30.403625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":319,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796036+0000","last_change":"2024-05-07T11:17:26.408077+0000","last_active":"2024-05-07T11:17:30.796036+0000","last_peered":"2024-05-07T11:17:30.796036+0000","last_clean":"2024-05-07T11:17:30.796036+0000","last_became_active":"2024-05-07T11:17:26.407230+0000","last_became_peered":"2024-05-07T11:17:26.407230+0000","last_unstale":"2024-05-07T11:17:30.796036+0000","last_undegraded":"2024-05-07T11:17:30.796036+0000","last_fullsized":"2024-05-07T11:17:30.796036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:29.469789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":91096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402939+0000","last_change":"2024-05-07T11:17:18.431271+0000","last_active":"2024-05-07T11:17:30.402939+0000","last_peered":"2024-05-07T11:17:30.402939+0000","last_clean":"2024-05-07T11:17:30.402939+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:30.402939+0000","last_undegraded":"2024-05-07T11:17:30.402939+0000","last_fullsized":"2024-05-07T11:17:30.402939+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":233,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403514+0000","last_change":"2024-05-07T11:17:25.403221+0000","last_active":"2024-05-07T11:17:30.403514+0000","last_peered":"2024-05-07T11:17:30.403514+0000","last_clean":"2024-05-07T11:17:30.403514+0000","last_became_active":"2024-05-07T11:17:25.402661+0000","last_became_peered":"2024-05-07T11:17:25.402661+0000","last_unstale":"2024-05-07T11:17:30.403514+0000","last_undegraded":"2024-05-07T11:17:30.403514+0000","last_fullsized":"2024-05-07T11:17:30.403514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:07.574111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403047+0000","last_change":"2024-05-07T11:17:18.402834+0000","last_active":"2024-05-07T11:17:30.403047+0000","last_peered":"2024-05-07T11:17:30.403047+0000","last_clean":"2024-05-07T11:17:30.403047+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:30.403047+0000","last_undegraded":"2024-05-07T11:17:30.403047+0000","last_fullsized":"2024-05-07T11:17:30.403047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"63'205","reported_seq":357,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794925+0000","last_change":"2024-05-07T11:17:22.421343+0000","last_active":"2024-05-07T11:17:30.794925+0000","last_peered":"2024-05-07T11:17:30.794925+0000","last_clean":"2024-05-07T11:17:30.794925+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:30.794925+0000","last_undegraded":"2024-05-07T11:17:30.794925+0000","last_fullsized":"2024-05-07T11:17:30.794925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:24.076915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795839+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:30.795839+0000","last_peered":"2024-05-07T11:17:30.795839+0000","last_clean":"2024-05-07T11:17:30.795839+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:30.795839+0000","last_undegraded":"2024-05-07T11:17:30.795839+0000","last_fullsized":"2024-05-07T11:17:30.795839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:53.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'163","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795930+0000","last_change":"2024-05-07T11:17:24.407114+0000","last_active":"2024-05-07T11:17:30.795930+0000","last_peered":"2024-05-07T11:17:30.795930+0000","last_clean":"2024-05-07T11:17:30.795930+0000","last_became_active":"2024-05-07T11:17:24.406337+0000","last_became_peered":"2024-05-07T11:17:24.406337+0000","last_unstale":"2024-05-07T11:17:30.795930+0000","last_undegraded":"2024-05-07T11:17:30.795930+0000","last_fullsized":"2024-05-07T11:17:30.795930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:28:35.002816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":280772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795500+0000","last_change":"2024-05-07T11:17:18.555160+0000","last_active":"2024-05-07T11:17:30.795500+0000","last_peered":"2024-05-07T11:17:30.795500+0000","last_clean":"2024-05-07T11:17:30.795500+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:30.795500+0000","last_undegraded":"2024-05-07T11:17:30.795500+0000","last_fullsized":"2024-05-07T11:17:30.795500+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:37.962741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'166","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403479+0000","last_change":"2024-05-07T11:17:21.418540+0000","last_active":"2024-05-07T11:17:30.403479+0000","last_peered":"2024-05-07T11:17:30.403479+0000","last_clean":"2024-05-07T11:17:30.403479+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:30.403479+0000","last_undegraded":"2024-05-07T11:17:30.403479+0000","last_fullsized":"2024-05-07T11:17:30.403479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:16.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":171,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404368+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:30.404368+0000","last_peered":"2024-05-07T11:17:30.404368+0000","last_clean":"2024-05-07T11:17:30.404368+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:30.404368+0000","last_undegraded":"2024-05-07T11:17:30.404368+0000","last_fullsized":"2024-05-07T11:17:30.404368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:17.953399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.407286+0000","last_change":"2024-05-07T11:17:30.407286+0000","last_active":"2024-05-07T11:17:30.407286+0000","last_peered":"2024-05-07T11:17:30.407286+0000","last_clean":"2024-05-07T11:17:30.407286+0000","last_became_active":"2024-05-07T11:17:30.406353+0000","last_became_peered":"2024-05-07T11:17:30.406353+0000","last_unstale":"2024-05-07T11:17:30.407286+0000","last_undegraded":"2024-05-07T11:17:30.407286+0000","last_fullsized":"2024-05-07T11:17:30.407286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:51.684426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":124612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795798+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:30.795798+0000","last_peered":"2024-05-07T11:17:30.795798+0000","last_clean":"2024-05-07T11:17:30.795798+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:30.795798+0000","last_undegraded":"2024-05-07T11:17:30.795798+0000","last_fullsized":"2024-05-07T11:17:30.795798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:24.011380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'169","reported_seq":321,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794835+0000","last_change":"2024-05-07T11:17:22.416150+0000","last_active":"2024-05-07T11:17:30.794835+0000","last_peered":"2024-05-07T11:17:30.794835+0000","last_clean":"2024-05-07T11:17:30.794835+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:30.794835+0000","last_undegraded":"2024-05-07T11:17:30.794835+0000","last_fullsized":"2024-05-07T11:17:30.794835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:28.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403986+0000","last_change":"2024-05-07T11:17:18.504321+0000","last_active":"2024-05-07T11:17:30.403986+0000","last_peered":"2024-05-07T11:17:30.403986+0000","last_clean":"2024-05-07T11:17:30.403986+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:30.403986+0000","last_undegraded":"2024-05-07T11:17:30.403986+0000","last_fullsized":"2024-05-07T11:17:30.403986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"63'199","reported_seq":614,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403820+0000","last_change":"2024-05-07T11:17:25.402468+0000","last_active":"2024-05-07T11:17:30.403820+0000","last_peered":"2024-05-07T11:17:30.403820+0000","last_clean":"2024-05-07T11:17:30.403820+0000","last_became_active":"2024-05-07T11:17:25.401850+0000","last_became_peered":"2024-05-07T11:17:25.401850+0000","last_unstale":"2024-05-07T11:17:30.403820+0000","last_undegraded":"2024-05-07T11:17:30.403820+0000","last_fullsized":"2024-05-07T11:17:30.403820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:19.494294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403872+0000","last_change":"2024-05-07T11:17:18.429950+0000","last_active":"2024-05-07T11:17:30.403872+0000","last_peered":"2024-05-07T11:17:30.403872+0000","last_clean":"2024-05-07T11:17:30.403872+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:30.403872+0000","last_undegraded":"2024-05-07T11:17:30.403872+0000","last_fullsized":"2024-05-07T11:17:30.403872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5805,"num_bytes_recovered":19428989,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64405504,"data_stored":53099596,"data_compressed":4611280,"data_compressed_allocated":5402624,"data_compressed_original":14118912,"omap_allocated":0,"internal_metadata":0},"log_size":10416,"ondisk_log_size":10416,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":428,"ondisk_log_size":428,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84172,"kb_used_data":30776,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94287668,"statfs":{"total":96636764160,"available":96550572032,"internally_reserved":0,"allocated":31514624,"data_stored":54276063,"data_compressed":6326260,"data_compressed_allocated":7593984,"data_compressed_original":37191680,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710725,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":23060,"kb_used_omap":10,"kb_used_meta":35893,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":23613440,"data_stored":43695842,"data_compressed":5536379,"data_compressed_allocated":6516736,"data_compressed_original":33533952,"omap_allocated":10404,"internal_metadata":36755292},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66612,"kb_used_data":27108,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305228,"statfs":{"total":96636764160,"available":96568553472,"internally_reserved":0,"allocated":27758592,"data_stored":40411961,"data_compressed":4972494,"data_compressed_allocated":5840896,"data_compressed_original":25952256,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22953984,"data_stored":19509974,"data_compressed":1953035,"data_compressed_allocated":2265088,"data_compressed_original":5890048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17506304,"data_stored":13389680,"data_compressed":1088810,"data_compressed_allocated":1314816,"data_compressed_original":3727360,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23945216,"data_stored":20199942,"data_compressed":1569435,"data_compressed_allocated":1822720,"data_compressed_original":4501504,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:35.877 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-07T11:17:35.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:36.215 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:36.226 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-05-07T11:17:35.015009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5827,"num_bytes_recovered":56847285,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11001,"ondisk_log_size":11001,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":209764,"kb_used_data":80944,"kb_used_omap":13,"kb_used_meta":128754,"kb_avail":282905756,"statfs":{"total":289910292480,"available":289695494144,"internally_reserved":0,"allocated":82886656,"data_stored":138383866,"data_compressed":16835133,"data_compressed_allocated":19951616,"data_compressed_original":96677888,"omap_allocated":13594,"internal_metadata":131844838},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1076,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1230,"num_bytes_recovered":5842334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.619589"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":310,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796409+0000","last_change":"2024-05-07T11:17:27.408581+0000","last_active":"2024-05-07T11:17:30.796409+0000","last_peered":"2024-05-07T11:17:30.796409+0000","last_clean":"2024-05-07T11:17:30.796409+0000","last_became_active":"2024-05-07T11:17:27.407668+0000","last_became_peered":"2024-05-07T11:17:27.407668+0000","last_unstale":"2024-05-07T11:17:30.796409+0000","last_undegraded":"2024-05-07T11:17:30.796409+0000","last_fullsized":"2024-05-07T11:17:30.796409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:48:35.134503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":85925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'155","reported_seq":309,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796170+0000","last_change":"2024-05-07T11:17:21.419253+0000","last_active":"2024-05-07T11:17:30.796170+0000","last_peered":"2024-05-07T11:17:30.796170+0000","last_clean":"2024-05-07T11:17:30.796170+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:30.796170+0000","last_undegraded":"2024-05-07T11:17:30.796170+0000","last_fullsized":"2024-05-07T11:17:30.796170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:45:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'169","reported_seq":517,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403992+0000","last_change":"2024-05-07T11:17:26.408003+0000","last_active":"2024-05-07T11:17:30.403992+0000","last_peered":"2024-05-07T11:17:30.403992+0000","last_clean":"2024-05-07T11:17:30.403992+0000","last_became_active":"2024-05-07T11:17:26.407269+0000","last_became_peered":"2024-05-07T11:17:26.407269+0000","last_unstale":"2024-05-07T11:17:30.403992+0000","last_undegraded":"2024-05-07T11:17:30.403992+0000","last_fullsized":"2024-05-07T11:17:30.403992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:01.664780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":75254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":274,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403937+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:30.403937+0000","last_peered":"2024-05-07T11:17:30.403937+0000","last_clean":"2024-05-07T11:17:30.403937+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:30.403937+0000","last_undegraded":"2024-05-07T11:17:30.403937+0000","last_fullsized":"2024-05-07T11:17:30.403937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"63'186","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795678+0000","last_change":"2024-05-07T11:17:21.419034+0000","last_active":"2024-05-07T11:17:30.795678+0000","last_peered":"2024-05-07T11:17:30.795678+0000","last_clean":"2024-05-07T11:17:30.795678+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:30.795678+0000","last_undegraded":"2024-05-07T11:17:30.795678+0000","last_fullsized":"2024-05-07T11:17:30.795678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:42.536445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":488,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.406178+0000","last_change":"2024-05-07T11:17:30.406178+0000","last_active":"2024-05-07T11:17:30.406178+0000","last_peered":"2024-05-07T11:17:30.406178+0000","last_clean":"2024-05-07T11:17:30.406178+0000","last_became_active":"2024-05-07T11:17:30.405536+0000","last_became_peered":"2024-05-07T11:17:30.405536+0000","last_unstale":"2024-05-07T11:17:30.406178+0000","last_undegraded":"2024-05-07T11:17:30.406178+0000","last_fullsized":"2024-05-07T11:17:30.406178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:47.059204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":529421,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"63'166","reported_seq":269,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403641+0000","last_change":"2024-05-07T11:17:22.418934+0000","last_active":"2024-05-07T11:17:30.403641+0000","last_peered":"2024-05-07T11:17:30.403641+0000","last_clean":"2024-05-07T11:17:30.403641+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:30.403641+0000","last_undegraded":"2024-05-07T11:17:30.403641+0000","last_fullsized":"2024-05-07T11:17:30.403641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:05.143462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403262+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:30.403262+0000","last_peered":"2024-05-07T11:17:30.403262+0000","last_clean":"2024-05-07T11:17:30.403262+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:30.403262+0000","last_undegraded":"2024-05-07T11:17:30.403262+0000","last_fullsized":"2024-05-07T11:17:30.403262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:04.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403549+0000","last_change":"2024-05-07T11:17:27.409473+0000","last_active":"2024-05-07T11:17:30.403549+0000","last_peered":"2024-05-07T11:17:30.403549+0000","last_clean":"2024-05-07T11:17:30.403549+0000","last_became_active":"2024-05-07T11:17:27.408650+0000","last_became_peered":"2024-05-07T11:17:27.408650+0000","last_unstale":"2024-05-07T11:17:30.403549+0000","last_undegraded":"2024-05-07T11:17:30.403549+0000","last_fullsized":"2024-05-07T11:17:30.403549+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:11:56.118436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":631133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"63'156","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794731+0000","last_change":"2024-05-07T11:17:22.416801+0000","last_active":"2024-05-07T11:17:30.794731+0000","last_peered":"2024-05-07T11:17:30.794731+0000","last_clean":"2024-05-07T11:17:30.794731+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:30.794731+0000","last_undegraded":"2024-05-07T11:17:30.794731+0000","last_fullsized":"2024-05-07T11:17:30.794731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:07.028486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'154","reported_seq":450,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404098+0000","last_change":"2024-05-07T11:17:22.419089+0000","last_active":"2024-05-07T11:17:30.404098+0000","last_peered":"2024-05-07T11:17:30.404098+0000","last_clean":"2024-05-07T11:17:30.404098+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:30.404098+0000","last_undegraded":"2024-05-07T11:17:30.404098+0000","last_fullsized":"2024-05-07T11:17:30.404098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:57.833385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":280,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796121+0000","last_change":"2024-05-07T11:17:28.404789+0000","last_active":"2024-05-07T11:17:30.796121+0000","last_peered":"2024-05-07T11:17:30.796121+0000","last_clean":"2024-05-07T11:17:30.796121+0000","last_became_active":"2024-05-07T11:17:28.403770+0000","last_became_peered":"2024-05-07T11:17:28.403770+0000","last_unstale":"2024-05-07T11:17:30.796121+0000","last_undegraded":"2024-05-07T11:17:30.796121+0000","last_fullsized":"2024-05-07T11:17:30.796121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:52.521740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":89602,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'136","reported_seq":291,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795785+0000","last_change":"2024-05-07T11:17:23.398879+0000","last_active":"2024-05-07T11:17:30.795785+0000","last_peered":"2024-05-07T11:17:30.795785+0000","last_clean":"2024-05-07T11:17:30.795785+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:30.795785+0000","last_undegraded":"2024-05-07T11:17:30.795785+0000","last_fullsized":"2024-05-07T11:17:30.795785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:33:07.091905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'175","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403781+0000","last_change":"2024-05-07T11:17:26.407920+0000","last_active":"2024-05-07T11:17:30.403781+0000","last_peered":"2024-05-07T11:17:30.403781+0000","last_clean":"2024-05-07T11:17:30.403781+0000","last_became_active":"2024-05-07T11:17:26.407342+0000","last_became_peered":"2024-05-07T11:17:26.407342+0000","last_unstale":"2024-05-07T11:17:30.403781+0000","last_undegraded":"2024-05-07T11:17:30.403781+0000","last_fullsized":"2024-05-07T11:17:30.403781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:55:22.847728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":196945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":531,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403816+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:30.403816+0000","last_peered":"2024-05-07T11:17:30.403816+0000","last_clean":"2024-05-07T11:17:30.403816+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:30.403816+0000","last_undegraded":"2024-05-07T11:17:30.403816+0000","last_fullsized":"2024-05-07T11:17:30.403816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:30:48.688430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":501,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.406594+0000","last_change":"2024-05-07T11:17:30.406594+0000","last_active":"2024-05-07T11:17:30.406594+0000","last_peered":"2024-05-07T11:17:30.406594+0000","last_clean":"2024-05-07T11:17:30.406594+0000","last_became_active":"2024-05-07T11:17:30.405896+0000","last_became_peered":"2024-05-07T11:17:30.405896+0000","last_unstale":"2024-05-07T11:17:30.406594+0000","last_undegraded":"2024-05-07T11:17:30.406594+0000","last_fullsized":"2024-05-07T11:17:30.406594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:53:51.552775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4343464,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'161","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404106+0000","last_change":"2024-05-07T11:17:22.416613+0000","last_active":"2024-05-07T11:17:30.404106+0000","last_peered":"2024-05-07T11:17:30.404106+0000","last_clean":"2024-05-07T11:17:30.404106+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:30.404106+0000","last_undegraded":"2024-05-07T11:17:30.404106+0000","last_fullsized":"2024-05-07T11:17:30.404106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"63'148","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796047+0000","last_change":"2024-05-07T11:17:21.418472+0000","last_active":"2024-05-07T11:17:30.796047+0000","last_peered":"2024-05-07T11:17:30.796047+0000","last_clean":"2024-05-07T11:17:30.796047+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:30.796047+0000","last_undegraded":"2024-05-07T11:17:30.796047+0000","last_fullsized":"2024-05-07T11:17:30.796047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:18.184681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'147","reported_seq":237,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403595+0000","last_change":"2024-05-07T11:17:21.418164+0000","last_active":"2024-05-07T11:17:30.403595+0000","last_peered":"2024-05-07T11:17:30.403595+0000","last_clean":"2024-05-07T11:17:30.403595+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:30.403595+0000","last_undegraded":"2024-05-07T11:17:30.403595+0000","last_fullsized":"2024-05-07T11:17:30.403595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":573,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404075+0000","last_change":"2024-05-07T11:17:29.407762+0000","last_active":"2024-05-07T11:17:30.404075+0000","last_peered":"2024-05-07T11:17:30.404075+0000","last_clean":"2024-05-07T11:17:30.404075+0000","last_became_active":"2024-05-07T11:17:29.407032+0000","last_became_peered":"2024-05-07T11:17:29.407032+0000","last_unstale":"2024-05-07T11:17:30.404075+0000","last_undegraded":"2024-05-07T11:17:30.404075+0000","last_fullsized":"2024-05-07T11:17:30.404075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:55:10.099065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":98139,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":305,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403794+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:30.403794+0000","last_peered":"2024-05-07T11:17:30.403794+0000","last_clean":"2024-05-07T11:17:30.403794+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:30.403794+0000","last_undegraded":"2024-05-07T11:17:30.403794+0000","last_fullsized":"2024-05-07T11:17:30.403794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795900+0000","last_change":"2024-05-07T11:17:29.408512+0000","last_active":"2024-05-07T11:17:30.795900+0000","last_peered":"2024-05-07T11:17:30.795900+0000","last_clean":"2024-05-07T11:17:30.795900+0000","last_became_active":"2024-05-07T11:17:29.407294+0000","last_became_peered":"2024-05-07T11:17:29.407294+0000","last_unstale":"2024-05-07T11:17:30.795900+0000","last_undegraded":"2024-05-07T11:17:30.795900+0000","last_fullsized":"2024-05-07T11:17:30.795900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:30:15.441943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":116557,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'159","reported_seq":247,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402842+0000","last_change":"2024-05-07T11:17:21.418519+0000","last_active":"2024-05-07T11:17:30.402842+0000","last_peered":"2024-05-07T11:17:30.402842+0000","last_clean":"2024-05-07T11:17:30.402842+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:30.402842+0000","last_undegraded":"2024-05-07T11:17:30.402842+0000","last_fullsized":"2024-05-07T11:17:30.402842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"63'169","reported_seq":323,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795399+0000","last_change":"2024-05-07T11:17:21.414896+0000","last_active":"2024-05-07T11:17:30.795399+0000","last_peered":"2024-05-07T11:17:30.795399+0000","last_clean":"2024-05-07T11:17:30.795399+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:30.795399+0000","last_undegraded":"2024-05-07T11:17:30.795399+0000","last_fullsized":"2024-05-07T11:17:30.795399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:52.242314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796018+0000","last_change":"2024-05-07T11:17:24.407028+0000","last_active":"2024-05-07T11:17:30.796018+0000","last_peered":"2024-05-07T11:17:30.796018+0000","last_clean":"2024-05-07T11:17:30.796018+0000","last_became_active":"2024-05-07T11:17:24.406307+0000","last_became_peered":"2024-05-07T11:17:24.406307+0000","last_unstale":"2024-05-07T11:17:30.796018+0000","last_undegraded":"2024-05-07T11:17:30.796018+0000","last_fullsized":"2024-05-07T11:17:30.796018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:24.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":230897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'195","reported_seq":345,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403991+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:17:30.403991+0000","last_peered":"2024-05-07T11:17:30.403991+0000","last_clean":"2024-05-07T11:17:30.403991+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:30.403991+0000","last_undegraded":"2024-05-07T11:17:30.403991+0000","last_fullsized":"2024-05-07T11:17:30.403991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404276+0000","last_change":"2024-05-07T11:17:29.416071+0000","last_active":"2024-05-07T11:17:30.404276+0000","last_peered":"2024-05-07T11:17:30.404276+0000","last_clean":"2024-05-07T11:17:30.404276+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:30.404276+0000","last_undegraded":"2024-05-07T11:17:30.404276+0000","last_fullsized":"2024-05-07T11:17:30.404276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:42.494889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":67681,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":287,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796001+0000","last_change":"2024-05-07T11:17:28.404770+0000","last_active":"2024-05-07T11:17:30.796001+0000","last_peered":"2024-05-07T11:17:30.796001+0000","last_clean":"2024-05-07T11:17:30.796001+0000","last_became_active":"2024-05-07T11:17:28.403782+0000","last_became_peered":"2024-05-07T11:17:28.403782+0000","last_unstale":"2024-05-07T11:17:30.796001+0000","last_undegraded":"2024-05-07T11:17:30.796001+0000","last_fullsized":"2024-05-07T11:17:30.796001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:38.547257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":211687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":247,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403283+0000","last_change":"2024-05-07T11:17:24.403807+0000","last_active":"2024-05-07T11:17:30.403283+0000","last_peered":"2024-05-07T11:17:30.403283+0000","last_clean":"2024-05-07T11:17:30.403283+0000","last_became_active":"2024-05-07T11:17:24.403179+0000","last_became_peered":"2024-05-07T11:17:24.403179+0000","last_unstale":"2024-05-07T11:17:30.403283+0000","last_undegraded":"2024-05-07T11:17:30.403283+0000","last_fullsized":"2024-05-07T11:17:30.403283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:15:55.499366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":323,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795763+0000","last_change":"2024-05-07T11:17:29.409488+0000","last_active":"2024-05-07T11:17:30.795763+0000","last_peered":"2024-05-07T11:17:30.795763+0000","last_clean":"2024-05-07T11:17:30.795763+0000","last_became_active":"2024-05-07T11:17:29.408425+0000","last_became_peered":"2024-05-07T11:17:29.408425+0000","last_unstale":"2024-05-07T11:17:30.795763+0000","last_undegraded":"2024-05-07T11:17:30.795763+0000","last_fullsized":"2024-05-07T11:17:30.795763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:34.508418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":86167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'192","reported_seq":586,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402995+0000","last_change":"2024-05-07T11:17:22.416120+0000","last_active":"2024-05-07T11:17:30.402995+0000","last_peered":"2024-05-07T11:17:30.402995+0000","last_clean":"2024-05-07T11:17:30.402995+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:30.402995+0000","last_undegraded":"2024-05-07T11:17:30.402995+0000","last_fullsized":"2024-05-07T11:17:30.402995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:13.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"63'185","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403405+0000","last_change":"2024-05-07T11:17:28.399808+0000","last_active":"2024-05-07T11:17:30.403405+0000","last_peered":"2024-05-07T11:17:30.403405+0000","last_clean":"2024-05-07T11:17:30.403405+0000","last_became_active":"2024-05-07T11:17:28.398801+0000","last_became_peered":"2024-05-07T11:17:28.398801+0000","last_unstale":"2024-05-07T11:17:30.403405+0000","last_undegraded":"2024-05-07T11:17:30.403405+0000","last_fullsized":"2024-05-07T11:17:30.403405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:34.170387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":459999,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'156","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794879+0000","last_change":"2024-05-07T11:17:22.416165+0000","last_active":"2024-05-07T11:17:30.794879+0000","last_peered":"2024-05-07T11:17:30.794879+0000","last_clean":"2024-05-07T11:17:30.794879+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:30.794879+0000","last_undegraded":"2024-05-07T11:17:30.794879+0000","last_fullsized":"2024-05-07T11:17:30.794879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:57.237765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":277,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404046+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:30.404046+0000","last_peered":"2024-05-07T11:17:30.404046+0000","last_clean":"2024-05-07T11:17:30.404046+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:30.404046+0000","last_undegraded":"2024-05-07T11:17:30.404046+0000","last_fullsized":"2024-05-07T11:17:30.404046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"63'141","reported_seq":295,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796184+0000","last_change":"2024-05-07T11:17:21.419206+0000","last_active":"2024-05-07T11:17:30.796184+0000","last_peered":"2024-05-07T11:17:30.796184+0000","last_clean":"2024-05-07T11:17:30.796184+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:30.796184+0000","last_undegraded":"2024-05-07T11:17:30.796184+0000","last_fullsized":"2024-05-07T11:17:30.796184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:12.679336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403297+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:30.403297+0000","last_peered":"2024-05-07T11:17:30.403297+0000","last_clean":"2024-05-07T11:17:30.403297+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:30.403297+0000","last_undegraded":"2024-05-07T11:17:30.403297+0000","last_fullsized":"2024-05-07T11:17:30.403297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.025763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"63'179","reported_seq":267,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403562+0000","last_change":"2024-05-07T11:17:21.419284+0000","last_active":"2024-05-07T11:17:30.403562+0000","last_peered":"2024-05-07T11:17:30.403562+0000","last_clean":"2024-05-07T11:17:30.403562+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:30.403562+0000","last_undegraded":"2024-05-07T11:17:30.403562+0000","last_fullsized":"2024-05-07T11:17:30.403562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:54.463898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795361+0000","last_change":"2024-05-07T11:17:18.423604+0000","last_active":"2024-05-07T11:17:30.795361+0000","last_peered":"2024-05-07T11:17:30.795361+0000","last_clean":"2024-05-07T11:17:30.795361+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:30.795361+0000","last_undegraded":"2024-05-07T11:17:30.795361+0000","last_fullsized":"2024-05-07T11:17:30.795361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:45:28.650148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":244,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403803+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:30.403803+0000","last_peered":"2024-05-07T11:17:30.403803+0000","last_clean":"2024-05-07T11:17:30.403803+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:30.403803+0000","last_undegraded":"2024-05-07T11:17:30.403803+0000","last_fullsized":"2024-05-07T11:17:30.403803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403673+0000","last_change":"2024-05-07T11:17:18.433027+0000","last_active":"2024-05-07T11:17:30.403673+0000","last_peered":"2024-05-07T11:17:30.403673+0000","last_clean":"2024-05-07T11:17:30.403673+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:30.403673+0000","last_undegraded":"2024-05-07T11:17:30.403673+0000","last_fullsized":"2024-05-07T11:17:30.403673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:47.068504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404359+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:30.404359+0000","last_peered":"2024-05-07T11:17:30.404359+0000","last_clean":"2024-05-07T11:17:30.404359+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:30.404359+0000","last_undegraded":"2024-05-07T11:17:30.404359+0000","last_fullsized":"2024-05-07T11:17:30.404359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:35:51.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'155","reported_seq":435,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403110+0000","last_change":"2024-05-07T11:17:27.404484+0000","last_active":"2024-05-07T11:17:30.403110+0000","last_peered":"2024-05-07T11:17:30.403110+0000","last_clean":"2024-05-07T11:17:30.403110+0000","last_became_active":"2024-05-07T11:17:27.403866+0000","last_became_peered":"2024-05-07T11:17:27.403866+0000","last_unstale":"2024-05-07T11:17:30.403110+0000","last_undegraded":"2024-05-07T11:17:30.403110+0000","last_fullsized":"2024-05-07T11:17:30.403110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:15:32.849874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":166862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795883+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:30.795883+0000","last_peered":"2024-05-07T11:17:30.795883+0000","last_clean":"2024-05-07T11:17:30.795883+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:30.795883+0000","last_undegraded":"2024-05-07T11:17:30.795883+0000","last_fullsized":"2024-05-07T11:17:30.795883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:16.479879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'167","reported_seq":321,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795133+0000","last_change":"2024-05-07T11:17:21.418782+0000","last_active":"2024-05-07T11:17:30.795133+0000","last_peered":"2024-05-07T11:17:30.795133+0000","last_clean":"2024-05-07T11:17:30.795133+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:30.795133+0000","last_undegraded":"2024-05-07T11:17:30.795133+0000","last_fullsized":"2024-05-07T11:17:30.795133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:13.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404754+0000","last_change":"2024-05-07T11:17:22.419069+0000","last_active":"2024-05-07T11:17:30.404754+0000","last_peered":"2024-05-07T11:17:30.404754+0000","last_clean":"2024-05-07T11:17:30.404754+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:30.404754+0000","last_undegraded":"2024-05-07T11:17:30.404754+0000","last_fullsized":"2024-05-07T11:17:30.404754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:20.890067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404443+0000","last_change":"2024-05-07T11:17:29.408348+0000","last_active":"2024-05-07T11:17:30.404443+0000","last_peered":"2024-05-07T11:17:30.404443+0000","last_clean":"2024-05-07T11:17:30.404443+0000","last_became_active":"2024-05-07T11:17:29.407677+0000","last_became_peered":"2024-05-07T11:17:29.407677+0000","last_unstale":"2024-05-07T11:17:30.404443+0000","last_undegraded":"2024-05-07T11:17:30.404443+0000","last_fullsized":"2024-05-07T11:17:30.404443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:02.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":83336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404663+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:30.404663+0000","last_peered":"2024-05-07T11:17:30.404663+0000","last_clean":"2024-05-07T11:17:30.404663+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:30.404663+0000","last_undegraded":"2024-05-07T11:17:30.404663+0000","last_fullsized":"2024-05-07T11:17:30.404663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:31:28.580245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"63'164","reported_seq":314,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403552+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:17:30.403552+0000","last_peered":"2024-05-07T11:17:30.403552+0000","last_clean":"2024-05-07T11:17:30.403552+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:30.403552+0000","last_undegraded":"2024-05-07T11:17:30.403552+0000","last_fullsized":"2024-05-07T11:17:30.403552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403688+0000","last_change":"2024-05-07T11:17:18.450923+0000","last_active":"2024-05-07T11:17:30.403688+0000","last_peered":"2024-05-07T11:17:30.403688+0000","last_clean":"2024-05-07T11:17:30.403688+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:30.403688+0000","last_undegraded":"2024-05-07T11:17:30.403688+0000","last_fullsized":"2024-05-07T11:17:30.403688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:38.864461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"63'172","reported_seq":560,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404209+0000","last_change":"2024-05-07T11:17:28.401492+0000","last_active":"2024-05-07T11:17:30.404209+0000","last_peered":"2024-05-07T11:17:30.404209+0000","last_clean":"2024-05-07T11:17:30.404209+0000","last_became_active":"2024-05-07T11:17:28.400673+0000","last_became_peered":"2024-05-07T11:17:28.400673+0000","last_unstale":"2024-05-07T11:17:30.404209+0000","last_undegraded":"2024-05-07T11:17:30.404209+0000","last_fullsized":"2024-05-07T11:17:30.404209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:41.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":127501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404803+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:30.404803+0000","last_peered":"2024-05-07T11:17:30.404803+0000","last_clean":"2024-05-07T11:17:30.404803+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:30.404803+0000","last_undegraded":"2024-05-07T11:17:30.404803+0000","last_fullsized":"2024-05-07T11:17:30.404803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"63'163","reported_seq":519,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404591+0000","last_change":"2024-05-07T11:17:27.405072+0000","last_active":"2024-05-07T11:17:30.404591+0000","last_peered":"2024-05-07T11:17:30.404591+0000","last_clean":"2024-05-07T11:17:30.404591+0000","last_became_active":"2024-05-07T11:17:27.404340+0000","last_became_peered":"2024-05-07T11:17:27.404340+0000","last_unstale":"2024-05-07T11:17:30.404591+0000","last_undegraded":"2024-05-07T11:17:30.404591+0000","last_fullsized":"2024-05-07T11:17:30.404591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:05:12.602038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":119690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795129+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:30.795129+0000","last_peered":"2024-05-07T11:17:30.795129+0000","last_clean":"2024-05-07T11:17:30.795129+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:30.795129+0000","last_undegraded":"2024-05-07T11:17:30.795129+0000","last_fullsized":"2024-05-07T11:17:30.795129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:47.689436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'137","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403862+0000","last_change":"2024-05-07T11:17:24.403787+0000","last_active":"2024-05-07T11:17:30.403862+0000","last_peered":"2024-05-07T11:17:30.403862+0000","last_clean":"2024-05-07T11:17:30.403862+0000","last_became_active":"2024-05-07T11:17:24.403279+0000","last_became_peered":"2024-05-07T11:17:24.403279+0000","last_unstale":"2024-05-07T11:17:30.403862+0000","last_undegraded":"2024-05-07T11:17:30.403862+0000","last_fullsized":"2024-05-07T11:17:30.403862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:42.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":119,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795539+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:30.795539+0000","last_peered":"2024-05-07T11:17:30.795539+0000","last_clean":"2024-05-07T11:17:30.795539+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:30.795539+0000","last_undegraded":"2024-05-07T11:17:30.795539+0000","last_fullsized":"2024-05-07T11:17:30.795539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:59.411938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'141","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403996+0000","last_change":"2024-05-07T11:17:22.417126+0000","last_active":"2024-05-07T11:17:30.403996+0000","last_peered":"2024-05-07T11:17:30.403996+0000","last_clean":"2024-05-07T11:17:30.403996+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:30.403996+0000","last_undegraded":"2024-05-07T11:17:30.403996+0000","last_fullsized":"2024-05-07T11:17:30.403996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":359,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404346+0000","last_change":"2024-05-07T11:17:18.433863+0000","last_active":"2024-05-07T11:17:30.404346+0000","last_peered":"2024-05-07T11:17:30.404346+0000","last_clean":"2024-05-07T11:17:30.404346+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:30.404346+0000","last_undegraded":"2024-05-07T11:17:30.404346+0000","last_fullsized":"2024-05-07T11:17:30.404346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:10.515455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404385+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:30.404385+0000","last_peered":"2024-05-07T11:17:30.404385+0000","last_clean":"2024-05-07T11:17:30.404385+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:30.404385+0000","last_undegraded":"2024-05-07T11:17:30.404385+0000","last_fullsized":"2024-05-07T11:17:30.404385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:03:02.539869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403061+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:30.403061+0000","last_peered":"2024-05-07T11:17:30.403061+0000","last_clean":"2024-05-07T11:17:30.403061+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:30.403061+0000","last_undegraded":"2024-05-07T11:17:30.403061+0000","last_fullsized":"2024-05-07T11:17:30.403061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404654+0000","last_change":"2024-05-07T11:17:29.231999+0000","last_active":"2024-05-07T11:17:30.404654+0000","last_peered":"2024-05-07T11:17:30.404654+0000","last_clean":"2024-05-07T11:17:30.404654+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:30.404654+0000","last_undegraded":"2024-05-07T11:17:30.404654+0000","last_fullsized":"2024-05-07T11:17:30.404654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:37.451106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":138308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404219+0000","last_change":"2024-05-07T11:17:18.433452+0000","last_active":"2024-05-07T11:17:30.404219+0000","last_peered":"2024-05-07T11:17:30.404219+0000","last_clean":"2024-05-07T11:17:30.404219+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:30.404219+0000","last_undegraded":"2024-05-07T11:17:30.404219+0000","last_fullsized":"2024-05-07T11:17:30.404219+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:26.663080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":220,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403281+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:17:30.403281+0000","last_peered":"2024-05-07T11:17:30.403281+0000","last_clean":"2024-05-07T11:17:30.403281+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:30.403281+0000","last_undegraded":"2024-05-07T11:17:30.403281+0000","last_fullsized":"2024-05-07T11:17:30.403281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"63'160","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795913+0000","last_change":"2024-05-07T11:17:24.407000+0000","last_active":"2024-05-07T11:17:30.795913+0000","last_peered":"2024-05-07T11:17:30.795913+0000","last_clean":"2024-05-07T11:17:30.795913+0000","last_became_active":"2024-05-07T11:17:24.406306+0000","last_became_peered":"2024-05-07T11:17:24.406306+0000","last_unstale":"2024-05-07T11:17:30.795913+0000","last_undegraded":"2024-05-07T11:17:30.795913+0000","last_fullsized":"2024-05-07T11:17:30.795913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:56:56.763708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":402414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403560+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:30.403560+0000","last_peered":"2024-05-07T11:17:30.403560+0000","last_clean":"2024-05-07T11:17:30.403560+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:30.403560+0000","last_undegraded":"2024-05-07T11:17:30.403560+0000","last_fullsized":"2024-05-07T11:17:30.403560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:20.744525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795119+0000","last_change":"2024-05-07T11:17:18.572639+0000","last_active":"2024-05-07T11:17:30.795119+0000","last_peered":"2024-05-07T11:17:30.795119+0000","last_clean":"2024-05-07T11:17:30.795119+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:30.795119+0000","last_undegraded":"2024-05-07T11:17:30.795119+0000","last_fullsized":"2024-05-07T11:17:30.795119+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:15.538158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403967+0000","last_change":"2024-05-07T11:17:26.407965+0000","last_active":"2024-05-07T11:17:30.403967+0000","last_peered":"2024-05-07T11:17:30.403967+0000","last_clean":"2024-05-07T11:17:30.403967+0000","last_became_active":"2024-05-07T11:17:26.407203+0000","last_became_peered":"2024-05-07T11:17:26.407203+0000","last_unstale":"2024-05-07T11:17:30.403967+0000","last_undegraded":"2024-05-07T11:17:30.403967+0000","last_fullsized":"2024-05-07T11:17:30.403967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:50.842472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":384377,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404866+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:30.404866+0000","last_peered":"2024-05-07T11:17:30.404866+0000","last_clean":"2024-05-07T11:17:30.404866+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:30.404866+0000","last_undegraded":"2024-05-07T11:17:30.404866+0000","last_fullsized":"2024-05-07T11:17:30.404866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":162,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404316+0000","last_change":"2024-05-07T11:17:18.404539+0000","last_active":"2024-05-07T11:17:30.404316+0000","last_peered":"2024-05-07T11:17:30.404316+0000","last_clean":"2024-05-07T11:17:30.404316+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:30.404316+0000","last_undegraded":"2024-05-07T11:17:30.404316+0000","last_fullsized":"2024-05-07T11:17:30.404316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:50.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":233,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403988+0000","last_change":"2024-05-07T11:17:25.412664+0000","last_active":"2024-05-07T11:17:30.403988+0000","last_peered":"2024-05-07T11:17:30.403988+0000","last_clean":"2024-05-07T11:17:30.403988+0000","last_became_active":"2024-05-07T11:17:25.412026+0000","last_became_peered":"2024-05-07T11:17:25.412026+0000","last_unstale":"2024-05-07T11:17:30.403988+0000","last_undegraded":"2024-05-07T11:17:30.403988+0000","last_fullsized":"2024-05-07T11:17:30.403988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:19:28.465664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":174891,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404777+0000","last_change":"2024-05-07T11:17:22.424750+0000","last_active":"2024-05-07T11:17:30.404777+0000","last_peered":"2024-05-07T11:17:30.404777+0000","last_clean":"2024-05-07T11:17:30.404777+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:30.404777+0000","last_undegraded":"2024-05-07T11:17:30.404777+0000","last_fullsized":"2024-05-07T11:17:30.404777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:12.283160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404113+0000","last_change":"2024-05-07T11:17:18.433137+0000","last_active":"2024-05-07T11:17:30.404113+0000","last_peered":"2024-05-07T11:17:30.404113+0000","last_clean":"2024-05-07T11:17:30.404113+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:30.404113+0000","last_undegraded":"2024-05-07T11:17:30.404113+0000","last_fullsized":"2024-05-07T11:17:30.404113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:40.770823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":296,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795321+0000","last_change":"2024-05-07T11:17:29.408764+0000","last_active":"2024-05-07T11:17:30.795321+0000","last_peered":"2024-05-07T11:17:30.795321+0000","last_clean":"2024-05-07T11:17:30.795321+0000","last_became_active":"2024-05-07T11:17:29.407296+0000","last_became_peered":"2024-05-07T11:17:29.407296+0000","last_unstale":"2024-05-07T11:17:30.795321+0000","last_undegraded":"2024-05-07T11:17:30.795321+0000","last_fullsized":"2024-05-07T11:17:30.795321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:34:42.615088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":74509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403776+0000","last_change":"2024-05-07T11:17:18.431763+0000","last_active":"2024-05-07T11:17:30.403776+0000","last_peered":"2024-05-07T11:17:30.403776+0000","last_clean":"2024-05-07T11:17:30.403776+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:30.403776+0000","last_undegraded":"2024-05-07T11:17:30.403776+0000","last_fullsized":"2024-05-07T11:17:30.403776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:38.234395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":125,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796383+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:30.796383+0000","last_peered":"2024-05-07T11:17:30.796383+0000","last_clean":"2024-05-07T11:17:30.796383+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:30.796383+0000","last_undegraded":"2024-05-07T11:17:30.796383+0000","last_fullsized":"2024-05-07T11:17:30.796383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:54.609817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'181","reported_seq":331,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795311+0000","last_change":"2024-05-07T11:17:23.399296+0000","last_active":"2024-05-07T11:17:30.795311+0000","last_peered":"2024-05-07T11:17:30.795311+0000","last_clean":"2024-05-07T11:17:30.795311+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:30.795311+0000","last_undegraded":"2024-05-07T11:17:30.795311+0000","last_fullsized":"2024-05-07T11:17:30.795311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:21.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":100,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404018+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:30.404018+0000","last_peered":"2024-05-07T11:17:30.404018+0000","last_clean":"2024-05-07T11:17:30.404018+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:30.404018+0000","last_undegraded":"2024-05-07T11:17:30.404018+0000","last_fullsized":"2024-05-07T11:17:30.404018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:03.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403832+0000","last_change":"2024-05-07T11:17:18.432358+0000","last_active":"2024-05-07T11:17:30.403832+0000","last_peered":"2024-05-07T11:17:30.403832+0000","last_clean":"2024-05-07T11:17:30.403832+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:30.403832+0000","last_undegraded":"2024-05-07T11:17:30.403832+0000","last_fullsized":"2024-05-07T11:17:30.403832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:36.281521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"63'175","reported_seq":285,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403129+0000","last_change":"2024-05-07T11:17:22.420080+0000","last_active":"2024-05-07T11:17:30.403129+0000","last_peered":"2024-05-07T11:17:30.403129+0000","last_clean":"2024-05-07T11:17:30.403129+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:30.403129+0000","last_undegraded":"2024-05-07T11:17:30.403129+0000","last_fullsized":"2024-05-07T11:17:30.403129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:41.233935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'38","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403696+0000","last_change":"2024-05-07T11:17:18.459674+0000","last_active":"2024-05-07T11:17:30.403696+0000","last_peered":"2024-05-07T11:17:30.403696+0000","last_clean":"2024-05-07T11:17:30.403696+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:30.403696+0000","last_undegraded":"2024-05-07T11:17:30.403696+0000","last_fullsized":"2024-05-07T11:17:30.403696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:35.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404514+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:30.404514+0000","last_peered":"2024-05-07T11:17:30.404514+0000","last_clean":"2024-05-07T11:17:30.404514+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:30.404514+0000","last_undegraded":"2024-05-07T11:17:30.404514+0000","last_fullsized":"2024-05-07T11:17:30.404514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:14.650941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'138","reported_seq":290,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794688+0000","last_change":"2024-05-07T11:17:22.417629+0000","last_active":"2024-05-07T11:17:30.794688+0000","last_peered":"2024-05-07T11:17:30.794688+0000","last_clean":"2024-05-07T11:17:30.794688+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:30.794688+0000","last_undegraded":"2024-05-07T11:17:30.794688+0000","last_fullsized":"2024-05-07T11:17:30.794688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:58.760049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'164","reported_seq":510,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403556+0000","last_change":"2024-05-07T11:17:23.400613+0000","last_active":"2024-05-07T11:17:30.403556+0000","last_peered":"2024-05-07T11:17:30.403556+0000","last_clean":"2024-05-07T11:17:30.403556+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:30.403556+0000","last_undegraded":"2024-05-07T11:17:30.403556+0000","last_fullsized":"2024-05-07T11:17:30.403556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:28.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":208,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404486+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:30.404486+0000","last_peered":"2024-05-07T11:17:30.404486+0000","last_clean":"2024-05-07T11:17:30.404486+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:30.404486+0000","last_undegraded":"2024-05-07T11:17:30.404486+0000","last_fullsized":"2024-05-07T11:17:30.404486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:35.832524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":228,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403482+0000","last_change":"2024-05-07T11:17:25.413137+0000","last_active":"2024-05-07T11:17:30.403482+0000","last_peered":"2024-05-07T11:17:30.403482+0000","last_clean":"2024-05-07T11:17:30.403482+0000","last_became_active":"2024-05-07T11:17:25.412149+0000","last_became_peered":"2024-05-07T11:17:25.412149+0000","last_unstale":"2024-05-07T11:17:30.403482+0000","last_undegraded":"2024-05-07T11:17:30.403482+0000","last_fullsized":"2024-05-07T11:17:30.403482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:05.259035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795725+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:30.795725+0000","last_peered":"2024-05-07T11:17:30.795725+0000","last_clean":"2024-05-07T11:17:30.795725+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:30.795725+0000","last_undegraded":"2024-05-07T11:17:30.795725+0000","last_fullsized":"2024-05-07T11:17:30.795725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:46.092532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404461+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:30.404461+0000","last_peered":"2024-05-07T11:17:30.404461+0000","last_clean":"2024-05-07T11:17:30.404461+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:30.404461+0000","last_undegraded":"2024-05-07T11:17:30.404461+0000","last_fullsized":"2024-05-07T11:17:30.404461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.076287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"63'172","reported_seq":261,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402830+0000","last_change":"2024-05-07T11:17:21.419673+0000","last_active":"2024-05-07T11:17:30.402830+0000","last_peered":"2024-05-07T11:17:30.402830+0000","last_clean":"2024-05-07T11:17:30.402830+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:30.402830+0000","last_undegraded":"2024-05-07T11:17:30.402830+0000","last_fullsized":"2024-05-07T11:17:30.402830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:01.519110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403713+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:30.403713+0000","last_peered":"2024-05-07T11:17:30.403713+0000","last_clean":"2024-05-07T11:17:30.403713+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:30.403713+0000","last_undegraded":"2024-05-07T11:17:30.403713+0000","last_fullsized":"2024-05-07T11:17:30.403713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:45.698283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":234,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403625+0000","last_change":"2024-05-07T11:17:27.408792+0000","last_active":"2024-05-07T11:17:30.403625+0000","last_peered":"2024-05-07T11:17:30.403625+0000","last_clean":"2024-05-07T11:17:30.403625+0000","last_became_active":"2024-05-07T11:17:27.407792+0000","last_became_peered":"2024-05-07T11:17:27.407792+0000","last_unstale":"2024-05-07T11:17:30.403625+0000","last_undegraded":"2024-05-07T11:17:30.403625+0000","last_fullsized":"2024-05-07T11:17:30.403625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":319,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796036+0000","last_change":"2024-05-07T11:17:26.408077+0000","last_active":"2024-05-07T11:17:30.796036+0000","last_peered":"2024-05-07T11:17:30.796036+0000","last_clean":"2024-05-07T11:17:30.796036+0000","last_became_active":"2024-05-07T11:17:26.407230+0000","last_became_peered":"2024-05-07T11:17:26.407230+0000","last_unstale":"2024-05-07T11:17:30.796036+0000","last_undegraded":"2024-05-07T11:17:30.796036+0000","last_fullsized":"2024-05-07T11:17:30.796036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:29.469789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":91096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402939+0000","last_change":"2024-05-07T11:17:18.431271+0000","last_active":"2024-05-07T11:17:30.402939+0000","last_peered":"2024-05-07T11:17:30.402939+0000","last_clean":"2024-05-07T11:17:30.402939+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:30.402939+0000","last_undegraded":"2024-05-07T11:17:30.402939+0000","last_fullsized":"2024-05-07T11:17:30.402939+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":233,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403514+0000","last_change":"2024-05-07T11:17:25.403221+0000","last_active":"2024-05-07T11:17:30.403514+0000","last_peered":"2024-05-07T11:17:30.403514+0000","last_clean":"2024-05-07T11:17:30.403514+0000","last_became_active":"2024-05-07T11:17:25.402661+0000","last_became_peered":"2024-05-07T11:17:25.402661+0000","last_unstale":"2024-05-07T11:17:30.403514+0000","last_undegraded":"2024-05-07T11:17:30.403514+0000","last_fullsized":"2024-05-07T11:17:30.403514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:07.574111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403047+0000","last_change":"2024-05-07T11:17:18.402834+0000","last_active":"2024-05-07T11:17:30.403047+0000","last_peered":"2024-05-07T11:17:30.403047+0000","last_clean":"2024-05-07T11:17:30.403047+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:30.403047+0000","last_undegraded":"2024-05-07T11:17:30.403047+0000","last_fullsized":"2024-05-07T11:17:30.403047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"63'205","reported_seq":357,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794925+0000","last_change":"2024-05-07T11:17:22.421343+0000","last_active":"2024-05-07T11:17:30.794925+0000","last_peered":"2024-05-07T11:17:30.794925+0000","last_clean":"2024-05-07T11:17:30.794925+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:30.794925+0000","last_undegraded":"2024-05-07T11:17:30.794925+0000","last_fullsized":"2024-05-07T11:17:30.794925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:24.076915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795839+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:30.795839+0000","last_peered":"2024-05-07T11:17:30.795839+0000","last_clean":"2024-05-07T11:17:30.795839+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:30.795839+0000","last_undegraded":"2024-05-07T11:17:30.795839+0000","last_fullsized":"2024-05-07T11:17:30.795839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:53.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'163","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795930+0000","last_change":"2024-05-07T11:17:24.407114+0000","last_active":"2024-05-07T11:17:30.795930+0000","last_peered":"2024-05-07T11:17:30.795930+0000","last_clean":"2024-05-07T11:17:30.795930+0000","last_became_active":"2024-05-07T11:17:24.406337+0000","last_became_peered":"2024-05-07T11:17:24.406337+0000","last_unstale":"2024-05-07T11:17:30.795930+0000","last_undegraded":"2024-05-07T11:17:30.795930+0000","last_fullsized":"2024-05-07T11:17:30.795930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:28:35.002816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":280772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795500+0000","last_change":"2024-05-07T11:17:18.555160+0000","last_active":"2024-05-07T11:17:30.795500+0000","last_peered":"2024-05-07T11:17:30.795500+0000","last_clean":"2024-05-07T11:17:30.795500+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:30.795500+0000","last_undegraded":"2024-05-07T11:17:30.795500+0000","last_fullsized":"2024-05-07T11:17:30.795500+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:37.962741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'166","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403479+0000","last_change":"2024-05-07T11:17:21.418540+0000","last_active":"2024-05-07T11:17:30.403479+0000","last_peered":"2024-05-07T11:17:30.403479+0000","last_clean":"2024-05-07T11:17:30.403479+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:30.403479+0000","last_undegraded":"2024-05-07T11:17:30.403479+0000","last_fullsized":"2024-05-07T11:17:30.403479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:16.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":171,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404368+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:30.404368+0000","last_peered":"2024-05-07T11:17:30.404368+0000","last_clean":"2024-05-07T11:17:30.404368+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:30.404368+0000","last_undegraded":"2024-05-07T11:17:30.404368+0000","last_fullsized":"2024-05-07T11:17:30.404368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:17.953399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.407286+0000","last_change":"2024-05-07T11:17:30.407286+0000","last_active":"2024-05-07T11:17:30.407286+0000","last_peered":"2024-05-07T11:17:30.407286+0000","last_clean":"2024-05-07T11:17:30.407286+0000","last_became_active":"2024-05-07T11:17:30.406353+0000","last_became_peered":"2024-05-07T11:17:30.406353+0000","last_unstale":"2024-05-07T11:17:30.407286+0000","last_undegraded":"2024-05-07T11:17:30.407286+0000","last_fullsized":"2024-05-07T11:17:30.407286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:51.684426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":124612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795798+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:30.795798+0000","last_peered":"2024-05-07T11:17:30.795798+0000","last_clean":"2024-05-07T11:17:30.795798+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:30.795798+0000","last_undegraded":"2024-05-07T11:17:30.795798+0000","last_fullsized":"2024-05-07T11:17:30.795798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:24.011380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'169","reported_seq":321,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794835+0000","last_change":"2024-05-07T11:17:22.416150+0000","last_active":"2024-05-07T11:17:30.794835+0000","last_peered":"2024-05-07T11:17:30.794835+0000","last_clean":"2024-05-07T11:17:30.794835+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:30.794835+0000","last_undegraded":"2024-05-07T11:17:30.794835+0000","last_fullsized":"2024-05-07T11:17:30.794835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:28.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403986+0000","last_change":"2024-05-07T11:17:18.504321+0000","last_active":"2024-05-07T11:17:30.403986+0000","last_peered":"2024-05-07T11:17:30.403986+0000","last_clean":"2024-05-07T11:17:30.403986+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:30.403986+0000","last_undegraded":"2024-05-07T11:17:30.403986+0000","last_fullsized":"2024-05-07T11:17:30.403986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"63'199","reported_seq":614,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403820+0000","last_change":"2024-05-07T11:17:25.402468+0000","last_active":"2024-05-07T11:17:30.403820+0000","last_peered":"2024-05-07T11:17:30.403820+0000","last_clean":"2024-05-07T11:17:30.403820+0000","last_became_active":"2024-05-07T11:17:25.401850+0000","last_became_peered":"2024-05-07T11:17:25.401850+0000","last_unstale":"2024-05-07T11:17:30.403820+0000","last_undegraded":"2024-05-07T11:17:30.403820+0000","last_fullsized":"2024-05-07T11:17:30.403820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:19.494294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403872+0000","last_change":"2024-05-07T11:17:18.429950+0000","last_active":"2024-05-07T11:17:30.403872+0000","last_peered":"2024-05-07T11:17:30.403872+0000","last_clean":"2024-05-07T11:17:30.403872+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:30.403872+0000","last_undegraded":"2024-05-07T11:17:30.403872+0000","last_fullsized":"2024-05-07T11:17:30.403872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5805,"num_bytes_recovered":19428989,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64405504,"data_stored":53099596,"data_compressed":4611280,"data_compressed_allocated":5402624,"data_compressed_original":14118912,"omap_allocated":0,"internal_metadata":0},"log_size":10416,"ondisk_log_size":10416,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":428,"ondisk_log_size":428,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84172,"kb_used_data":30776,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94287668,"statfs":{"total":96636764160,"available":96550572032,"internally_reserved":0,"allocated":31514624,"data_stored":54276063,"data_compressed":6326260,"data_compressed_allocated":7593984,"data_compressed_original":37191680,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710725,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":23060,"kb_used_omap":10,"kb_used_meta":35893,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":23613440,"data_stored":43695842,"data_compressed":5536379,"data_compressed_allocated":6516736,"data_compressed_original":33533952,"omap_allocated":10404,"internal_metadata":36755292},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66612,"kb_used_data":27108,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305228,"statfs":{"total":96636764160,"available":96568553472,"internally_reserved":0,"allocated":27758592,"data_stored":40411961,"data_compressed":4972494,"data_compressed_allocated":5840896,"data_compressed_original":25952256,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22953984,"data_stored":19509974,"data_compressed":1953035,"data_compressed_allocated":2265088,"data_compressed_original":5890048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17506304,"data_stored":13389680,"data_compressed":1088810,"data_compressed_allocated":1314816,"data_compressed_original":3727360,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23945216,"data_stored":20199942,"data_compressed":1569435,"data_compressed_allocated":1822720,"data_compressed_original":4501504,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:36.230 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:17:36.567 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:36.567 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":83,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:17:30.393939+0000","last_up_change":"2024-05-07T11:17:18.238867+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":52,"up_from":70,"up_thru":81,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6801","nonce":1252745844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6803","nonce":1252745844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6807","nonce":1252745844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6805","nonce":1252745844}]},"public_addr":"172.21.15.149:6801/1252745844","cluster_addr":"172.21.15.149:6803/1252745844","heartbeat_back_addr":"172.21.15.149:6807/1252745844","heartbeat_front_addr":"172.21.15.149:6805/1252745844","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.7","osds":[2,1]},{"pgid":"4.0","osds":[2,0]},{"pgid":"4.8","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:17:37.581 INFO:tasks.ceph:Scrubbing osd.0 2024-05-07T11:17:37.581 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-07T11:17:37.723 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:17:37.723 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T11:17:37.723 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:17:37.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-07T11:17:38.033 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 0 to deep-scrub 2024-05-07T11:17:38.046 INFO:tasks.ceph:Scrubbing osd.1 2024-05-07T11:17:38.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-07T11:17:38.176 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:17:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-05-07T11:17:38.177 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:17:38.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-07T11:17:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 1 to deep-scrub 2024-05-07T11:17:38.502 INFO:tasks.ceph:Scrubbing osd.2 2024-05-07T11:17:38.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-07T11:17:38.632 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-07T11:17:38.632 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T11:17:38.632 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-07T11:17:38.644 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-07T11:17:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 2 to deep-scrub 2024-05-07T11:17:38.955 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:39.261 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:39.263 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:39.273 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-05-07T11:17:39.015678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5827,"num_bytes_recovered":56847285,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11001,"ondisk_log_size":11001,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":209764,"kb_used_data":80944,"kb_used_omap":13,"kb_used_meta":128754,"kb_avail":282905756,"statfs":{"total":289910292480,"available":289695494144,"internally_reserved":0,"allocated":82886656,"data_stored":138383866,"data_compressed":16835133,"data_compressed_allocated":19951616,"data_compressed_original":96677888,"omap_allocated":13594,"internal_metadata":131844838},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1076,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1230,"num_bytes_recovered":5842334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.618239"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":310,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796409+0000","last_change":"2024-05-07T11:17:27.408581+0000","last_active":"2024-05-07T11:17:30.796409+0000","last_peered":"2024-05-07T11:17:30.796409+0000","last_clean":"2024-05-07T11:17:30.796409+0000","last_became_active":"2024-05-07T11:17:27.407668+0000","last_became_peered":"2024-05-07T11:17:27.407668+0000","last_unstale":"2024-05-07T11:17:30.796409+0000","last_undegraded":"2024-05-07T11:17:30.796409+0000","last_fullsized":"2024-05-07T11:17:30.796409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:48:35.134503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":85925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'155","reported_seq":309,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796170+0000","last_change":"2024-05-07T11:17:21.419253+0000","last_active":"2024-05-07T11:17:30.796170+0000","last_peered":"2024-05-07T11:17:30.796170+0000","last_clean":"2024-05-07T11:17:30.796170+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:30.796170+0000","last_undegraded":"2024-05-07T11:17:30.796170+0000","last_fullsized":"2024-05-07T11:17:30.796170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:45:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'169","reported_seq":517,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403992+0000","last_change":"2024-05-07T11:17:26.408003+0000","last_active":"2024-05-07T11:17:30.403992+0000","last_peered":"2024-05-07T11:17:30.403992+0000","last_clean":"2024-05-07T11:17:30.403992+0000","last_became_active":"2024-05-07T11:17:26.407269+0000","last_became_peered":"2024-05-07T11:17:26.407269+0000","last_unstale":"2024-05-07T11:17:30.403992+0000","last_undegraded":"2024-05-07T11:17:30.403992+0000","last_fullsized":"2024-05-07T11:17:30.403992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:01.664780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":75254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":274,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403937+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:30.403937+0000","last_peered":"2024-05-07T11:17:30.403937+0000","last_clean":"2024-05-07T11:17:30.403937+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:30.403937+0000","last_undegraded":"2024-05-07T11:17:30.403937+0000","last_fullsized":"2024-05-07T11:17:30.403937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:57.104136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"63'186","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795678+0000","last_change":"2024-05-07T11:17:21.419034+0000","last_active":"2024-05-07T11:17:30.795678+0000","last_peered":"2024-05-07T11:17:30.795678+0000","last_clean":"2024-05-07T11:17:30.795678+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:30.795678+0000","last_undegraded":"2024-05-07T11:17:30.795678+0000","last_fullsized":"2024-05-07T11:17:30.795678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:42.536445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":488,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.406178+0000","last_change":"2024-05-07T11:17:30.406178+0000","last_active":"2024-05-07T11:17:30.406178+0000","last_peered":"2024-05-07T11:17:30.406178+0000","last_clean":"2024-05-07T11:17:30.406178+0000","last_became_active":"2024-05-07T11:17:30.405536+0000","last_became_peered":"2024-05-07T11:17:30.405536+0000","last_unstale":"2024-05-07T11:17:30.406178+0000","last_undegraded":"2024-05-07T11:17:30.406178+0000","last_fullsized":"2024-05-07T11:17:30.406178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:47.059204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":529421,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"63'166","reported_seq":269,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403641+0000","last_change":"2024-05-07T11:17:22.418934+0000","last_active":"2024-05-07T11:17:30.403641+0000","last_peered":"2024-05-07T11:17:30.403641+0000","last_clean":"2024-05-07T11:17:30.403641+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:30.403641+0000","last_undegraded":"2024-05-07T11:17:30.403641+0000","last_fullsized":"2024-05-07T11:17:30.403641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:05.143462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403262+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:30.403262+0000","last_peered":"2024-05-07T11:17:30.403262+0000","last_clean":"2024-05-07T11:17:30.403262+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:30.403262+0000","last_undegraded":"2024-05-07T11:17:30.403262+0000","last_fullsized":"2024-05-07T11:17:30.403262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:04.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403549+0000","last_change":"2024-05-07T11:17:27.409473+0000","last_active":"2024-05-07T11:17:30.403549+0000","last_peered":"2024-05-07T11:17:30.403549+0000","last_clean":"2024-05-07T11:17:30.403549+0000","last_became_active":"2024-05-07T11:17:27.408650+0000","last_became_peered":"2024-05-07T11:17:27.408650+0000","last_unstale":"2024-05-07T11:17:30.403549+0000","last_undegraded":"2024-05-07T11:17:30.403549+0000","last_fullsized":"2024-05-07T11:17:30.403549+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:11:56.118436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":631133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"63'156","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794731+0000","last_change":"2024-05-07T11:17:22.416801+0000","last_active":"2024-05-07T11:17:30.794731+0000","last_peered":"2024-05-07T11:17:30.794731+0000","last_clean":"2024-05-07T11:17:30.794731+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:30.794731+0000","last_undegraded":"2024-05-07T11:17:30.794731+0000","last_fullsized":"2024-05-07T11:17:30.794731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:07.028486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'154","reported_seq":451,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404178+0000","last_change":"2024-05-07T11:17:22.419089+0000","last_active":"2024-05-07T11:17:30.404178+0000","last_peered":"2024-05-07T11:17:30.404178+0000","last_clean":"2024-05-07T11:17:30.404178+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:30.404178+0000","last_undegraded":"2024-05-07T11:17:30.404178+0000","last_fullsized":"2024-05-07T11:17:30.404178+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:57.833385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":280,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796121+0000","last_change":"2024-05-07T11:17:28.404789+0000","last_active":"2024-05-07T11:17:30.796121+0000","last_peered":"2024-05-07T11:17:30.796121+0000","last_clean":"2024-05-07T11:17:30.796121+0000","last_became_active":"2024-05-07T11:17:28.403770+0000","last_became_peered":"2024-05-07T11:17:28.403770+0000","last_unstale":"2024-05-07T11:17:30.796121+0000","last_undegraded":"2024-05-07T11:17:30.796121+0000","last_fullsized":"2024-05-07T11:17:30.796121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:52.521740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":89602,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'136","reported_seq":291,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795785+0000","last_change":"2024-05-07T11:17:23.398879+0000","last_active":"2024-05-07T11:17:30.795785+0000","last_peered":"2024-05-07T11:17:30.795785+0000","last_clean":"2024-05-07T11:17:30.795785+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:30.795785+0000","last_undegraded":"2024-05-07T11:17:30.795785+0000","last_fullsized":"2024-05-07T11:17:30.795785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:33:07.091905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'175","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403781+0000","last_change":"2024-05-07T11:17:26.407920+0000","last_active":"2024-05-07T11:17:30.403781+0000","last_peered":"2024-05-07T11:17:30.403781+0000","last_clean":"2024-05-07T11:17:30.403781+0000","last_became_active":"2024-05-07T11:17:26.407342+0000","last_became_peered":"2024-05-07T11:17:26.407342+0000","last_unstale":"2024-05-07T11:17:30.403781+0000","last_undegraded":"2024-05-07T11:17:30.403781+0000","last_fullsized":"2024-05-07T11:17:30.403781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:55:22.847728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":196945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":531,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403816+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:30.403816+0000","last_peered":"2024-05-07T11:17:30.403816+0000","last_clean":"2024-05-07T11:17:30.403816+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:30.403816+0000","last_undegraded":"2024-05-07T11:17:30.403816+0000","last_fullsized":"2024-05-07T11:17:30.403816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:30:48.688430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":501,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.406594+0000","last_change":"2024-05-07T11:17:30.406594+0000","last_active":"2024-05-07T11:17:30.406594+0000","last_peered":"2024-05-07T11:17:30.406594+0000","last_clean":"2024-05-07T11:17:30.406594+0000","last_became_active":"2024-05-07T11:17:30.405896+0000","last_became_peered":"2024-05-07T11:17:30.405896+0000","last_unstale":"2024-05-07T11:17:30.406594+0000","last_undegraded":"2024-05-07T11:17:30.406594+0000","last_fullsized":"2024-05-07T11:17:30.406594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:53:51.552775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4343464,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'161","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404106+0000","last_change":"2024-05-07T11:17:22.416613+0000","last_active":"2024-05-07T11:17:30.404106+0000","last_peered":"2024-05-07T11:17:30.404106+0000","last_clean":"2024-05-07T11:17:30.404106+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:30.404106+0000","last_undegraded":"2024-05-07T11:17:30.404106+0000","last_fullsized":"2024-05-07T11:17:30.404106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:12.500964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"63'148","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796047+0000","last_change":"2024-05-07T11:17:21.418472+0000","last_active":"2024-05-07T11:17:30.796047+0000","last_peered":"2024-05-07T11:17:30.796047+0000","last_clean":"2024-05-07T11:17:30.796047+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:30.796047+0000","last_undegraded":"2024-05-07T11:17:30.796047+0000","last_fullsized":"2024-05-07T11:17:30.796047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:18.184681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'147","reported_seq":237,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403595+0000","last_change":"2024-05-07T11:17:21.418164+0000","last_active":"2024-05-07T11:17:30.403595+0000","last_peered":"2024-05-07T11:17:30.403595+0000","last_clean":"2024-05-07T11:17:30.403595+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:30.403595+0000","last_undegraded":"2024-05-07T11:17:30.403595+0000","last_fullsized":"2024-05-07T11:17:30.403595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:08.489998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":573,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404075+0000","last_change":"2024-05-07T11:17:29.407762+0000","last_active":"2024-05-07T11:17:30.404075+0000","last_peered":"2024-05-07T11:17:30.404075+0000","last_clean":"2024-05-07T11:17:30.404075+0000","last_became_active":"2024-05-07T11:17:29.407032+0000","last_became_peered":"2024-05-07T11:17:29.407032+0000","last_unstale":"2024-05-07T11:17:30.404075+0000","last_undegraded":"2024-05-07T11:17:30.404075+0000","last_fullsized":"2024-05-07T11:17:30.404075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:55:10.099065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":98139,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":305,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403794+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:30.403794+0000","last_peered":"2024-05-07T11:17:30.403794+0000","last_clean":"2024-05-07T11:17:30.403794+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:30.403794+0000","last_undegraded":"2024-05-07T11:17:30.403794+0000","last_fullsized":"2024-05-07T11:17:30.403794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:45:22.142415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795900+0000","last_change":"2024-05-07T11:17:29.408512+0000","last_active":"2024-05-07T11:17:30.795900+0000","last_peered":"2024-05-07T11:17:30.795900+0000","last_clean":"2024-05-07T11:17:30.795900+0000","last_became_active":"2024-05-07T11:17:29.407294+0000","last_became_peered":"2024-05-07T11:17:29.407294+0000","last_unstale":"2024-05-07T11:17:30.795900+0000","last_undegraded":"2024-05-07T11:17:30.795900+0000","last_fullsized":"2024-05-07T11:17:30.795900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:30:15.441943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":116557,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'159","reported_seq":247,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402842+0000","last_change":"2024-05-07T11:17:21.418519+0000","last_active":"2024-05-07T11:17:30.402842+0000","last_peered":"2024-05-07T11:17:30.402842+0000","last_clean":"2024-05-07T11:17:30.402842+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:30.402842+0000","last_undegraded":"2024-05-07T11:17:30.402842+0000","last_fullsized":"2024-05-07T11:17:30.402842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:37.497972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"63'169","reported_seq":323,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795399+0000","last_change":"2024-05-07T11:17:21.414896+0000","last_active":"2024-05-07T11:17:30.795399+0000","last_peered":"2024-05-07T11:17:30.795399+0000","last_clean":"2024-05-07T11:17:30.795399+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:30.795399+0000","last_undegraded":"2024-05-07T11:17:30.795399+0000","last_fullsized":"2024-05-07T11:17:30.795399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:52.242314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796018+0000","last_change":"2024-05-07T11:17:24.407028+0000","last_active":"2024-05-07T11:17:30.796018+0000","last_peered":"2024-05-07T11:17:30.796018+0000","last_clean":"2024-05-07T11:17:30.796018+0000","last_became_active":"2024-05-07T11:17:24.406307+0000","last_became_peered":"2024-05-07T11:17:24.406307+0000","last_unstale":"2024-05-07T11:17:30.796018+0000","last_undegraded":"2024-05-07T11:17:30.796018+0000","last_fullsized":"2024-05-07T11:17:30.796018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:24.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":230897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'195","reported_seq":345,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403991+0000","last_change":"2024-05-07T11:12:44.050078+0000","last_active":"2024-05-07T11:17:30.403991+0000","last_peered":"2024-05-07T11:17:30.403991+0000","last_clean":"2024-05-07T11:17:30.403991+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:30.403991+0000","last_undegraded":"2024-05-07T11:17:30.403991+0000","last_fullsized":"2024-05-07T11:17:30.403991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:21.704247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404276+0000","last_change":"2024-05-07T11:17:29.416071+0000","last_active":"2024-05-07T11:17:30.404276+0000","last_peered":"2024-05-07T11:17:30.404276+0000","last_clean":"2024-05-07T11:17:30.404276+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:30.404276+0000","last_undegraded":"2024-05-07T11:17:30.404276+0000","last_fullsized":"2024-05-07T11:17:30.404276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:42.494889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":67681,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":287,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796001+0000","last_change":"2024-05-07T11:17:28.404770+0000","last_active":"2024-05-07T11:17:30.796001+0000","last_peered":"2024-05-07T11:17:30.796001+0000","last_clean":"2024-05-07T11:17:30.796001+0000","last_became_active":"2024-05-07T11:17:28.403782+0000","last_became_peered":"2024-05-07T11:17:28.403782+0000","last_unstale":"2024-05-07T11:17:30.796001+0000","last_undegraded":"2024-05-07T11:17:30.796001+0000","last_fullsized":"2024-05-07T11:17:30.796001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:38.547257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":211687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":247,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403283+0000","last_change":"2024-05-07T11:17:24.403807+0000","last_active":"2024-05-07T11:17:30.403283+0000","last_peered":"2024-05-07T11:17:30.403283+0000","last_clean":"2024-05-07T11:17:30.403283+0000","last_became_active":"2024-05-07T11:17:24.403179+0000","last_became_peered":"2024-05-07T11:17:24.403179+0000","last_unstale":"2024-05-07T11:17:30.403283+0000","last_undegraded":"2024-05-07T11:17:30.403283+0000","last_fullsized":"2024-05-07T11:17:30.403283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:15:55.499366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":323,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795763+0000","last_change":"2024-05-07T11:17:29.409488+0000","last_active":"2024-05-07T11:17:30.795763+0000","last_peered":"2024-05-07T11:17:30.795763+0000","last_clean":"2024-05-07T11:17:30.795763+0000","last_became_active":"2024-05-07T11:17:29.408425+0000","last_became_peered":"2024-05-07T11:17:29.408425+0000","last_unstale":"2024-05-07T11:17:30.795763+0000","last_undegraded":"2024-05-07T11:17:30.795763+0000","last_fullsized":"2024-05-07T11:17:30.795763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:34.508418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":86167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'192","reported_seq":586,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402995+0000","last_change":"2024-05-07T11:17:22.416120+0000","last_active":"2024-05-07T11:17:30.402995+0000","last_peered":"2024-05-07T11:17:30.402995+0000","last_clean":"2024-05-07T11:17:30.402995+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:30.402995+0000","last_undegraded":"2024-05-07T11:17:30.402995+0000","last_fullsized":"2024-05-07T11:17:30.402995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:13.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"63'185","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403405+0000","last_change":"2024-05-07T11:17:28.399808+0000","last_active":"2024-05-07T11:17:30.403405+0000","last_peered":"2024-05-07T11:17:30.403405+0000","last_clean":"2024-05-07T11:17:30.403405+0000","last_became_active":"2024-05-07T11:17:28.398801+0000","last_became_peered":"2024-05-07T11:17:28.398801+0000","last_unstale":"2024-05-07T11:17:30.403405+0000","last_undegraded":"2024-05-07T11:17:30.403405+0000","last_fullsized":"2024-05-07T11:17:30.403405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:48:34.170387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":459999,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'156","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794879+0000","last_change":"2024-05-07T11:17:22.416165+0000","last_active":"2024-05-07T11:17:30.794879+0000","last_peered":"2024-05-07T11:17:30.794879+0000","last_clean":"2024-05-07T11:17:30.794879+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:30.794879+0000","last_undegraded":"2024-05-07T11:17:30.794879+0000","last_fullsized":"2024-05-07T11:17:30.794879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:01:57.237765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":277,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404046+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:30.404046+0000","last_peered":"2024-05-07T11:17:30.404046+0000","last_clean":"2024-05-07T11:17:30.404046+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:30.404046+0000","last_undegraded":"2024-05-07T11:17:30.404046+0000","last_fullsized":"2024-05-07T11:17:30.404046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:31:17.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"63'141","reported_seq":295,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796184+0000","last_change":"2024-05-07T11:17:21.419206+0000","last_active":"2024-05-07T11:17:30.796184+0000","last_peered":"2024-05-07T11:17:30.796184+0000","last_clean":"2024-05-07T11:17:30.796184+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:30.796184+0000","last_undegraded":"2024-05-07T11:17:30.796184+0000","last_fullsized":"2024-05-07T11:17:30.796184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:12.679336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403297+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:30.403297+0000","last_peered":"2024-05-07T11:17:30.403297+0000","last_clean":"2024-05-07T11:17:30.403297+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:30.403297+0000","last_undegraded":"2024-05-07T11:17:30.403297+0000","last_fullsized":"2024-05-07T11:17:30.403297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.025763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"63'179","reported_seq":267,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403562+0000","last_change":"2024-05-07T11:17:21.419284+0000","last_active":"2024-05-07T11:17:30.403562+0000","last_peered":"2024-05-07T11:17:30.403562+0000","last_clean":"2024-05-07T11:17:30.403562+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:30.403562+0000","last_undegraded":"2024-05-07T11:17:30.403562+0000","last_fullsized":"2024-05-07T11:17:30.403562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:57:54.463898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795361+0000","last_change":"2024-05-07T11:17:18.423604+0000","last_active":"2024-05-07T11:17:30.795361+0000","last_peered":"2024-05-07T11:17:30.795361+0000","last_clean":"2024-05-07T11:17:30.795361+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:30.795361+0000","last_undegraded":"2024-05-07T11:17:30.795361+0000","last_fullsized":"2024-05-07T11:17:30.795361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:45:28.650148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":244,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403803+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:30.403803+0000","last_peered":"2024-05-07T11:17:30.403803+0000","last_clean":"2024-05-07T11:17:30.403803+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:30.403803+0000","last_undegraded":"2024-05-07T11:17:30.403803+0000","last_fullsized":"2024-05-07T11:17:30.403803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403673+0000","last_change":"2024-05-07T11:17:18.433027+0000","last_active":"2024-05-07T11:17:30.403673+0000","last_peered":"2024-05-07T11:17:30.403673+0000","last_clean":"2024-05-07T11:17:30.403673+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:30.403673+0000","last_undegraded":"2024-05-07T11:17:30.403673+0000","last_fullsized":"2024-05-07T11:17:30.403673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:47.068504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404359+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:30.404359+0000","last_peered":"2024-05-07T11:17:30.404359+0000","last_clean":"2024-05-07T11:17:30.404359+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:30.404359+0000","last_undegraded":"2024-05-07T11:17:30.404359+0000","last_fullsized":"2024-05-07T11:17:30.404359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:35:51.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'155","reported_seq":435,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403110+0000","last_change":"2024-05-07T11:17:27.404484+0000","last_active":"2024-05-07T11:17:30.403110+0000","last_peered":"2024-05-07T11:17:30.403110+0000","last_clean":"2024-05-07T11:17:30.403110+0000","last_became_active":"2024-05-07T11:17:27.403866+0000","last_became_peered":"2024-05-07T11:17:27.403866+0000","last_unstale":"2024-05-07T11:17:30.403110+0000","last_undegraded":"2024-05-07T11:17:30.403110+0000","last_fullsized":"2024-05-07T11:17:30.403110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:15:32.849874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":166862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795883+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:30.795883+0000","last_peered":"2024-05-07T11:17:30.795883+0000","last_clean":"2024-05-07T11:17:30.795883+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:30.795883+0000","last_undegraded":"2024-05-07T11:17:30.795883+0000","last_fullsized":"2024-05-07T11:17:30.795883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:16.479879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'167","reported_seq":321,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795133+0000","last_change":"2024-05-07T11:17:21.418782+0000","last_active":"2024-05-07T11:17:30.795133+0000","last_peered":"2024-05-07T11:17:30.795133+0000","last_clean":"2024-05-07T11:17:30.795133+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:30.795133+0000","last_undegraded":"2024-05-07T11:17:30.795133+0000","last_fullsized":"2024-05-07T11:17:30.795133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:13.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404754+0000","last_change":"2024-05-07T11:17:22.419069+0000","last_active":"2024-05-07T11:17:30.404754+0000","last_peered":"2024-05-07T11:17:30.404754+0000","last_clean":"2024-05-07T11:17:30.404754+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:30.404754+0000","last_undegraded":"2024-05-07T11:17:30.404754+0000","last_fullsized":"2024-05-07T11:17:30.404754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:20.890067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404443+0000","last_change":"2024-05-07T11:17:29.408348+0000","last_active":"2024-05-07T11:17:30.404443+0000","last_peered":"2024-05-07T11:17:30.404443+0000","last_clean":"2024-05-07T11:17:30.404443+0000","last_became_active":"2024-05-07T11:17:29.407677+0000","last_became_peered":"2024-05-07T11:17:29.407677+0000","last_unstale":"2024-05-07T11:17:30.404443+0000","last_undegraded":"2024-05-07T11:17:30.404443+0000","last_fullsized":"2024-05-07T11:17:30.404443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:02.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":83336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404663+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:30.404663+0000","last_peered":"2024-05-07T11:17:30.404663+0000","last_clean":"2024-05-07T11:17:30.404663+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:30.404663+0000","last_undegraded":"2024-05-07T11:17:30.404663+0000","last_fullsized":"2024-05-07T11:17:30.404663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:31:28.580245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"63'164","reported_seq":314,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403552+0000","last_change":"2024-05-07T11:12:44.052584+0000","last_active":"2024-05-07T11:17:30.403552+0000","last_peered":"2024-05-07T11:17:30.403552+0000","last_clean":"2024-05-07T11:17:30.403552+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:30.403552+0000","last_undegraded":"2024-05-07T11:17:30.403552+0000","last_fullsized":"2024-05-07T11:17:30.403552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:16:25.467600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'16","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403688+0000","last_change":"2024-05-07T11:17:18.450923+0000","last_active":"2024-05-07T11:17:30.403688+0000","last_peered":"2024-05-07T11:17:30.403688+0000","last_clean":"2024-05-07T11:17:30.403688+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:30.403688+0000","last_undegraded":"2024-05-07T11:17:30.403688+0000","last_fullsized":"2024-05-07T11:17:30.403688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:02:38.864461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"63'172","reported_seq":560,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404209+0000","last_change":"2024-05-07T11:17:28.401492+0000","last_active":"2024-05-07T11:17:30.404209+0000","last_peered":"2024-05-07T11:17:30.404209+0000","last_clean":"2024-05-07T11:17:30.404209+0000","last_became_active":"2024-05-07T11:17:28.400673+0000","last_became_peered":"2024-05-07T11:17:28.400673+0000","last_unstale":"2024-05-07T11:17:30.404209+0000","last_undegraded":"2024-05-07T11:17:30.404209+0000","last_fullsized":"2024-05-07T11:17:30.404209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:41.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":127501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404803+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:30.404803+0000","last_peered":"2024-05-07T11:17:30.404803+0000","last_clean":"2024-05-07T11:17:30.404803+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:30.404803+0000","last_undegraded":"2024-05-07T11:17:30.404803+0000","last_fullsized":"2024-05-07T11:17:30.404803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:05:37.062259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"63'163","reported_seq":519,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404591+0000","last_change":"2024-05-07T11:17:27.405072+0000","last_active":"2024-05-07T11:17:30.404591+0000","last_peered":"2024-05-07T11:17:30.404591+0000","last_clean":"2024-05-07T11:17:30.404591+0000","last_became_active":"2024-05-07T11:17:27.404340+0000","last_became_peered":"2024-05-07T11:17:27.404340+0000","last_unstale":"2024-05-07T11:17:30.404591+0000","last_undegraded":"2024-05-07T11:17:30.404591+0000","last_fullsized":"2024-05-07T11:17:30.404591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:05:12.602038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":119690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795129+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:30.795129+0000","last_peered":"2024-05-07T11:17:30.795129+0000","last_clean":"2024-05-07T11:17:30.795129+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:30.795129+0000","last_undegraded":"2024-05-07T11:17:30.795129+0000","last_fullsized":"2024-05-07T11:17:30.795129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:23:47.689436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'137","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403862+0000","last_change":"2024-05-07T11:17:24.403787+0000","last_active":"2024-05-07T11:17:30.403862+0000","last_peered":"2024-05-07T11:17:30.403862+0000","last_clean":"2024-05-07T11:17:30.403862+0000","last_became_active":"2024-05-07T11:17:24.403279+0000","last_became_peered":"2024-05-07T11:17:24.403279+0000","last_unstale":"2024-05-07T11:17:30.403862+0000","last_undegraded":"2024-05-07T11:17:30.403862+0000","last_fullsized":"2024-05-07T11:17:30.403862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:42.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":119,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795539+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:30.795539+0000","last_peered":"2024-05-07T11:17:30.795539+0000","last_clean":"2024-05-07T11:17:30.795539+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:30.795539+0000","last_undegraded":"2024-05-07T11:17:30.795539+0000","last_fullsized":"2024-05-07T11:17:30.795539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:59.411938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'141","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403996+0000","last_change":"2024-05-07T11:17:22.417126+0000","last_active":"2024-05-07T11:17:30.403996+0000","last_peered":"2024-05-07T11:17:30.403996+0000","last_clean":"2024-05-07T11:17:30.403996+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:30.403996+0000","last_undegraded":"2024-05-07T11:17:30.403996+0000","last_fullsized":"2024-05-07T11:17:30.403996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:46.775489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":359,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404346+0000","last_change":"2024-05-07T11:17:18.433863+0000","last_active":"2024-05-07T11:17:30.404346+0000","last_peered":"2024-05-07T11:17:30.404346+0000","last_clean":"2024-05-07T11:17:30.404346+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:30.404346+0000","last_undegraded":"2024-05-07T11:17:30.404346+0000","last_fullsized":"2024-05-07T11:17:30.404346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:10.515455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404385+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:30.404385+0000","last_peered":"2024-05-07T11:17:30.404385+0000","last_clean":"2024-05-07T11:17:30.404385+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:30.404385+0000","last_undegraded":"2024-05-07T11:17:30.404385+0000","last_fullsized":"2024-05-07T11:17:30.404385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:03:02.539869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403061+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:30.403061+0000","last_peered":"2024-05-07T11:17:30.403061+0000","last_clean":"2024-05-07T11:17:30.403061+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:30.403061+0000","last_undegraded":"2024-05-07T11:17:30.403061+0000","last_fullsized":"2024-05-07T11:17:30.403061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:24:00.875722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404654+0000","last_change":"2024-05-07T11:17:29.231999+0000","last_active":"2024-05-07T11:17:30.404654+0000","last_peered":"2024-05-07T11:17:30.404654+0000","last_clean":"2024-05-07T11:17:30.404654+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:30.404654+0000","last_undegraded":"2024-05-07T11:17:30.404654+0000","last_fullsized":"2024-05-07T11:17:30.404654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:37.451106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":138308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404219+0000","last_change":"2024-05-07T11:17:18.433452+0000","last_active":"2024-05-07T11:17:30.404219+0000","last_peered":"2024-05-07T11:17:30.404219+0000","last_clean":"2024-05-07T11:17:30.404219+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:30.404219+0000","last_undegraded":"2024-05-07T11:17:30.404219+0000","last_fullsized":"2024-05-07T11:17:30.404219+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:26.663080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'35","reported_seq":220,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403281+0000","last_change":"2024-05-07T11:12:43.048900+0000","last_active":"2024-05-07T11:17:30.403281+0000","last_peered":"2024-05-07T11:17:30.403281+0000","last_clean":"2024-05-07T11:17:30.403281+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:30.403281+0000","last_undegraded":"2024-05-07T11:17:30.403281+0000","last_fullsized":"2024-05-07T11:17:30.403281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:44.639321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"63'160","reported_seq":313,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795913+0000","last_change":"2024-05-07T11:17:24.407000+0000","last_active":"2024-05-07T11:17:30.795913+0000","last_peered":"2024-05-07T11:17:30.795913+0000","last_clean":"2024-05-07T11:17:30.795913+0000","last_became_active":"2024-05-07T11:17:24.406306+0000","last_became_peered":"2024-05-07T11:17:24.406306+0000","last_unstale":"2024-05-07T11:17:30.795913+0000","last_undegraded":"2024-05-07T11:17:30.795913+0000","last_fullsized":"2024-05-07T11:17:30.795913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:56:56.763708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":402414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403560+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:30.403560+0000","last_peered":"2024-05-07T11:17:30.403560+0000","last_clean":"2024-05-07T11:17:30.403560+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:30.403560+0000","last_undegraded":"2024-05-07T11:17:30.403560+0000","last_fullsized":"2024-05-07T11:17:30.403560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:20.744525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'56","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795119+0000","last_change":"2024-05-07T11:17:18.572639+0000","last_active":"2024-05-07T11:17:30.795119+0000","last_peered":"2024-05-07T11:17:30.795119+0000","last_clean":"2024-05-07T11:17:30.795119+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:30.795119+0000","last_undegraded":"2024-05-07T11:17:30.795119+0000","last_fullsized":"2024-05-07T11:17:30.795119+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:51:15.538158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403967+0000","last_change":"2024-05-07T11:17:26.407965+0000","last_active":"2024-05-07T11:17:30.403967+0000","last_peered":"2024-05-07T11:17:30.403967+0000","last_clean":"2024-05-07T11:17:30.403967+0000","last_became_active":"2024-05-07T11:17:26.407203+0000","last_became_peered":"2024-05-07T11:17:26.407203+0000","last_unstale":"2024-05-07T11:17:30.403967+0000","last_undegraded":"2024-05-07T11:17:30.403967+0000","last_fullsized":"2024-05-07T11:17:30.403967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:54:50.842472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":384377,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404866+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:30.404866+0000","last_peered":"2024-05-07T11:17:30.404866+0000","last_clean":"2024-05-07T11:17:30.404866+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:30.404866+0000","last_undegraded":"2024-05-07T11:17:30.404866+0000","last_fullsized":"2024-05-07T11:17:30.404866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:33.648331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":162,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404316+0000","last_change":"2024-05-07T11:17:18.404539+0000","last_active":"2024-05-07T11:17:30.404316+0000","last_peered":"2024-05-07T11:17:30.404316+0000","last_clean":"2024-05-07T11:17:30.404316+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:30.404316+0000","last_undegraded":"2024-05-07T11:17:30.404316+0000","last_fullsized":"2024-05-07T11:17:30.404316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:50.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":233,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403988+0000","last_change":"2024-05-07T11:17:25.412664+0000","last_active":"2024-05-07T11:17:30.403988+0000","last_peered":"2024-05-07T11:17:30.403988+0000","last_clean":"2024-05-07T11:17:30.403988+0000","last_became_active":"2024-05-07T11:17:25.412026+0000","last_became_peered":"2024-05-07T11:17:25.412026+0000","last_unstale":"2024-05-07T11:17:30.403988+0000","last_undegraded":"2024-05-07T11:17:30.403988+0000","last_fullsized":"2024-05-07T11:17:30.403988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:19:28.465664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":174891,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404777+0000","last_change":"2024-05-07T11:17:22.424750+0000","last_active":"2024-05-07T11:17:30.404777+0000","last_peered":"2024-05-07T11:17:30.404777+0000","last_clean":"2024-05-07T11:17:30.404777+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:30.404777+0000","last_undegraded":"2024-05-07T11:17:30.404777+0000","last_fullsized":"2024-05-07T11:17:30.404777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:12.283160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404113+0000","last_change":"2024-05-07T11:17:18.433137+0000","last_active":"2024-05-07T11:17:30.404113+0000","last_peered":"2024-05-07T11:17:30.404113+0000","last_clean":"2024-05-07T11:17:30.404113+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:30.404113+0000","last_undegraded":"2024-05-07T11:17:30.404113+0000","last_fullsized":"2024-05-07T11:17:30.404113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:10:40.770823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":296,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795321+0000","last_change":"2024-05-07T11:17:29.408764+0000","last_active":"2024-05-07T11:17:30.795321+0000","last_peered":"2024-05-07T11:17:30.795321+0000","last_clean":"2024-05-07T11:17:30.795321+0000","last_became_active":"2024-05-07T11:17:29.407296+0000","last_became_peered":"2024-05-07T11:17:29.407296+0000","last_unstale":"2024-05-07T11:17:30.795321+0000","last_undegraded":"2024-05-07T11:17:30.795321+0000","last_fullsized":"2024-05-07T11:17:30.795321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:34:42.615088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":74509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403776+0000","last_change":"2024-05-07T11:17:18.431763+0000","last_active":"2024-05-07T11:17:30.403776+0000","last_peered":"2024-05-07T11:17:30.403776+0000","last_clean":"2024-05-07T11:17:30.403776+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:30.403776+0000","last_undegraded":"2024-05-07T11:17:30.403776+0000","last_fullsized":"2024-05-07T11:17:30.403776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:38.234395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":125,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796383+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:30.796383+0000","last_peered":"2024-05-07T11:17:30.796383+0000","last_clean":"2024-05-07T11:17:30.796383+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:30.796383+0000","last_undegraded":"2024-05-07T11:17:30.796383+0000","last_fullsized":"2024-05-07T11:17:30.796383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:54.609817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'181","reported_seq":331,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795311+0000","last_change":"2024-05-07T11:17:23.399296+0000","last_active":"2024-05-07T11:17:30.795311+0000","last_peered":"2024-05-07T11:17:30.795311+0000","last_clean":"2024-05-07T11:17:30.795311+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:30.795311+0000","last_undegraded":"2024-05-07T11:17:30.795311+0000","last_fullsized":"2024-05-07T11:17:30.795311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:21.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":100,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404018+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:30.404018+0000","last_peered":"2024-05-07T11:17:30.404018+0000","last_clean":"2024-05-07T11:17:30.404018+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:30.404018+0000","last_undegraded":"2024-05-07T11:17:30.404018+0000","last_fullsized":"2024-05-07T11:17:30.404018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:03.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403832+0000","last_change":"2024-05-07T11:17:18.432358+0000","last_active":"2024-05-07T11:17:30.403832+0000","last_peered":"2024-05-07T11:17:30.403832+0000","last_clean":"2024-05-07T11:17:30.403832+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:30.403832+0000","last_undegraded":"2024-05-07T11:17:30.403832+0000","last_fullsized":"2024-05-07T11:17:30.403832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:36.281521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"63'175","reported_seq":285,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403129+0000","last_change":"2024-05-07T11:17:22.420080+0000","last_active":"2024-05-07T11:17:30.403129+0000","last_peered":"2024-05-07T11:17:30.403129+0000","last_clean":"2024-05-07T11:17:30.403129+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:30.403129+0000","last_undegraded":"2024-05-07T11:17:30.403129+0000","last_fullsized":"2024-05-07T11:17:30.403129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:41.233935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'38","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403696+0000","last_change":"2024-05-07T11:17:18.459674+0000","last_active":"2024-05-07T11:17:30.403696+0000","last_peered":"2024-05-07T11:17:30.403696+0000","last_clean":"2024-05-07T11:17:30.403696+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:30.403696+0000","last_undegraded":"2024-05-07T11:17:30.403696+0000","last_fullsized":"2024-05-07T11:17:30.403696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:35.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404514+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:30.404514+0000","last_peered":"2024-05-07T11:17:30.404514+0000","last_clean":"2024-05-07T11:17:30.404514+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:30.404514+0000","last_undegraded":"2024-05-07T11:17:30.404514+0000","last_fullsized":"2024-05-07T11:17:30.404514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:14.650941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'138","reported_seq":290,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794688+0000","last_change":"2024-05-07T11:17:22.417629+0000","last_active":"2024-05-07T11:17:30.794688+0000","last_peered":"2024-05-07T11:17:30.794688+0000","last_clean":"2024-05-07T11:17:30.794688+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:30.794688+0000","last_undegraded":"2024-05-07T11:17:30.794688+0000","last_fullsized":"2024-05-07T11:17:30.794688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:58.760049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'164","reported_seq":510,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403556+0000","last_change":"2024-05-07T11:17:23.400613+0000","last_active":"2024-05-07T11:17:30.403556+0000","last_peered":"2024-05-07T11:17:30.403556+0000","last_clean":"2024-05-07T11:17:30.403556+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:30.403556+0000","last_undegraded":"2024-05-07T11:17:30.403556+0000","last_fullsized":"2024-05-07T11:17:30.403556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:28.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":208,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404486+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:30.404486+0000","last_peered":"2024-05-07T11:17:30.404486+0000","last_clean":"2024-05-07T11:17:30.404486+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:30.404486+0000","last_undegraded":"2024-05-07T11:17:30.404486+0000","last_fullsized":"2024-05-07T11:17:30.404486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:35.832524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":228,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403482+0000","last_change":"2024-05-07T11:17:25.413137+0000","last_active":"2024-05-07T11:17:30.403482+0000","last_peered":"2024-05-07T11:17:30.403482+0000","last_clean":"2024-05-07T11:17:30.403482+0000","last_became_active":"2024-05-07T11:17:25.412149+0000","last_became_peered":"2024-05-07T11:17:25.412149+0000","last_unstale":"2024-05-07T11:17:30.403482+0000","last_undegraded":"2024-05-07T11:17:30.403482+0000","last_fullsized":"2024-05-07T11:17:30.403482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:05.259035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795725+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:30.795725+0000","last_peered":"2024-05-07T11:17:30.795725+0000","last_clean":"2024-05-07T11:17:30.795725+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:30.795725+0000","last_undegraded":"2024-05-07T11:17:30.795725+0000","last_fullsized":"2024-05-07T11:17:30.795725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:46.092532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404524+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:30.404524+0000","last_peered":"2024-05-07T11:17:30.404524+0000","last_clean":"2024-05-07T11:17:30.404524+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:30.404524+0000","last_undegraded":"2024-05-07T11:17:30.404524+0000","last_fullsized":"2024-05-07T11:17:30.404524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.076287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"63'172","reported_seq":261,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402830+0000","last_change":"2024-05-07T11:17:21.419673+0000","last_active":"2024-05-07T11:17:30.402830+0000","last_peered":"2024-05-07T11:17:30.402830+0000","last_clean":"2024-05-07T11:17:30.402830+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:30.402830+0000","last_undegraded":"2024-05-07T11:17:30.402830+0000","last_fullsized":"2024-05-07T11:17:30.402830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:01.519110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403713+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:30.403713+0000","last_peered":"2024-05-07T11:17:30.403713+0000","last_clean":"2024-05-07T11:17:30.403713+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:30.403713+0000","last_undegraded":"2024-05-07T11:17:30.403713+0000","last_fullsized":"2024-05-07T11:17:30.403713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:19:45.698283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":234,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403625+0000","last_change":"2024-05-07T11:17:27.408792+0000","last_active":"2024-05-07T11:17:30.403625+0000","last_peered":"2024-05-07T11:17:30.403625+0000","last_clean":"2024-05-07T11:17:30.403625+0000","last_became_active":"2024-05-07T11:17:27.407792+0000","last_became_peered":"2024-05-07T11:17:27.407792+0000","last_unstale":"2024-05-07T11:17:30.403625+0000","last_undegraded":"2024-05-07T11:17:30.403625+0000","last_fullsized":"2024-05-07T11:17:30.403625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":319,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796036+0000","last_change":"2024-05-07T11:17:26.408077+0000","last_active":"2024-05-07T11:17:30.796036+0000","last_peered":"2024-05-07T11:17:30.796036+0000","last_clean":"2024-05-07T11:17:30.796036+0000","last_became_active":"2024-05-07T11:17:26.407230+0000","last_became_peered":"2024-05-07T11:17:26.407230+0000","last_unstale":"2024-05-07T11:17:30.796036+0000","last_undegraded":"2024-05-07T11:17:30.796036+0000","last_fullsized":"2024-05-07T11:17:30.796036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:29.469789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":91096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.402939+0000","last_change":"2024-05-07T11:17:18.431271+0000","last_active":"2024-05-07T11:17:30.402939+0000","last_peered":"2024-05-07T11:17:30.402939+0000","last_clean":"2024-05-07T11:17:30.402939+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:30.402939+0000","last_undegraded":"2024-05-07T11:17:30.402939+0000","last_fullsized":"2024-05-07T11:17:30.402939+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:04.299985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":233,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403514+0000","last_change":"2024-05-07T11:17:25.403221+0000","last_active":"2024-05-07T11:17:30.403514+0000","last_peered":"2024-05-07T11:17:30.403514+0000","last_clean":"2024-05-07T11:17:30.403514+0000","last_became_active":"2024-05-07T11:17:25.402661+0000","last_became_peered":"2024-05-07T11:17:25.402661+0000","last_unstale":"2024-05-07T11:17:30.403514+0000","last_undegraded":"2024-05-07T11:17:30.403514+0000","last_fullsized":"2024-05-07T11:17:30.403514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:07.574111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403047+0000","last_change":"2024-05-07T11:17:18.402834+0000","last_active":"2024-05-07T11:17:30.403047+0000","last_peered":"2024-05-07T11:17:30.403047+0000","last_clean":"2024-05-07T11:17:30.403047+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:30.403047+0000","last_undegraded":"2024-05-07T11:17:30.403047+0000","last_fullsized":"2024-05-07T11:17:30.403047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:04.401529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"63'205","reported_seq":357,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794925+0000","last_change":"2024-05-07T11:17:22.421343+0000","last_active":"2024-05-07T11:17:30.794925+0000","last_peered":"2024-05-07T11:17:30.794925+0000","last_clean":"2024-05-07T11:17:30.794925+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:30.794925+0000","last_undegraded":"2024-05-07T11:17:30.794925+0000","last_fullsized":"2024-05-07T11:17:30.794925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:24.076915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795839+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:30.795839+0000","last_peered":"2024-05-07T11:17:30.795839+0000","last_clean":"2024-05-07T11:17:30.795839+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:30.795839+0000","last_undegraded":"2024-05-07T11:17:30.795839+0000","last_fullsized":"2024-05-07T11:17:30.795839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:30:53.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'163","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795930+0000","last_change":"2024-05-07T11:17:24.407114+0000","last_active":"2024-05-07T11:17:30.795930+0000","last_peered":"2024-05-07T11:17:30.795930+0000","last_clean":"2024-05-07T11:17:30.795930+0000","last_became_active":"2024-05-07T11:17:24.406337+0000","last_became_peered":"2024-05-07T11:17:24.406337+0000","last_unstale":"2024-05-07T11:17:30.795930+0000","last_undegraded":"2024-05-07T11:17:30.795930+0000","last_fullsized":"2024-05-07T11:17:30.795930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:28:35.002816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":280772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"55'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795500+0000","last_change":"2024-05-07T11:17:18.555160+0000","last_active":"2024-05-07T11:17:30.795500+0000","last_peered":"2024-05-07T11:17:30.795500+0000","last_clean":"2024-05-07T11:17:30.795500+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:30.795500+0000","last_undegraded":"2024-05-07T11:17:30.795500+0000","last_fullsized":"2024-05-07T11:17:30.795500+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:37.962741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'166","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403479+0000","last_change":"2024-05-07T11:17:21.418540+0000","last_active":"2024-05-07T11:17:30.403479+0000","last_peered":"2024-05-07T11:17:30.403479+0000","last_clean":"2024-05-07T11:17:30.403479+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:30.403479+0000","last_undegraded":"2024-05-07T11:17:30.403479+0000","last_fullsized":"2024-05-07T11:17:30.403479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:54:16.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":171,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404368+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:30.404368+0000","last_peered":"2024-05-07T11:17:30.404368+0000","last_clean":"2024-05-07T11:17:30.404368+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:30.404368+0000","last_undegraded":"2024-05-07T11:17:30.404368+0000","last_fullsized":"2024-05-07T11:17:30.404368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:17.953399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.407286+0000","last_change":"2024-05-07T11:17:30.407286+0000","last_active":"2024-05-07T11:17:30.407286+0000","last_peered":"2024-05-07T11:17:30.407286+0000","last_clean":"2024-05-07T11:17:30.407286+0000","last_became_active":"2024-05-07T11:17:30.406353+0000","last_became_peered":"2024-05-07T11:17:30.406353+0000","last_unstale":"2024-05-07T11:17:30.407286+0000","last_undegraded":"2024-05-07T11:17:30.407286+0000","last_fullsized":"2024-05-07T11:17:30.407286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:51.684426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":124612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795798+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:30.795798+0000","last_peered":"2024-05-07T11:17:30.795798+0000","last_clean":"2024-05-07T11:17:30.795798+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:30.795798+0000","last_undegraded":"2024-05-07T11:17:30.795798+0000","last_fullsized":"2024-05-07T11:17:30.795798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:24.011380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'169","reported_seq":321,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.794835+0000","last_change":"2024-05-07T11:17:22.416150+0000","last_active":"2024-05-07T11:17:30.794835+0000","last_peered":"2024-05-07T11:17:30.794835+0000","last_clean":"2024-05-07T11:17:30.794835+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:30.794835+0000","last_undegraded":"2024-05-07T11:17:30.794835+0000","last_fullsized":"2024-05-07T11:17:30.794835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:28.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"56'2","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403986+0000","last_change":"2024-05-07T11:17:18.504321+0000","last_active":"2024-05-07T11:17:30.403986+0000","last_peered":"2024-05-07T11:17:30.403986+0000","last_clean":"2024-05-07T11:17:30.403986+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:30.403986+0000","last_undegraded":"2024-05-07T11:17:30.403986+0000","last_fullsized":"2024-05-07T11:17:30.403986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:37:08.138234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"63'199","reported_seq":615,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403883+0000","last_change":"2024-05-07T11:17:25.402468+0000","last_active":"2024-05-07T11:17:30.403883+0000","last_peered":"2024-05-07T11:17:30.403883+0000","last_clean":"2024-05-07T11:17:30.403883+0000","last_became_active":"2024-05-07T11:17:25.401850+0000","last_became_peered":"2024-05-07T11:17:25.401850+0000","last_unstale":"2024-05-07T11:17:30.403883+0000","last_undegraded":"2024-05-07T11:17:30.403883+0000","last_fullsized":"2024-05-07T11:17:30.403883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:19.494294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403872+0000","last_change":"2024-05-07T11:17:18.429950+0000","last_active":"2024-05-07T11:17:30.403872+0000","last_peered":"2024-05-07T11:17:30.403872+0000","last_clean":"2024-05-07T11:17:30.403872+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:30.403872+0000","last_undegraded":"2024-05-07T11:17:30.403872+0000","last_fullsized":"2024-05-07T11:17:30.403872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:15:39.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5805,"num_bytes_recovered":19428989,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64405504,"data_stored":53099596,"data_compressed":4611280,"data_compressed_allocated":5402624,"data_compressed_original":14118912,"omap_allocated":0,"internal_metadata":0},"log_size":10416,"ondisk_log_size":10416,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":428,"ondisk_log_size":428,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84172,"kb_used_data":30776,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94287668,"statfs":{"total":96636764160,"available":96550572032,"internally_reserved":0,"allocated":31514624,"data_stored":54276063,"data_compressed":6326260,"data_compressed_allocated":7593984,"data_compressed_original":37191680,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710726,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":23060,"kb_used_omap":10,"kb_used_meta":35893,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":23613440,"data_stored":43695842,"data_compressed":5536379,"data_compressed_allocated":6516736,"data_compressed_original":33533952,"omap_allocated":10404,"internal_metadata":36755292},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66612,"kb_used_data":27108,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305228,"statfs":{"total":96636764160,"available":96568553472,"internally_reserved":0,"allocated":27758592,"data_stored":40411961,"data_compressed":4972494,"data_compressed_allocated":5840896,"data_compressed_original":25952256,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22953984,"data_stored":19509974,"data_compressed":1953035,"data_compressed_allocated":2265088,"data_compressed_original":5890048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17506304,"data_stored":13389680,"data_compressed":1088810,"data_compressed_allocated":1314816,"data_compressed_original":3727360,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23945216,"data_stored":20199942,"data_compressed":1569435,"data_compressed_allocated":1822720,"data_compressed_original":4501504,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:39.280 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.280 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.280 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.281 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.281 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.281 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.281 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.281 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.282 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.282 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.282 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.282 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.282 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.282 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.283 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.283 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.283 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.283 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.283 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.284 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.284 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.284 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.284 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.284 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.284 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.285 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.285 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.285 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.285 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.285 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.285 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.286 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.286 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.286 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.286 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.286 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.286 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.287 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.287 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.287 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.287 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.287 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.287 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.288 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.288 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.288 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.288 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.288 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.288 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.289 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.289 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.289 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.290 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.290 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.290 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.290 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.290 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.291 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.291 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.291 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.291 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.291 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.291 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.291 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.292 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.292 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.292 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.292 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.292 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.292 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.293 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.293 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.293 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.293 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.293 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.294 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.294 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.294 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.295 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.296 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.296 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.296 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.296 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.296 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.297 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.297 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.297 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.297 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.297 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.297 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.298 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.298 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.298 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.298 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.298 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.298 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.299 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.299 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.299 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.299 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.299 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.299 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.300 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.300 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.300 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:39.300 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T11:17:59.301 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:17:59.626 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:17:59.628 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:17:59.633 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-05-07T11:17:59.020662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5827,"num_bytes_recovered":56847285,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13036,"ondisk_log_size":13036,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":205576,"kb_used_data":80944,"kb_used_omap":13,"kb_used_meta":124594,"kb_avail":282909944,"statfs":{"total":289910292480,"available":289699782656,"internally_reserved":0,"allocated":82886656,"data_stored":138383866,"data_compressed":16835133,"data_compressed_allocated":19951616,"data_compressed_original":96677888,"omap_allocated":13594,"internal_metadata":127584998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002948"},"pg_stats":[{"pgid":"4.3f","version":"63'163","reported_seq":311,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796477+0000","last_change":"2024-05-07T11:17:27.408581+0000","last_active":"2024-05-07T11:17:30.796477+0000","last_peered":"2024-05-07T11:17:30.796477+0000","last_clean":"2024-05-07T11:17:30.796477+0000","last_became_active":"2024-05-07T11:17:27.407668+0000","last_became_peered":"2024-05-07T11:17:27.407668+0000","last_unstale":"2024-05-07T11:17:30.796477+0000","last_undegraded":"2024-05-07T11:17:30.796477+0000","last_fullsized":"2024-05-07T11:17:30.796477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":85925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"83'201","reported_seq":365,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:41.201485+0000","last_change":"2024-05-07T11:17:41.201530+0000","last_active":"2024-05-07T11:17:41.201485+0000","last_peered":"2024-05-07T11:17:41.201485+0000","last_clean":"2024-05-07T11:17:41.201485+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:41.201485+0000","last_undegraded":"2024-05-07T11:17:41.201485+0000","last_fullsized":"2024-05-07T11:17:41.201485+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:41.201407+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:41.201407+0000","last_clean_scrub_stamp":"2024-05-07T11:17:41.201407+0000","objects_scrubbed":46,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:10.995764+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"83'214","reported_seq":572,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:41.066480+0000","last_change":"2024-05-07T11:17:41.066533+0000","last_active":"2024-05-07T11:17:41.066480+0000","last_peered":"2024-05-07T11:17:41.066480+0000","last_clean":"2024-05-07T11:17:41.066480+0000","last_became_active":"2024-05-07T11:17:26.407269+0000","last_became_peered":"2024-05-07T11:17:26.407269+0000","last_unstale":"2024-05-07T11:17:41.066480+0000","last_undegraded":"2024-05-07T11:17:41.066480+0000","last_fullsized":"2024-05-07T11:17:41.066480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'214","last_scrub_stamp":"2024-05-07T11:17:41.066386+0000","last_deep_scrub":"83'214","last_deep_scrub_stamp":"2024-05-07T11:17:41.066386+0000","last_clean_scrub_stamp":"2024-05-07T11:17:41.066386+0000","objects_scrubbed":45,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:36:14.974872+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":75254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'126","reported_seq":275,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404000+0000","last_change":"2024-05-07T11:12:44.054764+0000","last_active":"2024-05-07T11:17:30.404000+0000","last_peered":"2024-05-07T11:17:30.404000+0000","last_clean":"2024-05-07T11:17:30.404000+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:17:30.404000+0000","last_undegraded":"2024-05-07T11:17:30.404000+0000","last_fullsized":"2024-05-07T11:17:30.404000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"83'247","reported_seq":412,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:45.223435+0000","last_change":"2024-05-07T11:17:45.223468+0000","last_active":"2024-05-07T11:17:45.223435+0000","last_peered":"2024-05-07T11:17:45.223435+0000","last_clean":"2024-05-07T11:17:45.223435+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:45.223435+0000","last_undegraded":"2024-05-07T11:17:45.223435+0000","last_fullsized":"2024-05-07T11:17:45.223435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'247","last_scrub_stamp":"2024-05-07T11:17:45.223358+0000","last_deep_scrub":"83'247","last_deep_scrub_stamp":"2024-05-07T11:17:45.223358+0000","last_clean_scrub_stamp":"2024-05-07T11:17:45.223358+0000","objects_scrubbed":61,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:00:54.386592+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:38.943709+0000","last_change":"2024-05-07T11:17:30.406178+0000","last_active":"2024-05-07T11:17:38.943709+0000","last_peered":"2024-05-07T11:17:38.943709+0000","last_clean":"2024-05-07T11:17:38.943709+0000","last_became_active":"2024-05-07T11:17:30.405536+0000","last_became_peered":"2024-05-07T11:17:30.405536+0000","last_unstale":"2024-05-07T11:17:38.943709+0000","last_undegraded":"2024-05-07T11:17:38.943709+0000","last_fullsized":"2024-05-07T11:17:38.943709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":529421,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"83'228","reported_seq":342,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.985885+0000","last_change":"2024-05-07T11:17:47.985926+0000","last_active":"2024-05-07T11:17:47.985885+0000","last_peered":"2024-05-07T11:17:47.985885+0000","last_clean":"2024-05-07T11:17:47.985885+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:47.985885+0000","last_undegraded":"2024-05-07T11:17:47.985885+0000","last_fullsized":"2024-05-07T11:17:47.985885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'228","last_scrub_stamp":"2024-05-07T11:17:47.985809+0000","last_deep_scrub":"83'228","last_deep_scrub_stamp":"2024-05-07T11:17:47.985809+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.985809+0000","objects_scrubbed":62,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:36:21.119192+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"63'132","reported_seq":465,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:38.943683+0000","last_change":"2024-05-07T11:17:23.399107+0000","last_active":"2024-05-07T11:17:38.943683+0000","last_peered":"2024-05-07T11:17:38.943683+0000","last_clean":"2024-05-07T11:17:38.943683+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:17:38.943683+0000","last_undegraded":"2024-05-07T11:17:38.943683+0000","last_fullsized":"2024-05-07T11:17:38.943683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'171","reported_seq":250,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403637+0000","last_change":"2024-05-07T11:17:27.409473+0000","last_active":"2024-05-07T11:17:30.403637+0000","last_peered":"2024-05-07T11:17:30.403637+0000","last_clean":"2024-05-07T11:17:30.403637+0000","last_became_active":"2024-05-07T11:17:27.408650+0000","last_became_peered":"2024-05-07T11:17:27.408650+0000","last_unstale":"2024-05-07T11:17:30.403637+0000","last_undegraded":"2024-05-07T11:17:30.403637+0000","last_fullsized":"2024-05-07T11:17:30.403637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":631133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"83'201","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:44.203197+0000","last_change":"2024-05-07T11:17:44.203242+0000","last_active":"2024-05-07T11:17:44.203197+0000","last_peered":"2024-05-07T11:17:44.203197+0000","last_clean":"2024-05-07T11:17:44.203197+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:44.203197+0000","last_undegraded":"2024-05-07T11:17:44.203197+0000","last_fullsized":"2024-05-07T11:17:44.203197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:44.203102+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:44.203102+0000","last_clean_scrub_stamp":"2024-05-07T11:17:44.203102+0000","objects_scrubbed":45,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:39:20.413250+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"83'213","reported_seq":522,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.053940+0000","last_change":"2024-05-07T11:17:52.053975+0000","last_active":"2024-05-07T11:17:52.053940+0000","last_peered":"2024-05-07T11:17:52.053940+0000","last_clean":"2024-05-07T11:17:52.053940+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:52.053940+0000","last_undegraded":"2024-05-07T11:17:52.053940+0000","last_fullsized":"2024-05-07T11:17:52.053940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'213","last_scrub_stamp":"2024-05-07T11:17:52.053862+0000","last_deep_scrub":"83'213","last_deep_scrub_stamp":"2024-05-07T11:17:52.053862+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.053862+0000","objects_scrubbed":59,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:34:34.769997+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"63'140","reported_seq":281,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796176+0000","last_change":"2024-05-07T11:17:28.404789+0000","last_active":"2024-05-07T11:17:30.796176+0000","last_peered":"2024-05-07T11:17:30.796176+0000","last_clean":"2024-05-07T11:17:30.796176+0000","last_became_active":"2024-05-07T11:17:28.403770+0000","last_became_peered":"2024-05-07T11:17:28.403770+0000","last_unstale":"2024-05-07T11:17:30.796176+0000","last_undegraded":"2024-05-07T11:17:30.796176+0000","last_fullsized":"2024-05-07T11:17:30.796176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":89602,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"83'187","reported_seq":353,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:50.303808+0000","last_change":"2024-05-07T11:17:50.303836+0000","last_active":"2024-05-07T11:17:50.303808+0000","last_peered":"2024-05-07T11:17:50.303808+0000","last_clean":"2024-05-07T11:17:50.303808+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:50.303808+0000","last_undegraded":"2024-05-07T11:17:50.303808+0000","last_fullsized":"2024-05-07T11:17:50.303808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'187","last_scrub_stamp":"2024-05-07T11:17:50.303719+0000","last_deep_scrub":"83'187","last_deep_scrub_stamp":"2024-05-07T11:17:50.303719+0000","last_clean_scrub_stamp":"2024-05-07T11:17:50.303719+0000","objects_scrubbed":51,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:14:41.226878+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"83'222","reported_seq":590,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:43.081883+0000","last_change":"2024-05-07T11:17:43.081932+0000","last_active":"2024-05-07T11:17:43.081883+0000","last_peered":"2024-05-07T11:17:43.081883+0000","last_clean":"2024-05-07T11:17:43.081883+0000","last_became_active":"2024-05-07T11:17:26.407342+0000","last_became_peered":"2024-05-07T11:17:26.407342+0000","last_unstale":"2024-05-07T11:17:43.081883+0000","last_undegraded":"2024-05-07T11:17:43.081883+0000","last_fullsized":"2024-05-07T11:17:43.081883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'222","last_scrub_stamp":"2024-05-07T11:17:43.081787+0000","last_deep_scrub":"83'222","last_deep_scrub_stamp":"2024-05-07T11:17:43.081787+0000","last_clean_scrub_stamp":"2024-05-07T11:17:43.081787+0000","objects_scrubbed":47,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:36.906648+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":196945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'171","reported_seq":532,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403885+0000","last_change":"2024-05-07T11:17:23.399194+0000","last_active":"2024-05-07T11:17:30.403885+0000","last_peered":"2024-05-07T11:17:30.403885+0000","last_clean":"2024-05-07T11:17:30.403885+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:17:30.403885+0000","last_undegraded":"2024-05-07T11:17:30.403885+0000","last_fullsized":"2024-05-07T11:17:30.403885+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":502,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.407524+0000","last_change":"2024-05-07T11:17:30.406594+0000","last_active":"2024-05-07T11:17:30.407524+0000","last_peered":"2024-05-07T11:17:30.407524+0000","last_clean":"2024-05-07T11:17:30.407524+0000","last_became_active":"2024-05-07T11:17:30.405896+0000","last_became_peered":"2024-05-07T11:17:30.405896+0000","last_unstale":"2024-05-07T11:17:30.407524+0000","last_undegraded":"2024-05-07T11:17:30.407524+0000","last_fullsized":"2024-05-07T11:17:30.407524+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4343464,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"83'210","reported_seq":574,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:49.314556+0000","last_change":"2024-05-07T11:17:49.314602+0000","last_active":"2024-05-07T11:17:49.314556+0000","last_peered":"2024-05-07T11:17:49.314556+0000","last_clean":"2024-05-07T11:17:49.314556+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:49.314556+0000","last_undegraded":"2024-05-07T11:17:49.314556+0000","last_fullsized":"2024-05-07T11:17:49.314556+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'210","last_scrub_stamp":"2024-05-07T11:17:49.314458+0000","last_deep_scrub":"83'210","last_deep_scrub_stamp":"2024-05-07T11:17:49.314458+0000","last_clean_scrub_stamp":"2024-05-07T11:17:49.314458+0000","objects_scrubbed":49,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:02.141295+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"83'202","reported_seq":367,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:49.285042+0000","last_change":"2024-05-07T11:17:49.285099+0000","last_active":"2024-05-07T11:17:49.285042+0000","last_peered":"2024-05-07T11:17:49.285042+0000","last_clean":"2024-05-07T11:17:49.285042+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:49.285042+0000","last_undegraded":"2024-05-07T11:17:49.285042+0000","last_fullsized":"2024-05-07T11:17:49.285042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'202","last_scrub_stamp":"2024-05-07T11:17:49.284941+0000","last_deep_scrub":"83'202","last_deep_scrub_stamp":"2024-05-07T11:17:49.284941+0000","last_clean_scrub_stamp":"2024-05-07T11:17:49.284941+0000","objects_scrubbed":54,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:06:24.534977+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"83'201","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:39.333162+0000","last_change":"2024-05-07T11:17:39.333214+0000","last_active":"2024-05-07T11:17:39.333162+0000","last_peered":"2024-05-07T11:17:39.333162+0000","last_clean":"2024-05-07T11:17:39.333162+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:39.333162+0000","last_undegraded":"2024-05-07T11:17:39.333162+0000","last_fullsized":"2024-05-07T11:17:39.333162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:39.333074+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:39.333074+0000","last_clean_scrub_stamp":"2024-05-07T11:17:39.333074+0000","objects_scrubbed":54,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:32.756865+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"63'185","reported_seq":574,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404127+0000","last_change":"2024-05-07T11:17:29.407762+0000","last_active":"2024-05-07T11:17:30.404127+0000","last_peered":"2024-05-07T11:17:30.404127+0000","last_clean":"2024-05-07T11:17:30.404127+0000","last_became_active":"2024-05-07T11:17:29.407032+0000","last_became_peered":"2024-05-07T11:17:29.407032+0000","last_unstale":"2024-05-07T11:17:30.404127+0000","last_undegraded":"2024-05-07T11:17:30.404127+0000","last_fullsized":"2024-05-07T11:17:30.404127+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":98139,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'157","reported_seq":306,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403854+0000","last_change":"2024-05-07T11:12:44.055810+0000","last_active":"2024-05-07T11:17:30.403854+0000","last_peered":"2024-05-07T11:17:30.403854+0000","last_clean":"2024-05-07T11:17:30.403854+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:17:30.403854+0000","last_undegraded":"2024-05-07T11:17:30.403854+0000","last_fullsized":"2024-05-07T11:17:30.403854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"63'165","reported_seq":304,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796110+0000","last_change":"2024-05-07T11:17:29.408512+0000","last_active":"2024-05-07T11:17:30.796110+0000","last_peered":"2024-05-07T11:17:30.796110+0000","last_clean":"2024-05-07T11:17:30.796110+0000","last_became_active":"2024-05-07T11:17:29.407294+0000","last_became_peered":"2024-05-07T11:17:29.407294+0000","last_unstale":"2024-05-07T11:17:30.796110+0000","last_undegraded":"2024-05-07T11:17:30.796110+0000","last_fullsized":"2024-05-07T11:17:30.796110+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":116557,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"83'210","reported_seq":309,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:41.259211+0000","last_change":"2024-05-07T11:17:41.259241+0000","last_active":"2024-05-07T11:17:41.259211+0000","last_peered":"2024-05-07T11:17:41.259211+0000","last_clean":"2024-05-07T11:17:41.259211+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:41.259211+0000","last_undegraded":"2024-05-07T11:17:41.259211+0000","last_fullsized":"2024-05-07T11:17:41.259211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'210","last_scrub_stamp":"2024-05-07T11:17:41.259122+0000","last_deep_scrub":"83'210","last_deep_scrub_stamp":"2024-05-07T11:17:41.259122+0000","last_clean_scrub_stamp":"2024-05-07T11:17:41.259122+0000","objects_scrubbed":51,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:06:52.200929+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"83'217","reported_seq":381,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:51.266223+0000","last_change":"2024-05-07T11:17:51.266265+0000","last_active":"2024-05-07T11:17:51.266223+0000","last_peered":"2024-05-07T11:17:51.266223+0000","last_clean":"2024-05-07T11:17:51.266223+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:51.266223+0000","last_undegraded":"2024-05-07T11:17:51.266223+0000","last_fullsized":"2024-05-07T11:17:51.266223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'217","last_scrub_stamp":"2024-05-07T11:17:51.266142+0000","last_deep_scrub":"83'217","last_deep_scrub_stamp":"2024-05-07T11:17:51.266142+0000","last_clean_scrub_stamp":"2024-05-07T11:17:51.266142+0000","objects_scrubbed":48,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:50:26.027402+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'154","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796128+0000","last_change":"2024-05-07T11:17:24.407028+0000","last_active":"2024-05-07T11:17:30.796128+0000","last_peered":"2024-05-07T11:17:30.796128+0000","last_clean":"2024-05-07T11:17:30.796128+0000","last_became_active":"2024-05-07T11:17:24.406307+0000","last_became_peered":"2024-05-07T11:17:24.406307+0000","last_unstale":"2024-05-07T11:17:30.796128+0000","last_undegraded":"2024-05-07T11:17:30.796128+0000","last_fullsized":"2024-05-07T11:17:30.796128+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":230897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"83'250","reported_seq":411,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:54.347620+0000","last_change":"2024-05-07T11:17:54.347648+0000","last_active":"2024-05-07T11:17:54.347620+0000","last_peered":"2024-05-07T11:17:54.347620+0000","last_clean":"2024-05-07T11:17:54.347620+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:54.347620+0000","last_undegraded":"2024-05-07T11:17:54.347620+0000","last_fullsized":"2024-05-07T11:17:54.347620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'250","last_scrub_stamp":"2024-05-07T11:17:54.347547+0000","last_deep_scrub":"83'250","last_deep_scrub_stamp":"2024-05-07T11:17:54.347547+0000","last_clean_scrub_stamp":"2024-05-07T11:17:54.347547+0000","objects_scrubbed":55,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:22:30.438020+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"63'152","reported_seq":474,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404428+0000","last_change":"2024-05-07T11:17:29.416071+0000","last_active":"2024-05-07T11:17:30.404428+0000","last_peered":"2024-05-07T11:17:30.404428+0000","last_clean":"2024-05-07T11:17:30.404428+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:17:30.404428+0000","last_undegraded":"2024-05-07T11:17:30.404428+0000","last_fullsized":"2024-05-07T11:17:30.404428+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":67681,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'147","reported_seq":288,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796043+0000","last_change":"2024-05-07T11:17:28.404770+0000","last_active":"2024-05-07T11:17:30.796043+0000","last_peered":"2024-05-07T11:17:30.796043+0000","last_clean":"2024-05-07T11:17:30.796043+0000","last_became_active":"2024-05-07T11:17:28.403782+0000","last_became_peered":"2024-05-07T11:17:28.403782+0000","last_unstale":"2024-05-07T11:17:30.796043+0000","last_undegraded":"2024-05-07T11:17:30.796043+0000","last_fullsized":"2024-05-07T11:17:30.796043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":211687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'163","reported_seq":248,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403538+0000","last_change":"2024-05-07T11:17:24.403807+0000","last_active":"2024-05-07T11:17:30.403538+0000","last_peered":"2024-05-07T11:17:30.403538+0000","last_clean":"2024-05-07T11:17:30.403538+0000","last_became_active":"2024-05-07T11:17:24.403179+0000","last_became_peered":"2024-05-07T11:17:24.403179+0000","last_unstale":"2024-05-07T11:17:30.403538+0000","last_undegraded":"2024-05-07T11:17:30.403538+0000","last_fullsized":"2024-05-07T11:17:30.403538+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'185","reported_seq":324,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795829+0000","last_change":"2024-05-07T11:17:29.409488+0000","last_active":"2024-05-07T11:17:30.795829+0000","last_peered":"2024-05-07T11:17:30.795829+0000","last_clean":"2024-05-07T11:17:30.795829+0000","last_became_active":"2024-05-07T11:17:29.408425+0000","last_became_peered":"2024-05-07T11:17:29.408425+0000","last_unstale":"2024-05-07T11:17:30.795829+0000","last_undegraded":"2024-05-07T11:17:30.795829+0000","last_fullsized":"2024-05-07T11:17:30.795829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":86167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"83'258","reported_seq":663,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.332086+0000","last_change":"2024-05-07T11:17:47.332120+0000","last_active":"2024-05-07T11:17:47.332086+0000","last_peered":"2024-05-07T11:17:47.332086+0000","last_clean":"2024-05-07T11:17:47.332086+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:47.332086+0000","last_undegraded":"2024-05-07T11:17:47.332086+0000","last_fullsized":"2024-05-07T11:17:47.332086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'258","last_scrub_stamp":"2024-05-07T11:17:47.331997+0000","last_deep_scrub":"83'258","last_deep_scrub_stamp":"2024-05-07T11:17:47.331997+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.331997+0000","objects_scrubbed":66,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:56.524621+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"83'241","reported_seq":648,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:42.102161+0000","last_change":"2024-05-07T11:17:42.102193+0000","last_active":"2024-05-07T11:17:42.102161+0000","last_peered":"2024-05-07T11:17:42.102161+0000","last_clean":"2024-05-07T11:17:42.102161+0000","last_became_active":"2024-05-07T11:17:28.398801+0000","last_became_peered":"2024-05-07T11:17:28.398801+0000","last_unstale":"2024-05-07T11:17:42.102161+0000","last_undegraded":"2024-05-07T11:17:42.102161+0000","last_fullsized":"2024-05-07T11:17:42.102161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'241","last_scrub_stamp":"2024-05-07T11:17:42.102072+0000","last_deep_scrub":"83'241","last_deep_scrub_stamp":"2024-05-07T11:17:42.102072+0000","last_clean_scrub_stamp":"2024-05-07T11:17:42.102072+0000","objects_scrubbed":56,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:41:31.485222+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":459999,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"83'201","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:42.201299+0000","last_change":"2024-05-07T11:17:42.201378+0000","last_active":"2024-05-07T11:17:42.201299+0000","last_peered":"2024-05-07T11:17:42.201299+0000","last_clean":"2024-05-07T11:17:42.201299+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:42.201299+0000","last_undegraded":"2024-05-07T11:17:42.201299+0000","last_fullsized":"2024-05-07T11:17:42.201299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:42.201182+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:42.201182+0000","last_clean_scrub_stamp":"2024-05-07T11:17:42.201182+0000","objects_scrubbed":45,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:36:38.491438+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"68'127","reported_seq":278,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404115+0000","last_change":"2024-05-07T11:12:43.052872+0000","last_active":"2024-05-07T11:17:30.404115+0000","last_peered":"2024-05-07T11:17:30.404115+0000","last_clean":"2024-05-07T11:17:30.404115+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:17:30.404115+0000","last_undegraded":"2024-05-07T11:17:30.404115+0000","last_fullsized":"2024-05-07T11:17:30.404115+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"83'186","reported_seq":350,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:43.155008+0000","last_change":"2024-05-07T11:17:43.155072+0000","last_active":"2024-05-07T11:17:43.155008+0000","last_peered":"2024-05-07T11:17:43.155008+0000","last_clean":"2024-05-07T11:17:43.155008+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:43.155008+0000","last_undegraded":"2024-05-07T11:17:43.155008+0000","last_fullsized":"2024-05-07T11:17:43.155008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'186","last_scrub_stamp":"2024-05-07T11:17:43.154922+0000","last_deep_scrub":"83'186","last_deep_scrub_stamp":"2024-05-07T11:17:43.154922+0000","last_clean_scrub_stamp":"2024-05-07T11:17:43.154922+0000","objects_scrubbed":45,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:58:38.318679+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403497+0000","last_change":"2024-05-07T11:17:18.404109+0000","last_active":"2024-05-07T11:17:30.403497+0000","last_peered":"2024-05-07T11:17:30.403497+0000","last_clean":"2024-05-07T11:17:30.403497+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:30.403497+0000","last_undegraded":"2024-05-07T11:17:30.403497+0000","last_fullsized":"2024-05-07T11:17:30.403497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"83'238","reported_seq":337,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:43.328522+0000","last_change":"2024-05-07T11:17:43.328557+0000","last_active":"2024-05-07T11:17:43.328522+0000","last_peered":"2024-05-07T11:17:43.328522+0000","last_clean":"2024-05-07T11:17:43.328522+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:43.328522+0000","last_undegraded":"2024-05-07T11:17:43.328522+0000","last_fullsized":"2024-05-07T11:17:43.328522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'238","last_scrub_stamp":"2024-05-07T11:17:43.328425+0000","last_deep_scrub":"83'238","last_deep_scrub_stamp":"2024-05-07T11:17:43.328425+0000","last_clean_scrub_stamp":"2024-05-07T11:17:43.328425+0000","objects_scrubbed":59,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:16:14.596154+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:56.323986+0000","last_change":"2024-05-07T11:17:56.324016+0000","last_active":"2024-05-07T11:17:56.323986+0000","last_peered":"2024-05-07T11:17:56.323986+0000","last_clean":"2024-05-07T11:17:56.323986+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:56.323986+0000","last_undegraded":"2024-05-07T11:17:56.323986+0000","last_fullsized":"2024-05-07T11:17:56.323986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:56.323896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:56.323896+0000","last_clean_scrub_stamp":"2024-05-07T11:17:56.323896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:32:35.546889+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'159","reported_seq":245,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403893+0000","last_change":"2024-05-07T11:17:23.400008+0000","last_active":"2024-05-07T11:17:30.403893+0000","last_peered":"2024-05-07T11:17:30.403893+0000","last_clean":"2024-05-07T11:17:30.403893+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:17:30.403893+0000","last_undegraded":"2024-05-07T11:17:30.403893+0000","last_fullsized":"2024-05-07T11:17:30.403893+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"83'12","reported_seq":178,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:55.005124+0000","last_change":"2024-05-07T11:17:55.005157+0000","last_active":"2024-05-07T11:17:55.005124+0000","last_peered":"2024-05-07T11:17:55.005124+0000","last_clean":"2024-05-07T11:17:55.005124+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:55.005124+0000","last_undegraded":"2024-05-07T11:17:55.005124+0000","last_fullsized":"2024-05-07T11:17:55.005124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'12","last_scrub_stamp":"2024-05-07T11:17:55.005031+0000","last_deep_scrub":"83'12","last_deep_scrub_stamp":"2024-05-07T11:17:55.005031+0000","last_clean_scrub_stamp":"2024-05-07T11:17:55.005031+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:38.264791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'2","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404422+0000","last_change":"2024-05-07T11:17:18.433637+0000","last_active":"2024-05-07T11:17:30.404422+0000","last_peered":"2024-05-07T11:17:30.404422+0000","last_clean":"2024-05-07T11:17:30.404422+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:17:30.404422+0000","last_undegraded":"2024-05-07T11:17:30.404422+0000","last_fullsized":"2024-05-07T11:17:30.404422+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"83'212","reported_seq":503,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:40.119928+0000","last_change":"2024-05-07T11:17:40.119960+0000","last_active":"2024-05-07T11:17:40.119928+0000","last_peered":"2024-05-07T11:17:40.119928+0000","last_clean":"2024-05-07T11:17:40.119928+0000","last_became_active":"2024-05-07T11:17:27.403866+0000","last_became_peered":"2024-05-07T11:17:27.403866+0000","last_unstale":"2024-05-07T11:17:40.119928+0000","last_undegraded":"2024-05-07T11:17:40.119928+0000","last_fullsized":"2024-05-07T11:17:40.119928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'212","last_scrub_stamp":"2024-05-07T11:17:40.119827+0000","last_deep_scrub":"83'212","last_deep_scrub_stamp":"2024-05-07T11:17:40.119827+0000","last_clean_scrub_stamp":"2024-05-07T11:17:40.119827+0000","objects_scrubbed":57,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:28:51.573724+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":166862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'3","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795948+0000","last_change":"2024-05-07T11:17:18.433424+0000","last_active":"2024-05-07T11:17:30.795948+0000","last_peered":"2024-05-07T11:17:30.795948+0000","last_clean":"2024-05-07T11:17:30.795948+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:17:30.795948+0000","last_undegraded":"2024-05-07T11:17:30.795948+0000","last_fullsized":"2024-05-07T11:17:30.795948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"83'221","reported_seq":387,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.273587+0000","last_change":"2024-05-07T11:17:47.273619+0000","last_active":"2024-05-07T11:17:47.273587+0000","last_peered":"2024-05-07T11:17:47.273587+0000","last_clean":"2024-05-07T11:17:47.273587+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:47.273587+0000","last_undegraded":"2024-05-07T11:17:47.273587+0000","last_fullsized":"2024-05-07T11:17:47.273587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'221","last_scrub_stamp":"2024-05-07T11:17:47.273504+0000","last_deep_scrub":"83'221","last_deep_scrub_stamp":"2024-05-07T11:17:47.273504+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.273504+0000","objects_scrubbed":54,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:32:07.829004+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"83'2","reported_seq":104,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:49.987444+0000","last_change":"2024-05-07T11:17:49.987471+0000","last_active":"2024-05-07T11:17:49.987444+0000","last_peered":"2024-05-07T11:17:49.987444+0000","last_clean":"2024-05-07T11:17:49.987444+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:49.987444+0000","last_undegraded":"2024-05-07T11:17:49.987444+0000","last_fullsized":"2024-05-07T11:17:49.987444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'2","last_scrub_stamp":"2024-05-07T11:17:49.987323+0000","last_deep_scrub":"83'2","last_deep_scrub_stamp":"2024-05-07T11:17:49.987323+0000","last_clean_scrub_stamp":"2024-05-07T11:17:49.987323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:12:22.356303+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'159","reported_seq":528,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404515+0000","last_change":"2024-05-07T11:17:29.408348+0000","last_active":"2024-05-07T11:17:30.404515+0000","last_peered":"2024-05-07T11:17:30.404515+0000","last_clean":"2024-05-07T11:17:30.404515+0000","last_became_active":"2024-05-07T11:17:29.407677+0000","last_became_peered":"2024-05-07T11:17:29.407677+0000","last_unstale":"2024-05-07T11:17:30.404515+0000","last_undegraded":"2024-05-07T11:17:30.404515+0000","last_fullsized":"2024-05-07T11:17:30.404515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":83336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":95,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404726+0000","last_change":"2024-05-07T11:17:22.424889+0000","last_active":"2024-05-07T11:17:30.404726+0000","last_peered":"2024-05-07T11:17:30.404726+0000","last_clean":"2024-05-07T11:17:30.404726+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:17:30.404726+0000","last_undegraded":"2024-05-07T11:17:30.404726+0000","last_fullsized":"2024-05-07T11:17:30.404726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"83'215","reported_seq":376,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:55.350485+0000","last_change":"2024-05-07T11:17:55.350512+0000","last_active":"2024-05-07T11:17:55.350485+0000","last_peered":"2024-05-07T11:17:55.350485+0000","last_clean":"2024-05-07T11:17:55.350485+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:55.350485+0000","last_undegraded":"2024-05-07T11:17:55.350485+0000","last_fullsized":"2024-05-07T11:17:55.350485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'215","last_scrub_stamp":"2024-05-07T11:17:55.350399+0000","last_deep_scrub":"83'215","last_deep_scrub_stamp":"2024-05-07T11:17:55.350399+0000","last_clean_scrub_stamp":"2024-05-07T11:17:55.350399+0000","objects_scrubbed":51,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:21:47.599124+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"83'18","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:42.260730+0000","last_change":"2024-05-07T11:17:42.260756+0000","last_active":"2024-05-07T11:17:42.260730+0000","last_peered":"2024-05-07T11:17:42.260730+0000","last_clean":"2024-05-07T11:17:42.260730+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:42.260730+0000","last_undegraded":"2024-05-07T11:17:42.260730+0000","last_fullsized":"2024-05-07T11:17:42.260730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'18","last_scrub_stamp":"2024-05-07T11:17:42.260615+0000","last_deep_scrub":"83'18","last_deep_scrub_stamp":"2024-05-07T11:17:42.260615+0000","last_clean_scrub_stamp":"2024-05-07T11:17:42.260615+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:52:04.635816+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"83'234","reported_seq":633,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:46.011170+0000","last_change":"2024-05-07T11:17:46.011210+0000","last_active":"2024-05-07T11:17:46.011170+0000","last_peered":"2024-05-07T11:17:46.011170+0000","last_clean":"2024-05-07T11:17:46.011170+0000","last_became_active":"2024-05-07T11:17:28.400673+0000","last_became_peered":"2024-05-07T11:17:28.400673+0000","last_unstale":"2024-05-07T11:17:46.011170+0000","last_undegraded":"2024-05-07T11:17:46.011170+0000","last_fullsized":"2024-05-07T11:17:46.011170+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'234","last_scrub_stamp":"2024-05-07T11:17:46.011079+0000","last_deep_scrub":"83'234","last_deep_scrub_stamp":"2024-05-07T11:17:46.011079+0000","last_clean_scrub_stamp":"2024-05-07T11:17:46.011079+0000","objects_scrubbed":62,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:52.036574+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":127501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404834+0000","last_change":"2024-05-07T11:12:43.052983+0000","last_active":"2024-05-07T11:17:30.404834+0000","last_peered":"2024-05-07T11:17:30.404834+0000","last_clean":"2024-05-07T11:17:30.404834+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:17:30.404834+0000","last_undegraded":"2024-05-07T11:17:30.404834+0000","last_fullsized":"2024-05-07T11:17:30.404834+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"83'217","reported_seq":584,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:39.078656+0000","last_change":"2024-05-07T11:17:39.078687+0000","last_active":"2024-05-07T11:17:39.078656+0000","last_peered":"2024-05-07T11:17:39.078656+0000","last_clean":"2024-05-07T11:17:39.078656+0000","last_became_active":"2024-05-07T11:17:27.404340+0000","last_became_peered":"2024-05-07T11:17:27.404340+0000","last_unstale":"2024-05-07T11:17:39.078656+0000","last_undegraded":"2024-05-07T11:17:39.078656+0000","last_fullsized":"2024-05-07T11:17:39.078656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'217","last_scrub_stamp":"2024-05-07T11:17:39.078562+0000","last_deep_scrub":"83'217","last_deep_scrub_stamp":"2024-05-07T11:17:39.078562+0000","last_clean_scrub_stamp":"2024-05-07T11:17:39.078562+0000","objects_scrubbed":54,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:32:20.273980+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":119690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795171+0000","last_change":"2024-05-07T11:17:18.424079+0000","last_active":"2024-05-07T11:17:30.795171+0000","last_peered":"2024-05-07T11:17:30.795171+0000","last_clean":"2024-05-07T11:17:30.795171+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:30.795171+0000","last_undegraded":"2024-05-07T11:17:30.795171+0000","last_fullsized":"2024-05-07T11:17:30.795171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"83'193","reported_seq":540,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:45.025977+0000","last_change":"2024-05-07T11:17:45.026028+0000","last_active":"2024-05-07T11:17:45.025977+0000","last_peered":"2024-05-07T11:17:45.025977+0000","last_clean":"2024-05-07T11:17:45.025977+0000","last_became_active":"2024-05-07T11:17:24.403279+0000","last_became_peered":"2024-05-07T11:17:24.403279+0000","last_unstale":"2024-05-07T11:17:45.025977+0000","last_undegraded":"2024-05-07T11:17:45.025977+0000","last_fullsized":"2024-05-07T11:17:45.025977+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'193","last_scrub_stamp":"2024-05-07T11:17:45.025873+0000","last_deep_scrub":"83'193","last_deep_scrub_stamp":"2024-05-07T11:17:45.025873+0000","last_clean_scrub_stamp":"2024-05-07T11:17:45.025873+0000","objects_scrubbed":56,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:49:13.481745+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":120,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795595+0000","last_change":"2024-05-07T11:17:18.433063+0000","last_active":"2024-05-07T11:17:30.795595+0000","last_peered":"2024-05-07T11:17:30.795595+0000","last_clean":"2024-05-07T11:17:30.795595+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:30.795595+0000","last_undegraded":"2024-05-07T11:17:30.795595+0000","last_fullsized":"2024-05-07T11:17:30.795595+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"83'194","reported_seq":539,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:51.378119+0000","last_change":"2024-05-07T11:17:51.378147+0000","last_active":"2024-05-07T11:17:51.378119+0000","last_peered":"2024-05-07T11:17:51.378119+0000","last_clean":"2024-05-07T11:17:51.378119+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:51.378119+0000","last_undegraded":"2024-05-07T11:17:51.378119+0000","last_fullsized":"2024-05-07T11:17:51.378119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'194","last_scrub_stamp":"2024-05-07T11:17:51.378022+0000","last_deep_scrub":"83'194","last_deep_scrub_stamp":"2024-05-07T11:17:51.378022+0000","last_clean_scrub_stamp":"2024-05-07T11:17:51.378022+0000","objects_scrubbed":53,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:55.523756+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"83'159","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:50.980974+0000","last_change":"2024-05-07T11:17:50.981010+0000","last_active":"2024-05-07T11:17:50.980974+0000","last_peered":"2024-05-07T11:17:50.980974+0000","last_clean":"2024-05-07T11:17:50.980974+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:50.980974+0000","last_undegraded":"2024-05-07T11:17:50.980974+0000","last_fullsized":"2024-05-07T11:17:50.980974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'159","last_scrub_stamp":"2024-05-07T11:17:50.980889+0000","last_deep_scrub":"83'159","last_deep_scrub_stamp":"2024-05-07T11:17:50.980889+0000","last_clean_scrub_stamp":"2024-05-07T11:17:50.980889+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:11:04.996284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":169,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404483+0000","last_change":"2024-05-07T11:17:18.404996+0000","last_active":"2024-05-07T11:17:30.404483+0000","last_peered":"2024-05-07T11:17:30.404483+0000","last_clean":"2024-05-07T11:17:30.404483+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:30.404483+0000","last_undegraded":"2024-05-07T11:17:30.404483+0000","last_fullsized":"2024-05-07T11:17:30.404483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403178+0000","last_change":"2024-05-07T11:17:18.429541+0000","last_active":"2024-05-07T11:17:30.403178+0000","last_peered":"2024-05-07T11:17:30.403178+0000","last_clean":"2024-05-07T11:17:30.403178+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:17:30.403178+0000","last_undegraded":"2024-05-07T11:17:30.403178+0000","last_fullsized":"2024-05-07T11:17:30.403178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"63'147","reported_seq":473,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404710+0000","last_change":"2024-05-07T11:17:29.231999+0000","last_active":"2024-05-07T11:17:30.404710+0000","last_peered":"2024-05-07T11:17:30.404710+0000","last_clean":"2024-05-07T11:17:30.404710+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:17:30.404710+0000","last_undegraded":"2024-05-07T11:17:30.404710+0000","last_fullsized":"2024-05-07T11:17:30.404710+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":138308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.962154+0000","last_change":"2024-05-07T11:17:52.962179+0000","last_active":"2024-05-07T11:17:52.962154+0000","last_peered":"2024-05-07T11:17:52.962154+0000","last_clean":"2024-05-07T11:17:52.962154+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:52.962154+0000","last_undegraded":"2024-05-07T11:17:52.962154+0000","last_fullsized":"2024-05-07T11:17:52.962154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:52.962063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:52.962063+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.962063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:32:03.113448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"83'36","reported_seq":230,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:53.329701+0000","last_change":"2024-05-07T11:17:53.329728+0000","last_active":"2024-05-07T11:17:53.329701+0000","last_peered":"2024-05-07T11:17:53.329701+0000","last_clean":"2024-05-07T11:17:53.329701+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:53.329701+0000","last_undegraded":"2024-05-07T11:17:53.329701+0000","last_fullsized":"2024-05-07T11:17:53.329701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'36","last_scrub_stamp":"2024-05-07T11:17:53.329615+0000","last_deep_scrub":"83'36","last_deep_scrub_stamp":"2024-05-07T11:17:53.329615+0000","last_clean_scrub_stamp":"2024-05-07T11:17:53.329615+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:38.387178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"83'216","reported_seq":380,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:54.342114+0000","last_change":"2024-05-07T11:17:54.342148+0000","last_active":"2024-05-07T11:17:54.342114+0000","last_peered":"2024-05-07T11:17:54.342114+0000","last_clean":"2024-05-07T11:17:54.342114+0000","last_became_active":"2024-05-07T11:17:24.406306+0000","last_became_peered":"2024-05-07T11:17:24.406306+0000","last_unstale":"2024-05-07T11:17:54.342114+0000","last_undegraded":"2024-05-07T11:17:54.342114+0000","last_fullsized":"2024-05-07T11:17:54.342114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'216","last_scrub_stamp":"2024-05-07T11:17:54.342032+0000","last_deep_scrub":"83'216","last_deep_scrub_stamp":"2024-05-07T11:17:54.342032+0000","last_clean_scrub_stamp":"2024-05-07T11:17:54.342032+0000","objects_scrubbed":56,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:16:33.674063+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":402414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":166,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403605+0000","last_change":"2024-05-07T11:17:18.426117+0000","last_active":"2024-05-07T11:17:30.403605+0000","last_peered":"2024-05-07T11:17:30.403605+0000","last_clean":"2024-05-07T11:17:30.403605+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:30.403605+0000","last_undegraded":"2024-05-07T11:17:30.403605+0000","last_fullsized":"2024-05-07T11:17:30.403605+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"83'57","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:53.253743+0000","last_change":"2024-05-07T11:17:53.253838+0000","last_active":"2024-05-07T11:17:53.253743+0000","last_peered":"2024-05-07T11:17:53.253743+0000","last_clean":"2024-05-07T11:17:53.253743+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:53.253743+0000","last_undegraded":"2024-05-07T11:17:53.253743+0000","last_fullsized":"2024-05-07T11:17:53.253743+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'57","last_scrub_stamp":"2024-05-07T11:17:53.253612+0000","last_deep_scrub":"83'57","last_deep_scrub_stamp":"2024-05-07T11:17:53.253612+0000","last_clean_scrub_stamp":"2024-05-07T11:17:53.253612+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:47.846273+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'169","reported_seq":250,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404017+0000","last_change":"2024-05-07T11:17:26.407965+0000","last_active":"2024-05-07T11:17:30.404017+0000","last_peered":"2024-05-07T11:17:30.404017+0000","last_clean":"2024-05-07T11:17:30.404017+0000","last_became_active":"2024-05-07T11:17:26.407203+0000","last_became_peered":"2024-05-07T11:17:26.407203+0000","last_unstale":"2024-05-07T11:17:30.404017+0000","last_undegraded":"2024-05-07T11:17:30.404017+0000","last_fullsized":"2024-05-07T11:17:30.404017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":384377,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404889+0000","last_change":"2024-05-07T11:12:38.712229+0000","last_active":"2024-05-07T11:17:30.404889+0000","last_peered":"2024-05-07T11:17:30.404889+0000","last_clean":"2024-05-07T11:17:30.404889+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:17:30.404889+0000","last_undegraded":"2024-05-07T11:17:30.404889+0000","last_fullsized":"2024-05-07T11:17:30.404889+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":171,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:57.010295+0000","last_change":"2024-05-07T11:17:57.010321+0000","last_active":"2024-05-07T11:17:57.010295+0000","last_peered":"2024-05-07T11:17:57.010295+0000","last_clean":"2024-05-07T11:17:57.010295+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:57.010295+0000","last_undegraded":"2024-05-07T11:17:57.010295+0000","last_fullsized":"2024-05-07T11:17:57.010295+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:57.010202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:57.010202+0000","last_clean_scrub_stamp":"2024-05-07T11:17:57.010202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:14.384618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"63'151","reported_seq":234,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404035+0000","last_change":"2024-05-07T11:17:25.412664+0000","last_active":"2024-05-07T11:17:30.404035+0000","last_peered":"2024-05-07T11:17:30.404035+0000","last_clean":"2024-05-07T11:17:30.404035+0000","last_became_active":"2024-05-07T11:17:25.412026+0000","last_became_peered":"2024-05-07T11:17:25.412026+0000","last_unstale":"2024-05-07T11:17:30.404035+0000","last_undegraded":"2024-05-07T11:17:30.404035+0000","last_fullsized":"2024-05-07T11:17:30.404035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":174891,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:56.036277+0000","last_change":"2024-05-07T11:17:56.036303+0000","last_active":"2024-05-07T11:17:56.036277+0000","last_peered":"2024-05-07T11:17:56.036277+0000","last_clean":"2024-05-07T11:17:56.036277+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:56.036277+0000","last_undegraded":"2024-05-07T11:17:56.036277+0000","last_fullsized":"2024-05-07T11:17:56.036277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-05-07T11:17:56.036184+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-05-07T11:17:56.036184+0000","last_clean_scrub_stamp":"2024-05-07T11:17:56.036184+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:56:59.214039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:44.239921+0000","last_change":"2024-05-07T11:17:44.239945+0000","last_active":"2024-05-07T11:17:44.239921+0000","last_peered":"2024-05-07T11:17:44.239921+0000","last_clean":"2024-05-07T11:17:44.239921+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:44.239921+0000","last_undegraded":"2024-05-07T11:17:44.239921+0000","last_fullsized":"2024-05-07T11:17:44.239921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:44.239834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:44.239834+0000","last_clean_scrub_stamp":"2024-05-07T11:17:44.239834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:25:18.735065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"63'158","reported_seq":297,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795396+0000","last_change":"2024-05-07T11:17:29.408764+0000","last_active":"2024-05-07T11:17:30.795396+0000","last_peered":"2024-05-07T11:17:30.795396+0000","last_clean":"2024-05-07T11:17:30.795396+0000","last_became_active":"2024-05-07T11:17:29.407296+0000","last_became_peered":"2024-05-07T11:17:29.407296+0000","last_unstale":"2024-05-07T11:17:30.795396+0000","last_undegraded":"2024-05-07T11:17:30.795396+0000","last_fullsized":"2024-05-07T11:17:30.795396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":74509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:48.258915+0000","last_change":"2024-05-07T11:17:48.258940+0000","last_active":"2024-05-07T11:17:48.258915+0000","last_peered":"2024-05-07T11:17:48.258915+0000","last_clean":"2024-05-07T11:17:48.258915+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:48.258915+0000","last_undegraded":"2024-05-07T11:17:48.258915+0000","last_fullsized":"2024-05-07T11:17:48.258915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:48.258794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:48.258794+0000","last_clean_scrub_stamp":"2024-05-07T11:17:48.258794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:23.353531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796434+0000","last_change":"2024-05-07T11:17:18.430835+0000","last_active":"2024-05-07T11:17:30.796434+0000","last_peered":"2024-05-07T11:17:30.796434+0000","last_clean":"2024-05-07T11:17:30.796434+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:30.796434+0000","last_undegraded":"2024-05-07T11:17:30.796434+0000","last_fullsized":"2024-05-07T11:17:30.796434+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"83'233","reported_seq":395,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.293237+0000","last_change":"2024-05-07T11:17:52.293267+0000","last_active":"2024-05-07T11:17:52.293237+0000","last_peered":"2024-05-07T11:17:52.293237+0000","last_clean":"2024-05-07T11:17:52.293237+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:52.293237+0000","last_undegraded":"2024-05-07T11:17:52.293237+0000","last_fullsized":"2024-05-07T11:17:52.293237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'233","last_scrub_stamp":"2024-05-07T11:17:52.293156+0000","last_deep_scrub":"83'233","last_deep_scrub_stamp":"2024-05-07T11:17:52.293156+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.293156+0000","objects_scrubbed":52,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:41:46.740290+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":101,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404086+0000","last_change":"2024-05-07T11:17:18.432198+0000","last_active":"2024-05-07T11:17:30.404086+0000","last_peered":"2024-05-07T11:17:30.404086+0000","last_clean":"2024-05-07T11:17:30.404086+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:17:30.404086+0000","last_undegraded":"2024-05-07T11:17:30.404086+0000","last_fullsized":"2024-05-07T11:17:30.404086+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:46.241049+0000","last_change":"2024-05-07T11:17:46.241075+0000","last_active":"2024-05-07T11:17:46.241049+0000","last_peered":"2024-05-07T11:17:46.241049+0000","last_clean":"2024-05-07T11:17:46.241049+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:46.241049+0000","last_undegraded":"2024-05-07T11:17:46.241049+0000","last_fullsized":"2024-05-07T11:17:46.241049+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:46.240900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:46.240900+0000","last_clean_scrub_stamp":"2024-05-07T11:17:46.240900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:37.866026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"83'233","reported_seq":354,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:54.033859+0000","last_change":"2024-05-07T11:17:54.033895+0000","last_active":"2024-05-07T11:17:54.033859+0000","last_peered":"2024-05-07T11:17:54.033859+0000","last_clean":"2024-05-07T11:17:54.033859+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:54.033859+0000","last_undegraded":"2024-05-07T11:17:54.033859+0000","last_fullsized":"2024-05-07T11:17:54.033859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'233","last_scrub_stamp":"2024-05-07T11:17:54.033780+0000","last_deep_scrub":"83'233","last_deep_scrub_stamp":"2024-05-07T11:17:54.033780+0000","last_clean_scrub_stamp":"2024-05-07T11:17:54.033780+0000","objects_scrubbed":58,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:47.910390+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"83'39","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:40.262548+0000","last_change":"2024-05-07T11:17:40.262573+0000","last_active":"2024-05-07T11:17:40.262548+0000","last_peered":"2024-05-07T11:17:40.262548+0000","last_clean":"2024-05-07T11:17:40.262548+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:40.262548+0000","last_undegraded":"2024-05-07T11:17:40.262548+0000","last_fullsized":"2024-05-07T11:17:40.262548+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'39","last_scrub_stamp":"2024-05-07T11:17:40.262463+0000","last_deep_scrub":"83'39","last_deep_scrub_stamp":"2024-05-07T11:17:40.262463+0000","last_clean_scrub_stamp":"2024-05-07T11:17:40.262463+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:30:27.064631+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":164,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404561+0000","last_change":"2024-05-07T11:17:18.433198+0000","last_active":"2024-05-07T11:17:30.404561+0000","last_peered":"2024-05-07T11:17:30.404561+0000","last_clean":"2024-05-07T11:17:30.404561+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:17:30.404561+0000","last_undegraded":"2024-05-07T11:17:30.404561+0000","last_fullsized":"2024-05-07T11:17:30.404561+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:37.690802+0000","last_clean_scrub_stamp":"2024-05-07T11:12:37.690802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"83'190","reported_seq":353,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:46.276900+0000","last_change":"2024-05-07T11:17:46.276956+0000","last_active":"2024-05-07T11:17:46.276900+0000","last_peered":"2024-05-07T11:17:46.276900+0000","last_clean":"2024-05-07T11:17:46.276900+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:46.276900+0000","last_undegraded":"2024-05-07T11:17:46.276900+0000","last_fullsized":"2024-05-07T11:17:46.276900+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'190","last_scrub_stamp":"2024-05-07T11:17:46.276811+0000","last_deep_scrub":"83'190","last_deep_scrub_stamp":"2024-05-07T11:17:46.276811+0000","last_clean_scrub_stamp":"2024-05-07T11:17:46.276811+0000","objects_scrubbed":52,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:04:11.845008+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"83'224","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.030675+0000","last_change":"2024-05-07T11:17:47.030735+0000","last_active":"2024-05-07T11:17:47.030675+0000","last_peered":"2024-05-07T11:17:47.030675+0000","last_clean":"2024-05-07T11:17:47.030675+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:47.030675+0000","last_undegraded":"2024-05-07T11:17:47.030675+0000","last_fullsized":"2024-05-07T11:17:47.030675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'224","last_scrub_stamp":"2024-05-07T11:17:47.030564+0000","last_deep_scrub":"83'224","last_deep_scrub_stamp":"2024-05-07T11:17:47.030564+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.030564+0000","objects_scrubbed":60,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:52:51.327322+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"68'44","reported_seq":209,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.404545+0000","last_change":"2024-05-07T11:17:18.454449+0000","last_active":"2024-05-07T11:17:30.404545+0000","last_peered":"2024-05-07T11:17:30.404545+0000","last_clean":"2024-05-07T11:17:30.404545+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:17:30.404545+0000","last_undegraded":"2024-05-07T11:17:30.404545+0000","last_fullsized":"2024-05-07T11:17:30.404545+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'146","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403531+0000","last_change":"2024-05-07T11:17:25.413137+0000","last_active":"2024-05-07T11:17:30.403531+0000","last_peered":"2024-05-07T11:17:30.403531+0000","last_clean":"2024-05-07T11:17:30.403531+0000","last_became_active":"2024-05-07T11:17:25.412149+0000","last_became_peered":"2024-05-07T11:17:25.412149+0000","last_unstale":"2024-05-07T11:17:30.403531+0000","last_undegraded":"2024-05-07T11:17:30.403531+0000","last_fullsized":"2024-05-07T11:17:30.403531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"61'22","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795797+0000","last_change":"2024-05-07T11:17:18.455376+0000","last_active":"2024-05-07T11:17:30.795797+0000","last_peered":"2024-05-07T11:17:30.795797+0000","last_clean":"2024-05-07T11:17:30.795797+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:17:30.795797+0000","last_undegraded":"2024-05-07T11:17:30.795797+0000","last_fullsized":"2024-05-07T11:17:30.795797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":95,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:37.043742+0000","last_change":"2024-05-07T11:17:22.424871+0000","last_active":"2024-05-07T11:17:37.043742+0000","last_peered":"2024-05-07T11:17:37.043742+0000","last_clean":"2024-05-07T11:17:37.043742+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:37.043742+0000","last_undegraded":"2024-05-07T11:17:37.043742+0000","last_fullsized":"2024-05-07T11:17:37.043742+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"83'236","reported_seq":336,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:45.288243+0000","last_change":"2024-05-07T11:17:45.288277+0000","last_active":"2024-05-07T11:17:45.288243+0000","last_peered":"2024-05-07T11:17:45.288243+0000","last_clean":"2024-05-07T11:17:45.288243+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:45.288243+0000","last_undegraded":"2024-05-07T11:17:45.288243+0000","last_fullsized":"2024-05-07T11:17:45.288243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'236","last_scrub_stamp":"2024-05-07T11:17:45.288150+0000","last_deep_scrub":"83'236","last_deep_scrub_stamp":"2024-05-07T11:17:45.288150+0000","last_clean_scrub_stamp":"2024-05-07T11:17:45.288150+0000","objects_scrubbed":64,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:33.054850+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403762+0000","last_change":"2024-05-07T11:17:18.403854+0000","last_active":"2024-05-07T11:17:30.403762+0000","last_peered":"2024-05-07T11:17:30.403762+0000","last_clean":"2024-05-07T11:17:30.403762+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:30.403762+0000","last_undegraded":"2024-05-07T11:17:30.403762+0000","last_fullsized":"2024-05-07T11:17:30.403762+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"63'156","reported_seq":235,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403688+0000","last_change":"2024-05-07T11:17:27.408792+0000","last_active":"2024-05-07T11:17:30.403688+0000","last_peered":"2024-05-07T11:17:30.403688+0000","last_clean":"2024-05-07T11:17:30.403688+0000","last_became_active":"2024-05-07T11:17:27.407792+0000","last_became_peered":"2024-05-07T11:17:27.407792+0000","last_unstale":"2024-05-07T11:17:30.403688+0000","last_undegraded":"2024-05-07T11:17:30.403688+0000","last_fullsized":"2024-05-07T11:17:30.403688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'175","reported_seq":320,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796106+0000","last_change":"2024-05-07T11:17:26.408077+0000","last_active":"2024-05-07T11:17:30.796106+0000","last_peered":"2024-05-07T11:17:30.796106+0000","last_clean":"2024-05-07T11:17:30.796106+0000","last_became_active":"2024-05-07T11:17:26.407230+0000","last_became_peered":"2024-05-07T11:17:26.407230+0000","last_unstale":"2024-05-07T11:17:30.796106+0000","last_undegraded":"2024-05-07T11:17:30.796106+0000","last_fullsized":"2024-05-07T11:17:30.796106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":91096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:50.321128+0000","last_change":"2024-05-07T11:17:50.321169+0000","last_active":"2024-05-07T11:17:50.321128+0000","last_peered":"2024-05-07T11:17:50.321128+0000","last_clean":"2024-05-07T11:17:50.321128+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:50.321128+0000","last_undegraded":"2024-05-07T11:17:50.321128+0000","last_fullsized":"2024-05-07T11:17:50.321128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'1","last_scrub_stamp":"2024-05-07T11:17:50.321000+0000","last_deep_scrub":"57'1","last_deep_scrub_stamp":"2024-05-07T11:17:50.321000+0000","last_clean_scrub_stamp":"2024-05-07T11:17:50.321000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:37:51.352461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"63'153","reported_seq":234,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.403635+0000","last_change":"2024-05-07T11:17:25.403221+0000","last_active":"2024-05-07T11:17:30.403635+0000","last_peered":"2024-05-07T11:17:30.403635+0000","last_clean":"2024-05-07T11:17:30.403635+0000","last_became_active":"2024-05-07T11:17:25.402661+0000","last_became_peered":"2024-05-07T11:17:25.402661+0000","last_unstale":"2024-05-07T11:17:30.403635+0000","last_undegraded":"2024-05-07T11:17:30.403635+0000","last_fullsized":"2024-05-07T11:17:30.403635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:56.295373+0000","last_change":"2024-05-07T11:17:56.295430+0000","last_active":"2024-05-07T11:17:56.295373+0000","last_peered":"2024-05-07T11:17:56.295373+0000","last_clean":"2024-05-07T11:17:56.295373+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:56.295373+0000","last_undegraded":"2024-05-07T11:17:56.295373+0000","last_fullsized":"2024-05-07T11:17:56.295373+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:56.295277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:56.295277+0000","last_clean_scrub_stamp":"2024-05-07T11:17:56.295277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:56:10.919183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"83'261","reported_seq":424,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:48.319698+0000","last_change":"2024-05-07T11:17:48.319731+0000","last_active":"2024-05-07T11:17:48.319698+0000","last_peered":"2024-05-07T11:17:48.319698+0000","last_clean":"2024-05-07T11:17:48.319698+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:48.319698+0000","last_undegraded":"2024-05-07T11:17:48.319698+0000","last_fullsized":"2024-05-07T11:17:48.319698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'261","last_scrub_stamp":"2024-05-07T11:17:48.319595+0000","last_deep_scrub":"83'261","last_deep_scrub_stamp":"2024-05-07T11:17:48.319595+0000","last_clean_scrub_stamp":"2024-05-07T11:17:48.319595+0000","objects_scrubbed":56,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:16.806230+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4","reported_seq":127,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.796038+0000","last_change":"2024-05-07T11:17:18.536818+0000","last_active":"2024-05-07T11:17:30.796038+0000","last_peered":"2024-05-07T11:17:30.796038+0000","last_clean":"2024-05-07T11:17:30.796038+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:17:30.796038+0000","last_undegraded":"2024-05-07T11:17:30.796038+0000","last_fullsized":"2024-05-07T11:17:30.796038+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"83'224","reported_seq":388,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:39.284980+0000","last_change":"2024-05-07T11:17:39.285014+0000","last_active":"2024-05-07T11:17:39.284980+0000","last_peered":"2024-05-07T11:17:39.284980+0000","last_clean":"2024-05-07T11:17:39.284980+0000","last_became_active":"2024-05-07T11:17:24.406337+0000","last_became_peered":"2024-05-07T11:17:24.406337+0000","last_unstale":"2024-05-07T11:17:39.284980+0000","last_undegraded":"2024-05-07T11:17:39.284980+0000","last_fullsized":"2024-05-07T11:17:39.284980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'224","last_scrub_stamp":"2024-05-07T11:17:39.284895+0000","last_deep_scrub":"83'224","last_deep_scrub_stamp":"2024-05-07T11:17:39.284895+0000","last_clean_scrub_stamp":"2024-05-07T11:17:39.284895+0000","objects_scrubbed":61,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:44.019329+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":280772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"83'6","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:55.293380+0000","last_change":"2024-05-07T11:17:55.293412+0000","last_active":"2024-05-07T11:17:55.293380+0000","last_peered":"2024-05-07T11:17:55.293380+0000","last_clean":"2024-05-07T11:17:55.293380+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:55.293380+0000","last_undegraded":"2024-05-07T11:17:55.293380+0000","last_fullsized":"2024-05-07T11:17:55.293380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'6","last_scrub_stamp":"2024-05-07T11:17:55.293289+0000","last_deep_scrub":"83'6","last_deep_scrub_stamp":"2024-05-07T11:17:55.293289+0000","last_clean_scrub_stamp":"2024-05-07T11:17:55.293289+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:58:33.636177+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"83'215","reported_seq":593,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:48.982412+0000","last_change":"2024-05-07T11:17:48.982459+0000","last_active":"2024-05-07T11:17:48.982412+0000","last_peered":"2024-05-07T11:17:48.982412+0000","last_clean":"2024-05-07T11:17:48.982412+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:48.982412+0000","last_undegraded":"2024-05-07T11:17:48.982412+0000","last_fullsized":"2024-05-07T11:17:48.982412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'215","last_scrub_stamp":"2024-05-07T11:17:48.982300+0000","last_deep_scrub":"83'215","last_deep_scrub_stamp":"2024-05-07T11:17:48.982300+0000","last_clean_scrub_stamp":"2024-05-07T11:17:48.982300+0000","objects_scrubbed":49,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:40.894671+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":173,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:38.943353+0000","last_change":"2024-05-07T11:17:18.407476+0000","last_active":"2024-05-07T11:17:38.943353+0000","last_peered":"2024-05-07T11:17:38.943353+0000","last_clean":"2024-05-07T11:17:38.943353+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:17:38.943353+0000","last_undegraded":"2024-05-07T11:17:38.943353+0000","last_fullsized":"2024-05-07T11:17:38.943353+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:38.943451+0000","last_change":"2024-05-07T11:17:30.407286+0000","last_active":"2024-05-07T11:17:38.943451+0000","last_peered":"2024-05-07T11:17:38.943451+0000","last_clean":"2024-05-07T11:17:38.943451+0000","last_became_active":"2024-05-07T11:17:30.406353+0000","last_became_peered":"2024-05-07T11:17:30.406353+0000","last_unstale":"2024-05-07T11:17:38.943451+0000","last_undegraded":"2024-05-07T11:17:38.943451+0000","last_fullsized":"2024-05-07T11:17:38.943451+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":124612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"57'45","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.795970+0000","last_change":"2024-05-07T11:17:18.498722+0000","last_active":"2024-05-07T11:17:30.795970+0000","last_peered":"2024-05-07T11:17:30.795970+0000","last_clean":"2024-05-07T11:17:30.795970+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:17:30.795970+0000","last_undegraded":"2024-05-07T11:17:30.795970+0000","last_fullsized":"2024-05-07T11:17:30.795970+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:42.024701+0000","last_clean_scrub_stamp":"2024-05-07T11:12:42.024701+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"83'232","reported_seq":395,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:40.266779+0000","last_change":"2024-05-07T11:17:40.266832+0000","last_active":"2024-05-07T11:17:40.266779+0000","last_peered":"2024-05-07T11:17:40.266779+0000","last_clean":"2024-05-07T11:17:40.266779+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:40.266779+0000","last_undegraded":"2024-05-07T11:17:40.266779+0000","last_fullsized":"2024-05-07T11:17:40.266779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'232","last_scrub_stamp":"2024-05-07T11:17:40.266666+0000","last_deep_scrub":"83'232","last_deep_scrub_stamp":"2024-05-07T11:17:40.266666+0000","last_clean_scrub_stamp":"2024-05-07T11:17:40.266666+0000","objects_scrubbed":63,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:36:06.762972+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"83'3","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:38.308033+0000","last_change":"2024-05-07T11:17:38.308072+0000","last_active":"2024-05-07T11:17:38.308033+0000","last_peered":"2024-05-07T11:17:38.308033+0000","last_clean":"2024-05-07T11:17:38.308033+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:38.308033+0000","last_undegraded":"2024-05-07T11:17:38.308033+0000","last_fullsized":"2024-05-07T11:17:38.308033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'3","last_scrub_stamp":"2024-05-07T11:17:38.307946+0000","last_deep_scrub":"83'3","last_deep_scrub_stamp":"2024-05-07T11:17:38.307946+0000","last_clean_scrub_stamp":"2024-05-07T11:17:38.307946+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:09:02.258964+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"83'261","reported_seq":688,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:44.054506+0000","last_change":"2024-05-07T11:17:44.054545+0000","last_active":"2024-05-07T11:17:44.054506+0000","last_peered":"2024-05-07T11:17:44.054506+0000","last_clean":"2024-05-07T11:17:44.054506+0000","last_became_active":"2024-05-07T11:17:25.401850+0000","last_became_peered":"2024-05-07T11:17:25.401850+0000","last_unstale":"2024-05-07T11:17:44.054506+0000","last_undegraded":"2024-05-07T11:17:44.054506+0000","last_fullsized":"2024-05-07T11:17:44.054506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'261","last_scrub_stamp":"2024-05-07T11:17:44.054428+0000","last_deep_scrub":"83'261","last_deep_scrub_stamp":"2024-05-07T11:17:44.054428+0000","last_clean_scrub_stamp":"2024-05-07T11:17:44.054428+0000","objects_scrubbed":62,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:40.345114+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"83'10","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.315142+0000","last_change":"2024-05-07T11:17:52.315175+0000","last_active":"2024-05-07T11:17:52.315142+0000","last_peered":"2024-05-07T11:17:52.315142+0000","last_clean":"2024-05-07T11:17:52.315142+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:52.315142+0000","last_undegraded":"2024-05-07T11:17:52.315142+0000","last_fullsized":"2024-05-07T11:17:52.315142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'10","last_scrub_stamp":"2024-05-07T11:17:52.315033+0000","last_deep_scrub":"83'10","last_deep_scrub_stamp":"2024-05-07T11:17:52.315033+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.315033+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:36:16.621480+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5805,"num_bytes_recovered":19428989,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64405504,"data_stored":53099596,"data_compressed":4611280,"data_compressed_allocated":5402624,"data_compressed_original":14118912,"omap_allocated":0,"internal_metadata":0},"log_size":12434,"ondisk_log_size":12434,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":443,"ondisk_log_size":443,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88320,"kb_used_data":30776,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94283520,"statfs":{"total":96636764160,"available":96546324480,"internally_reserved":0,"allocated":31514624,"data_stored":54276063,"data_compressed":6326260,"data_compressed_allocated":7593984,"data_compressed_original":37191680,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710730,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63132,"kb_used_data":23060,"kb_used_omap":10,"kb_used_meta":40053,"kb_avail":94308708,"statfs":{"total":96636764160,"available":96572116992,"internally_reserved":0,"allocated":23613440,"data_stored":43695842,"data_compressed":5536379,"data_compressed_allocated":6516736,"data_compressed_original":33533952,"omap_allocated":10404,"internal_metadata":41015132},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54124,"kb_used_data":27108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94317716,"statfs":{"total":96636764160,"available":96581341184,"internally_reserved":0,"allocated":27758592,"data_stored":40411961,"data_compressed":4972494,"data_compressed_allocated":5840896,"data_compressed_original":25952256,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22953984,"data_stored":19509974,"data_compressed":1953035,"data_compressed_allocated":2265088,"data_compressed_original":5890048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17506304,"data_stored":13389680,"data_compressed":1088810,"data_compressed_allocated":1314816,"data_compressed_original":3727360,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23945216,"data_stored":20199942,"data_compressed":1569435,"data_compressed_allocated":1822720,"data_compressed_original":4501504,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:17:59.639 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.640 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.640 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.640 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.640 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.640 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.641 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.641 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.641 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.641 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.641 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.641 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.642 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.642 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.642 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.642 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.642 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.643 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.643 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.643 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.643 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.643 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.643 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.644 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.644 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.644 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.644 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.644 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.645 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.645 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.645 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.645 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.645 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.645 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.646 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.646 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.646 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-07T11:12:37.690802+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=37, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.646 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.646 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.647 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.647 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.647 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.647 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.647 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.647 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.648 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.648 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.648 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.649 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-07T11:12:42.024701+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=42, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:17:59.649 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T11:18:19.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:18:19.967 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:18:19.968 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:18:19.977 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-05-07T11:18:19.025845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5827,"num_bytes_recovered":56847285,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14321,"ondisk_log_size":14321,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":227784,"kb_used_data":80944,"kb_used_omap":13,"kb_used_meta":146802,"kb_avail":282887736,"statfs":{"total":289910292480,"available":289677041664,"internally_reserved":0,"allocated":82886656,"data_stored":138383866,"data_compressed":16835133,"data_compressed_allocated":19951616,"data_compressed_original":96677888,"omap_allocated":13594,"internal_metadata":150325990},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002949"},"pg_stats":[{"pgid":"4.3f","version":"83'217","reported_seq":375,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:06.514131+0000","last_change":"2024-05-07T11:18:06.514160+0000","last_active":"2024-05-07T11:18:06.514131+0000","last_peered":"2024-05-07T11:18:06.514131+0000","last_clean":"2024-05-07T11:18:06.514131+0000","last_became_active":"2024-05-07T11:17:27.407668+0000","last_became_peered":"2024-05-07T11:17:27.407668+0000","last_unstale":"2024-05-07T11:18:06.514131+0000","last_undegraded":"2024-05-07T11:18:06.514131+0000","last_fullsized":"2024-05-07T11:18:06.514131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'217","last_scrub_stamp":"2024-05-07T11:18:06.514052+0000","last_deep_scrub":"83'217","last_deep_scrub_stamp":"2024-05-07T11:18:06.514052+0000","last_clean_scrub_stamp":"2024-05-07T11:18:06.514052+0000","objects_scrubbed":54,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:47.984157+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":85925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"83'201","reported_seq":365,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:41.201485+0000","last_change":"2024-05-07T11:17:41.201530+0000","last_active":"2024-05-07T11:17:41.201485+0000","last_peered":"2024-05-07T11:17:41.201485+0000","last_clean":"2024-05-07T11:17:41.201485+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:41.201485+0000","last_undegraded":"2024-05-07T11:17:41.201485+0000","last_fullsized":"2024-05-07T11:17:41.201485+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:41.201407+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:41.201407+0000","last_clean_scrub_stamp":"2024-05-07T11:17:41.201407+0000","objects_scrubbed":46,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:10.995764+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"83'214","reported_seq":572,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:41.066480+0000","last_change":"2024-05-07T11:17:41.066533+0000","last_active":"2024-05-07T11:17:41.066480+0000","last_peered":"2024-05-07T11:17:41.066480+0000","last_clean":"2024-05-07T11:17:41.066480+0000","last_became_active":"2024-05-07T11:17:26.407269+0000","last_became_peered":"2024-05-07T11:17:26.407269+0000","last_unstale":"2024-05-07T11:17:41.066480+0000","last_undegraded":"2024-05-07T11:17:41.066480+0000","last_fullsized":"2024-05-07T11:17:41.066480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'214","last_scrub_stamp":"2024-05-07T11:17:41.066386+0000","last_deep_scrub":"83'214","last_deep_scrub_stamp":"2024-05-07T11:17:41.066386+0000","last_clean_scrub_stamp":"2024-05-07T11:17:41.066386+0000","objects_scrubbed":45,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:36:14.974872+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":75254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"83'175","reported_seq":333,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:07.178837+0000","last_change":"2024-05-07T11:18:07.178895+0000","last_active":"2024-05-07T11:18:07.178837+0000","last_peered":"2024-05-07T11:18:07.178837+0000","last_clean":"2024-05-07T11:18:07.178837+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:18:07.178837+0000","last_undegraded":"2024-05-07T11:18:07.178837+0000","last_fullsized":"2024-05-07T11:18:07.178837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'175","last_scrub_stamp":"2024-05-07T11:18:07.178757+0000","last_deep_scrub":"83'175","last_deep_scrub_stamp":"2024-05-07T11:18:07.178757+0000","last_clean_scrub_stamp":"2024-05-07T11:18:07.178757+0000","objects_scrubbed":49,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:46:56.545274+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"83'247","reported_seq":412,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:45.223435+0000","last_change":"2024-05-07T11:17:45.223468+0000","last_active":"2024-05-07T11:17:45.223435+0000","last_peered":"2024-05-07T11:17:45.223435+0000","last_clean":"2024-05-07T11:17:45.223435+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:45.223435+0000","last_undegraded":"2024-05-07T11:17:45.223435+0000","last_fullsized":"2024-05-07T11:17:45.223435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'247","last_scrub_stamp":"2024-05-07T11:17:45.223358+0000","last_deep_scrub":"83'247","last_deep_scrub_stamp":"2024-05-07T11:17:45.223358+0000","last_clean_scrub_stamp":"2024-05-07T11:17:45.223358+0000","objects_scrubbed":61,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:00:54.386592+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'176","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:38.943709+0000","last_change":"2024-05-07T11:17:30.406178+0000","last_active":"2024-05-07T11:17:38.943709+0000","last_peered":"2024-05-07T11:17:38.943709+0000","last_clean":"2024-05-07T11:17:38.943709+0000","last_became_active":"2024-05-07T11:17:30.405536+0000","last_became_peered":"2024-05-07T11:17:30.405536+0000","last_unstale":"2024-05-07T11:17:38.943709+0000","last_undegraded":"2024-05-07T11:17:38.943709+0000","last_fullsized":"2024-05-07T11:17:38.943709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":529421,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"83'228","reported_seq":342,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.985885+0000","last_change":"2024-05-07T11:17:47.985926+0000","last_active":"2024-05-07T11:17:47.985885+0000","last_peered":"2024-05-07T11:17:47.985885+0000","last_clean":"2024-05-07T11:17:47.985885+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:47.985885+0000","last_undegraded":"2024-05-07T11:17:47.985885+0000","last_fullsized":"2024-05-07T11:17:47.985885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'228","last_scrub_stamp":"2024-05-07T11:17:47.985809+0000","last_deep_scrub":"83'228","last_deep_scrub_stamp":"2024-05-07T11:17:47.985809+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.985809+0000","objects_scrubbed":62,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:36:21.119192+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"83'178","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:02.156070+0000","last_change":"2024-05-07T11:18:02.156144+0000","last_active":"2024-05-07T11:18:02.156070+0000","last_peered":"2024-05-07T11:18:02.156070+0000","last_clean":"2024-05-07T11:18:02.156070+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:18:02.156070+0000","last_undegraded":"2024-05-07T11:18:02.156070+0000","last_fullsized":"2024-05-07T11:18:02.156070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'178","last_scrub_stamp":"2024-05-07T11:18:02.155981+0000","last_deep_scrub":"83'178","last_deep_scrub_stamp":"2024-05-07T11:18:02.155981+0000","last_clean_scrub_stamp":"2024-05-07T11:18:02.155981+0000","objects_scrubbed":46,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:50.815606+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"83'226","reported_seq":315,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:08.254460+0000","last_change":"2024-05-07T11:18:08.254487+0000","last_active":"2024-05-07T11:18:08.254460+0000","last_peered":"2024-05-07T11:18:08.254460+0000","last_clean":"2024-05-07T11:18:08.254460+0000","last_became_active":"2024-05-07T11:17:27.408650+0000","last_became_peered":"2024-05-07T11:17:27.408650+0000","last_unstale":"2024-05-07T11:18:08.254460+0000","last_undegraded":"2024-05-07T11:18:08.254460+0000","last_fullsized":"2024-05-07T11:18:08.254460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'226","last_scrub_stamp":"2024-05-07T11:18:08.254384+0000","last_deep_scrub":"83'226","last_deep_scrub_stamp":"2024-05-07T11:18:08.254384+0000","last_clean_scrub_stamp":"2024-05-07T11:18:08.254384+0000","objects_scrubbed":55,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:29.929876+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":631133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"83'201","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:44.203197+0000","last_change":"2024-05-07T11:17:44.203242+0000","last_active":"2024-05-07T11:17:44.203197+0000","last_peered":"2024-05-07T11:17:44.203197+0000","last_clean":"2024-05-07T11:17:44.203197+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:44.203197+0000","last_undegraded":"2024-05-07T11:17:44.203197+0000","last_fullsized":"2024-05-07T11:17:44.203197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:44.203102+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:44.203102+0000","last_clean_scrub_stamp":"2024-05-07T11:17:44.203102+0000","objects_scrubbed":45,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:39:20.413250+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"83'213","reported_seq":522,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.053940+0000","last_change":"2024-05-07T11:17:52.053975+0000","last_active":"2024-05-07T11:17:52.053940+0000","last_peered":"2024-05-07T11:17:52.053940+0000","last_clean":"2024-05-07T11:17:52.053940+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:52.053940+0000","last_undegraded":"2024-05-07T11:17:52.053940+0000","last_fullsized":"2024-05-07T11:17:52.053940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'213","last_scrub_stamp":"2024-05-07T11:17:52.053862+0000","last_deep_scrub":"83'213","last_deep_scrub_stamp":"2024-05-07T11:17:52.053862+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.053862+0000","objects_scrubbed":59,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:34:34.769997+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"83'193","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:08.613240+0000","last_change":"2024-05-07T11:18:08.613267+0000","last_active":"2024-05-07T11:18:08.613240+0000","last_peered":"2024-05-07T11:18:08.613240+0000","last_clean":"2024-05-07T11:18:08.613240+0000","last_became_active":"2024-05-07T11:17:28.403770+0000","last_became_peered":"2024-05-07T11:17:28.403770+0000","last_unstale":"2024-05-07T11:18:08.613240+0000","last_undegraded":"2024-05-07T11:18:08.613240+0000","last_fullsized":"2024-05-07T11:18:08.613240+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'193","last_scrub_stamp":"2024-05-07T11:18:08.613153+0000","last_deep_scrub":"83'193","last_deep_scrub_stamp":"2024-05-07T11:18:08.613153+0000","last_clean_scrub_stamp":"2024-05-07T11:18:08.613153+0000","objects_scrubbed":53,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:03.299333+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":89602,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"83'187","reported_seq":353,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:50.303808+0000","last_change":"2024-05-07T11:17:50.303836+0000","last_active":"2024-05-07T11:17:50.303808+0000","last_peered":"2024-05-07T11:17:50.303808+0000","last_clean":"2024-05-07T11:17:50.303808+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:50.303808+0000","last_undegraded":"2024-05-07T11:17:50.303808+0000","last_fullsized":"2024-05-07T11:17:50.303808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'187","last_scrub_stamp":"2024-05-07T11:17:50.303719+0000","last_deep_scrub":"83'187","last_deep_scrub_stamp":"2024-05-07T11:17:50.303719+0000","last_clean_scrub_stamp":"2024-05-07T11:17:50.303719+0000","objects_scrubbed":51,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:14:41.226878+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"83'222","reported_seq":590,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:43.081883+0000","last_change":"2024-05-07T11:17:43.081932+0000","last_active":"2024-05-07T11:17:43.081883+0000","last_peered":"2024-05-07T11:17:43.081883+0000","last_clean":"2024-05-07T11:17:43.081883+0000","last_became_active":"2024-05-07T11:17:26.407342+0000","last_became_peered":"2024-05-07T11:17:26.407342+0000","last_unstale":"2024-05-07T11:17:43.081883+0000","last_undegraded":"2024-05-07T11:17:43.081883+0000","last_fullsized":"2024-05-07T11:17:43.081883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'222","last_scrub_stamp":"2024-05-07T11:17:43.081787+0000","last_deep_scrub":"83'222","last_deep_scrub_stamp":"2024-05-07T11:17:43.081787+0000","last_clean_scrub_stamp":"2024-05-07T11:17:43.081787+0000","objects_scrubbed":47,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:36.906648+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":196945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"83'214","reported_seq":585,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:12.069461+0000","last_change":"2024-05-07T11:18:12.069503+0000","last_active":"2024-05-07T11:18:12.069461+0000","last_peered":"2024-05-07T11:18:12.069461+0000","last_clean":"2024-05-07T11:18:12.069461+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:18:12.069461+0000","last_undegraded":"2024-05-07T11:18:12.069461+0000","last_fullsized":"2024-05-07T11:18:12.069461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'214","last_scrub_stamp":"2024-05-07T11:18:12.069380+0000","last_deep_scrub":"83'214","last_deep_scrub_stamp":"2024-05-07T11:18:12.069380+0000","last_clean_scrub_stamp":"2024-05-07T11:18:12.069380+0000","objects_scrubbed":43,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:07.947475+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'178","reported_seq":502,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:30.407524+0000","last_change":"2024-05-07T11:17:30.406594+0000","last_active":"2024-05-07T11:17:30.407524+0000","last_peered":"2024-05-07T11:17:30.407524+0000","last_clean":"2024-05-07T11:17:30.407524+0000","last_became_active":"2024-05-07T11:17:30.405896+0000","last_became_peered":"2024-05-07T11:17:30.405896+0000","last_unstale":"2024-05-07T11:17:30.407524+0000","last_undegraded":"2024-05-07T11:17:30.407524+0000","last_fullsized":"2024-05-07T11:17:30.407524+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4343464,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"83'210","reported_seq":574,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:49.314556+0000","last_change":"2024-05-07T11:17:49.314602+0000","last_active":"2024-05-07T11:17:49.314556+0000","last_peered":"2024-05-07T11:17:49.314556+0000","last_clean":"2024-05-07T11:17:49.314556+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:49.314556+0000","last_undegraded":"2024-05-07T11:17:49.314556+0000","last_fullsized":"2024-05-07T11:17:49.314556+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'210","last_scrub_stamp":"2024-05-07T11:17:49.314458+0000","last_deep_scrub":"83'210","last_deep_scrub_stamp":"2024-05-07T11:17:49.314458+0000","last_clean_scrub_stamp":"2024-05-07T11:17:49.314458+0000","objects_scrubbed":49,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:02.141295+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"83'202","reported_seq":367,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:49.285042+0000","last_change":"2024-05-07T11:17:49.285099+0000","last_active":"2024-05-07T11:17:49.285042+0000","last_peered":"2024-05-07T11:17:49.285042+0000","last_clean":"2024-05-07T11:17:49.285042+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:49.285042+0000","last_undegraded":"2024-05-07T11:17:49.285042+0000","last_fullsized":"2024-05-07T11:17:49.285042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'202","last_scrub_stamp":"2024-05-07T11:17:49.284941+0000","last_deep_scrub":"83'202","last_deep_scrub_stamp":"2024-05-07T11:17:49.284941+0000","last_clean_scrub_stamp":"2024-05-07T11:17:49.284941+0000","objects_scrubbed":54,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:06:24.534977+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"83'201","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:39.333162+0000","last_change":"2024-05-07T11:17:39.333214+0000","last_active":"2024-05-07T11:17:39.333162+0000","last_peered":"2024-05-07T11:17:39.333162+0000","last_clean":"2024-05-07T11:17:39.333162+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:39.333162+0000","last_undegraded":"2024-05-07T11:17:39.333162+0000","last_fullsized":"2024-05-07T11:17:39.333162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:39.333074+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:39.333074+0000","last_clean_scrub_stamp":"2024-05-07T11:17:39.333074+0000","objects_scrubbed":54,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:32.756865+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"83'235","reported_seq":634,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:14.124646+0000","last_change":"2024-05-07T11:18:14.124673+0000","last_active":"2024-05-07T11:18:14.124646+0000","last_peered":"2024-05-07T11:18:14.124646+0000","last_clean":"2024-05-07T11:18:14.124646+0000","last_became_active":"2024-05-07T11:17:29.407032+0000","last_became_peered":"2024-05-07T11:17:29.407032+0000","last_unstale":"2024-05-07T11:18:14.124646+0000","last_undegraded":"2024-05-07T11:18:14.124646+0000","last_fullsized":"2024-05-07T11:18:14.124646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'235","last_scrub_stamp":"2024-05-07T11:18:14.124569+0000","last_deep_scrub":"83'235","last_deep_scrub_stamp":"2024-05-07T11:18:14.124569+0000","last_clean_scrub_stamp":"2024-05-07T11:18:14.124569+0000","objects_scrubbed":50,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:55:30.521564+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":98139,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"83'211","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:08.136289+0000","last_change":"2024-05-07T11:18:08.136345+0000","last_active":"2024-05-07T11:18:08.136289+0000","last_peered":"2024-05-07T11:18:08.136289+0000","last_clean":"2024-05-07T11:18:08.136289+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:18:08.136289+0000","last_undegraded":"2024-05-07T11:18:08.136289+0000","last_fullsized":"2024-05-07T11:18:08.136289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'211","last_scrub_stamp":"2024-05-07T11:18:08.136181+0000","last_deep_scrub":"83'211","last_deep_scrub_stamp":"2024-05-07T11:18:08.136181+0000","last_clean_scrub_stamp":"2024-05-07T11:18:08.136181+0000","objects_scrubbed":54,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:58:53.256733+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"83'229","reported_seq":378,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:09.573333+0000","last_change":"2024-05-07T11:18:09.573379+0000","last_active":"2024-05-07T11:18:09.573333+0000","last_peered":"2024-05-07T11:18:09.573333+0000","last_clean":"2024-05-07T11:18:09.573333+0000","last_became_active":"2024-05-07T11:17:29.407294+0000","last_became_peered":"2024-05-07T11:17:29.407294+0000","last_unstale":"2024-05-07T11:18:09.573333+0000","last_undegraded":"2024-05-07T11:18:09.573333+0000","last_fullsized":"2024-05-07T11:18:09.573333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'229","last_scrub_stamp":"2024-05-07T11:18:09.573249+0000","last_deep_scrub":"83'229","last_deep_scrub_stamp":"2024-05-07T11:18:09.573249+0000","last_clean_scrub_stamp":"2024-05-07T11:18:09.573249+0000","objects_scrubbed":64,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:56:26.772632+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":116557,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"83'210","reported_seq":309,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:41.259211+0000","last_change":"2024-05-07T11:17:41.259241+0000","last_active":"2024-05-07T11:17:41.259211+0000","last_peered":"2024-05-07T11:17:41.259211+0000","last_clean":"2024-05-07T11:17:41.259211+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:41.259211+0000","last_undegraded":"2024-05-07T11:17:41.259211+0000","last_fullsized":"2024-05-07T11:17:41.259211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'210","last_scrub_stamp":"2024-05-07T11:17:41.259122+0000","last_deep_scrub":"83'210","last_deep_scrub_stamp":"2024-05-07T11:17:41.259122+0000","last_clean_scrub_stamp":"2024-05-07T11:17:41.259122+0000","objects_scrubbed":51,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:06:52.200929+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"83'217","reported_seq":381,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:51.266223+0000","last_change":"2024-05-07T11:17:51.266265+0000","last_active":"2024-05-07T11:17:51.266223+0000","last_peered":"2024-05-07T11:17:51.266223+0000","last_clean":"2024-05-07T11:17:51.266223+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:51.266223+0000","last_undegraded":"2024-05-07T11:17:51.266223+0000","last_fullsized":"2024-05-07T11:17:51.266223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'217","last_scrub_stamp":"2024-05-07T11:17:51.266142+0000","last_deep_scrub":"83'217","last_deep_scrub_stamp":"2024-05-07T11:17:51.266142+0000","last_clean_scrub_stamp":"2024-05-07T11:17:51.266142+0000","objects_scrubbed":48,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:50:26.027402+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"83'218","reported_seq":377,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:04.460342+0000","last_change":"2024-05-07T11:18:04.460378+0000","last_active":"2024-05-07T11:18:04.460342+0000","last_peered":"2024-05-07T11:18:04.460342+0000","last_clean":"2024-05-07T11:18:04.460342+0000","last_became_active":"2024-05-07T11:17:24.406307+0000","last_became_peered":"2024-05-07T11:17:24.406307+0000","last_unstale":"2024-05-07T11:18:04.460342+0000","last_undegraded":"2024-05-07T11:18:04.460342+0000","last_fullsized":"2024-05-07T11:18:04.460342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'218","last_scrub_stamp":"2024-05-07T11:18:04.460265+0000","last_deep_scrub":"83'218","last_deep_scrub_stamp":"2024-05-07T11:18:04.460265+0000","last_clean_scrub_stamp":"2024-05-07T11:18:04.460265+0000","objects_scrubbed":64,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:15:14.365494+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":230897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"83'250","reported_seq":411,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:54.347620+0000","last_change":"2024-05-07T11:17:54.347648+0000","last_active":"2024-05-07T11:17:54.347620+0000","last_peered":"2024-05-07T11:17:54.347620+0000","last_clean":"2024-05-07T11:17:54.347620+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:54.347620+0000","last_undegraded":"2024-05-07T11:17:54.347620+0000","last_fullsized":"2024-05-07T11:17:54.347620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'250","last_scrub_stamp":"2024-05-07T11:17:54.347547+0000","last_deep_scrub":"83'250","last_deep_scrub_stamp":"2024-05-07T11:17:54.347547+0000","last_clean_scrub_stamp":"2024-05-07T11:17:54.347547+0000","objects_scrubbed":55,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:22:30.438020+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"83'199","reported_seq":530,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:16.170343+0000","last_change":"2024-05-07T11:18:16.170385+0000","last_active":"2024-05-07T11:18:16.170343+0000","last_peered":"2024-05-07T11:18:16.170343+0000","last_clean":"2024-05-07T11:18:16.170343+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:18:16.170343+0000","last_undegraded":"2024-05-07T11:18:16.170343+0000","last_fullsized":"2024-05-07T11:18:16.170343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'199","last_scrub_stamp":"2024-05-07T11:18:16.170242+0000","last_deep_scrub":"83'199","last_deep_scrub_stamp":"2024-05-07T11:18:16.170242+0000","last_clean_scrub_stamp":"2024-05-07T11:18:16.170242+0000","objects_scrubbed":47,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:50.569705+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":67681,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"83'195","reported_seq":345,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:07.555692+0000","last_change":"2024-05-07T11:18:07.555793+0000","last_active":"2024-05-07T11:18:07.555692+0000","last_peered":"2024-05-07T11:18:07.555692+0000","last_clean":"2024-05-07T11:18:07.555692+0000","last_became_active":"2024-05-07T11:17:28.403782+0000","last_became_peered":"2024-05-07T11:17:28.403782+0000","last_unstale":"2024-05-07T11:18:07.555692+0000","last_undegraded":"2024-05-07T11:18:07.555692+0000","last_fullsized":"2024-05-07T11:18:07.555692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'195","last_scrub_stamp":"2024-05-07T11:18:07.555591+0000","last_deep_scrub":"83'195","last_deep_scrub_stamp":"2024-05-07T11:18:07.555591+0000","last_clean_scrub_stamp":"2024-05-07T11:18:07.555591+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:08.558392+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":211687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"83'221","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:02.318600+0000","last_change":"2024-05-07T11:18:02.318630+0000","last_active":"2024-05-07T11:18:02.318600+0000","last_peered":"2024-05-07T11:18:02.318600+0000","last_clean":"2024-05-07T11:18:02.318600+0000","last_became_active":"2024-05-07T11:17:24.403179+0000","last_became_peered":"2024-05-07T11:17:24.403179+0000","last_unstale":"2024-05-07T11:18:02.318600+0000","last_undegraded":"2024-05-07T11:18:02.318600+0000","last_fullsized":"2024-05-07T11:18:02.318600+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'221","last_scrub_stamp":"2024-05-07T11:18:02.318520+0000","last_deep_scrub":"83'221","last_deep_scrub_stamp":"2024-05-07T11:18:02.318520+0000","last_clean_scrub_stamp":"2024-05-07T11:18:02.318520+0000","objects_scrubbed":58,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:07.362323+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"83'253","reported_seq":402,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:11.519687+0000","last_change":"2024-05-07T11:18:11.519728+0000","last_active":"2024-05-07T11:18:11.519687+0000","last_peered":"2024-05-07T11:18:11.519687+0000","last_clean":"2024-05-07T11:18:11.519687+0000","last_became_active":"2024-05-07T11:17:29.408425+0000","last_became_peered":"2024-05-07T11:17:29.408425+0000","last_unstale":"2024-05-07T11:18:11.519687+0000","last_undegraded":"2024-05-07T11:18:11.519687+0000","last_fullsized":"2024-05-07T11:18:11.519687+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'253","last_scrub_stamp":"2024-05-07T11:18:11.519608+0000","last_deep_scrub":"83'253","last_deep_scrub_stamp":"2024-05-07T11:18:11.519608+0000","last_clean_scrub_stamp":"2024-05-07T11:18:11.519608+0000","objects_scrubbed":68,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:25.920931+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":86167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"83'258","reported_seq":663,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.332086+0000","last_change":"2024-05-07T11:17:47.332120+0000","last_active":"2024-05-07T11:17:47.332086+0000","last_peered":"2024-05-07T11:17:47.332086+0000","last_clean":"2024-05-07T11:17:47.332086+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:47.332086+0000","last_undegraded":"2024-05-07T11:17:47.332086+0000","last_fullsized":"2024-05-07T11:17:47.332086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'258","last_scrub_stamp":"2024-05-07T11:17:47.331997+0000","last_deep_scrub":"83'258","last_deep_scrub_stamp":"2024-05-07T11:17:47.331997+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.331997+0000","objects_scrubbed":66,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:56.524621+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"83'241","reported_seq":648,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:42.102161+0000","last_change":"2024-05-07T11:17:42.102193+0000","last_active":"2024-05-07T11:17:42.102161+0000","last_peered":"2024-05-07T11:17:42.102161+0000","last_clean":"2024-05-07T11:17:42.102161+0000","last_became_active":"2024-05-07T11:17:28.398801+0000","last_became_peered":"2024-05-07T11:17:28.398801+0000","last_unstale":"2024-05-07T11:17:42.102161+0000","last_undegraded":"2024-05-07T11:17:42.102161+0000","last_fullsized":"2024-05-07T11:17:42.102161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'241","last_scrub_stamp":"2024-05-07T11:17:42.102072+0000","last_deep_scrub":"83'241","last_deep_scrub_stamp":"2024-05-07T11:17:42.102072+0000","last_clean_scrub_stamp":"2024-05-07T11:17:42.102072+0000","objects_scrubbed":56,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:41:31.485222+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":459999,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"83'201","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:42.201299+0000","last_change":"2024-05-07T11:17:42.201378+0000","last_active":"2024-05-07T11:17:42.201299+0000","last_peered":"2024-05-07T11:17:42.201299+0000","last_clean":"2024-05-07T11:17:42.201299+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:42.201299+0000","last_undegraded":"2024-05-07T11:17:42.201299+0000","last_fullsized":"2024-05-07T11:17:42.201299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:42.201182+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:42.201182+0000","last_clean_scrub_stamp":"2024-05-07T11:17:42.201182+0000","objects_scrubbed":45,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:36:38.491438+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"83'130","reported_seq":289,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:05.175847+0000","last_change":"2024-05-07T11:18:05.175908+0000","last_active":"2024-05-07T11:18:05.175847+0000","last_peered":"2024-05-07T11:18:05.175847+0000","last_clean":"2024-05-07T11:18:05.175847+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:18:05.175847+0000","last_undegraded":"2024-05-07T11:18:05.175847+0000","last_fullsized":"2024-05-07T11:18:05.175847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'130","last_scrub_stamp":"2024-05-07T11:18:05.175737+0000","last_deep_scrub":"83'130","last_deep_scrub_stamp":"2024-05-07T11:18:05.175737+0000","last_clean_scrub_stamp":"2024-05-07T11:18:05.175737+0000","objects_scrubbed":3,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:13:21.691125+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"83'186","reported_seq":350,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:43.155008+0000","last_change":"2024-05-07T11:17:43.155072+0000","last_active":"2024-05-07T11:17:43.155008+0000","last_peered":"2024-05-07T11:17:43.155008+0000","last_clean":"2024-05-07T11:17:43.155008+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:43.155008+0000","last_undegraded":"2024-05-07T11:17:43.155008+0000","last_fullsized":"2024-05-07T11:17:43.155008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'186","last_scrub_stamp":"2024-05-07T11:17:43.154922+0000","last_deep_scrub":"83'186","last_deep_scrub_stamp":"2024-05-07T11:17:43.154922+0000","last_clean_scrub_stamp":"2024-05-07T11:17:43.154922+0000","objects_scrubbed":45,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:58:38.318679+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:58.311017+0000","last_change":"2024-05-07T11:17:58.311068+0000","last_active":"2024-05-07T11:17:58.311017+0000","last_peered":"2024-05-07T11:17:58.311017+0000","last_clean":"2024-05-07T11:17:58.311017+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:58.311017+0000","last_undegraded":"2024-05-07T11:17:58.311017+0000","last_fullsized":"2024-05-07T11:17:58.311017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:58.310920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:58.310920+0000","last_clean_scrub_stamp":"2024-05-07T11:17:58.310920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:48.856280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"83'238","reported_seq":337,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:43.328522+0000","last_change":"2024-05-07T11:17:43.328557+0000","last_active":"2024-05-07T11:17:43.328522+0000","last_peered":"2024-05-07T11:17:43.328522+0000","last_clean":"2024-05-07T11:17:43.328522+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:43.328522+0000","last_undegraded":"2024-05-07T11:17:43.328522+0000","last_fullsized":"2024-05-07T11:17:43.328522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'238","last_scrub_stamp":"2024-05-07T11:17:43.328425+0000","last_deep_scrub":"83'238","last_deep_scrub_stamp":"2024-05-07T11:17:43.328425+0000","last_clean_scrub_stamp":"2024-05-07T11:17:43.328425+0000","objects_scrubbed":59,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:16:14.596154+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:56.323986+0000","last_change":"2024-05-07T11:17:56.324016+0000","last_active":"2024-05-07T11:17:56.323986+0000","last_peered":"2024-05-07T11:17:56.323986+0000","last_clean":"2024-05-07T11:17:56.323986+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:56.323986+0000","last_undegraded":"2024-05-07T11:17:56.323986+0000","last_fullsized":"2024-05-07T11:17:56.323986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:56.323896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:56.323896+0000","last_clean_scrub_stamp":"2024-05-07T11:17:56.323896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:32:35.546889+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"83'208","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:01.279143+0000","last_change":"2024-05-07T11:18:01.279189+0000","last_active":"2024-05-07T11:18:01.279143+0000","last_peered":"2024-05-07T11:18:01.279143+0000","last_clean":"2024-05-07T11:18:01.279143+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:18:01.279143+0000","last_undegraded":"2024-05-07T11:18:01.279143+0000","last_fullsized":"2024-05-07T11:18:01.279143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'208","last_scrub_stamp":"2024-05-07T11:18:01.279059+0000","last_deep_scrub":"83'208","last_deep_scrub_stamp":"2024-05-07T11:18:01.279059+0000","last_clean_scrub_stamp":"2024-05-07T11:18:01.279059+0000","objects_scrubbed":49,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:37.207758+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"83'12","reported_seq":178,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:55.005124+0000","last_change":"2024-05-07T11:17:55.005157+0000","last_active":"2024-05-07T11:17:55.005124+0000","last_peered":"2024-05-07T11:17:55.005124+0000","last_clean":"2024-05-07T11:17:55.005124+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:55.005124+0000","last_undegraded":"2024-05-07T11:17:55.005124+0000","last_fullsized":"2024-05-07T11:17:55.005124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'12","last_scrub_stamp":"2024-05-07T11:17:55.005031+0000","last_deep_scrub":"83'12","last_deep_scrub_stamp":"2024-05-07T11:17:55.005031+0000","last_clean_scrub_stamp":"2024-05-07T11:17:55.005031+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:38.264791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"83'3","reported_seq":170,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:11.035873+0000","last_change":"2024-05-07T11:18:11.035899+0000","last_active":"2024-05-07T11:18:11.035873+0000","last_peered":"2024-05-07T11:18:11.035873+0000","last_clean":"2024-05-07T11:18:11.035873+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:18:11.035873+0000","last_undegraded":"2024-05-07T11:18:11.035873+0000","last_fullsized":"2024-05-07T11:18:11.035873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'3","last_scrub_stamp":"2024-05-07T11:18:11.035779+0000","last_deep_scrub":"83'3","last_deep_scrub_stamp":"2024-05-07T11:18:11.035779+0000","last_clean_scrub_stamp":"2024-05-07T11:18:11.035779+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:32.317126+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"83'212","reported_seq":503,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:40.119928+0000","last_change":"2024-05-07T11:17:40.119960+0000","last_active":"2024-05-07T11:17:40.119928+0000","last_peered":"2024-05-07T11:17:40.119928+0000","last_clean":"2024-05-07T11:17:40.119928+0000","last_became_active":"2024-05-07T11:17:27.403866+0000","last_became_peered":"2024-05-07T11:17:27.403866+0000","last_unstale":"2024-05-07T11:17:40.119928+0000","last_undegraded":"2024-05-07T11:17:40.119928+0000","last_fullsized":"2024-05-07T11:17:40.119928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'212","last_scrub_stamp":"2024-05-07T11:17:40.119827+0000","last_deep_scrub":"83'212","last_deep_scrub_stamp":"2024-05-07T11:17:40.119827+0000","last_clean_scrub_stamp":"2024-05-07T11:17:40.119827+0000","objects_scrubbed":57,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:28:51.573724+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":166862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"83'4","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:00.330469+0000","last_change":"2024-05-07T11:18:00.330496+0000","last_active":"2024-05-07T11:18:00.330469+0000","last_peered":"2024-05-07T11:18:00.330469+0000","last_clean":"2024-05-07T11:18:00.330469+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:18:00.330469+0000","last_undegraded":"2024-05-07T11:18:00.330469+0000","last_fullsized":"2024-05-07T11:18:00.330469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'4","last_scrub_stamp":"2024-05-07T11:18:00.330384+0000","last_deep_scrub":"83'4","last_deep_scrub_stamp":"2024-05-07T11:18:00.330384+0000","last_clean_scrub_stamp":"2024-05-07T11:18:00.330384+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:28:20.417675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"83'221","reported_seq":387,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.273587+0000","last_change":"2024-05-07T11:17:47.273619+0000","last_active":"2024-05-07T11:17:47.273587+0000","last_peered":"2024-05-07T11:17:47.273587+0000","last_clean":"2024-05-07T11:17:47.273587+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:47.273587+0000","last_undegraded":"2024-05-07T11:17:47.273587+0000","last_fullsized":"2024-05-07T11:17:47.273587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'221","last_scrub_stamp":"2024-05-07T11:17:47.273504+0000","last_deep_scrub":"83'221","last_deep_scrub_stamp":"2024-05-07T11:17:47.273504+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.273504+0000","objects_scrubbed":54,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:32:07.829004+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"83'2","reported_seq":104,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:49.987444+0000","last_change":"2024-05-07T11:17:49.987471+0000","last_active":"2024-05-07T11:17:49.987444+0000","last_peered":"2024-05-07T11:17:49.987444+0000","last_clean":"2024-05-07T11:17:49.987444+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:49.987444+0000","last_undegraded":"2024-05-07T11:17:49.987444+0000","last_fullsized":"2024-05-07T11:17:49.987444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'2","last_scrub_stamp":"2024-05-07T11:17:49.987323+0000","last_deep_scrub":"83'2","last_deep_scrub_stamp":"2024-05-07T11:17:49.987323+0000","last_clean_scrub_stamp":"2024-05-07T11:17:49.987323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:12:22.356303+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"83'209","reported_seq":588,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:15.124379+0000","last_change":"2024-05-07T11:18:15.124404+0000","last_active":"2024-05-07T11:18:15.124379+0000","last_peered":"2024-05-07T11:18:15.124379+0000","last_clean":"2024-05-07T11:18:15.124379+0000","last_became_active":"2024-05-07T11:17:29.407677+0000","last_became_peered":"2024-05-07T11:17:29.407677+0000","last_unstale":"2024-05-07T11:18:15.124379+0000","last_undegraded":"2024-05-07T11:18:15.124379+0000","last_fullsized":"2024-05-07T11:18:15.124379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'209","last_scrub_stamp":"2024-05-07T11:18:15.124301+0000","last_deep_scrub":"83'209","last_deep_scrub_stamp":"2024-05-07T11:18:15.124301+0000","last_clean_scrub_stamp":"2024-05-07T11:18:15.124301+0000","objects_scrubbed":50,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:25.074219+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":83336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:00.068911+0000","last_change":"2024-05-07T11:18:00.068952+0000","last_active":"2024-05-07T11:18:00.068911+0000","last_peered":"2024-05-07T11:18:00.068911+0000","last_clean":"2024-05-07T11:18:00.068911+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:18:00.068911+0000","last_undegraded":"2024-05-07T11:18:00.068911+0000","last_fullsized":"2024-05-07T11:18:00.068911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-05-07T11:18:00.068784+0000","last_deep_scrub":"59'1","last_deep_scrub_stamp":"2024-05-07T11:18:00.068784+0000","last_clean_scrub_stamp":"2024-05-07T11:18:00.068784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:29.774977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"83'215","reported_seq":376,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:55.350485+0000","last_change":"2024-05-07T11:17:55.350512+0000","last_active":"2024-05-07T11:17:55.350485+0000","last_peered":"2024-05-07T11:17:55.350485+0000","last_clean":"2024-05-07T11:17:55.350485+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:55.350485+0000","last_undegraded":"2024-05-07T11:17:55.350485+0000","last_fullsized":"2024-05-07T11:17:55.350485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'215","last_scrub_stamp":"2024-05-07T11:17:55.350399+0000","last_deep_scrub":"83'215","last_deep_scrub_stamp":"2024-05-07T11:17:55.350399+0000","last_clean_scrub_stamp":"2024-05-07T11:17:55.350399+0000","objects_scrubbed":51,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:21:47.599124+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"83'18","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:42.260730+0000","last_change":"2024-05-07T11:17:42.260756+0000","last_active":"2024-05-07T11:17:42.260730+0000","last_peered":"2024-05-07T11:17:42.260730+0000","last_clean":"2024-05-07T11:17:42.260730+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:42.260730+0000","last_undegraded":"2024-05-07T11:17:42.260730+0000","last_fullsized":"2024-05-07T11:17:42.260730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'18","last_scrub_stamp":"2024-05-07T11:17:42.260615+0000","last_deep_scrub":"83'18","last_deep_scrub_stamp":"2024-05-07T11:17:42.260615+0000","last_clean_scrub_stamp":"2024-05-07T11:17:42.260615+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:52:04.635816+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"83'234","reported_seq":633,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:46.011170+0000","last_change":"2024-05-07T11:17:46.011210+0000","last_active":"2024-05-07T11:17:46.011170+0000","last_peered":"2024-05-07T11:17:46.011170+0000","last_clean":"2024-05-07T11:17:46.011170+0000","last_became_active":"2024-05-07T11:17:28.400673+0000","last_became_peered":"2024-05-07T11:17:28.400673+0000","last_unstale":"2024-05-07T11:17:46.011170+0000","last_undegraded":"2024-05-07T11:17:46.011170+0000","last_fullsized":"2024-05-07T11:17:46.011170+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'234","last_scrub_stamp":"2024-05-07T11:17:46.011079+0000","last_deep_scrub":"83'234","last_deep_scrub_stamp":"2024-05-07T11:17:46.011079+0000","last_clean_scrub_stamp":"2024-05-07T11:17:46.011079+0000","objects_scrubbed":62,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:52.036574+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":127501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":159,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:06.151855+0000","last_change":"2024-05-07T11:18:06.151884+0000","last_active":"2024-05-07T11:18:06.151855+0000","last_peered":"2024-05-07T11:18:06.151855+0000","last_clean":"2024-05-07T11:18:06.151855+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:18:06.151855+0000","last_undegraded":"2024-05-07T11:18:06.151855+0000","last_fullsized":"2024-05-07T11:18:06.151855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:18:06.151768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:18:06.151768+0000","last_clean_scrub_stamp":"2024-05-07T11:18:06.151768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:31.959839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"83'217","reported_seq":584,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:39.078656+0000","last_change":"2024-05-07T11:17:39.078687+0000","last_active":"2024-05-07T11:17:39.078656+0000","last_peered":"2024-05-07T11:17:39.078656+0000","last_clean":"2024-05-07T11:17:39.078656+0000","last_became_active":"2024-05-07T11:17:27.404340+0000","last_became_peered":"2024-05-07T11:17:27.404340+0000","last_unstale":"2024-05-07T11:17:39.078656+0000","last_undegraded":"2024-05-07T11:17:39.078656+0000","last_fullsized":"2024-05-07T11:17:39.078656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'217","last_scrub_stamp":"2024-05-07T11:17:39.078562+0000","last_deep_scrub":"83'217","last_deep_scrub_stamp":"2024-05-07T11:17:39.078562+0000","last_clean_scrub_stamp":"2024-05-07T11:17:39.078562+0000","objects_scrubbed":54,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:32:20.273980+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":119690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:57.312172+0000","last_change":"2024-05-07T11:17:57.312195+0000","last_active":"2024-05-07T11:17:57.312172+0000","last_peered":"2024-05-07T11:17:57.312172+0000","last_clean":"2024-05-07T11:17:57.312172+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:57.312172+0000","last_undegraded":"2024-05-07T11:17:57.312172+0000","last_fullsized":"2024-05-07T11:17:57.312172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:57.312086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:57.312086+0000","last_clean_scrub_stamp":"2024-05-07T11:17:57.312086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:07.100598+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"83'193","reported_seq":540,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:45.025977+0000","last_change":"2024-05-07T11:17:45.026028+0000","last_active":"2024-05-07T11:17:45.025977+0000","last_peered":"2024-05-07T11:17:45.025977+0000","last_clean":"2024-05-07T11:17:45.025977+0000","last_became_active":"2024-05-07T11:17:24.403279+0000","last_became_peered":"2024-05-07T11:17:24.403279+0000","last_unstale":"2024-05-07T11:17:45.025977+0000","last_undegraded":"2024-05-07T11:17:45.025977+0000","last_fullsized":"2024-05-07T11:17:45.025977+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'193","last_scrub_stamp":"2024-05-07T11:17:45.025873+0000","last_deep_scrub":"83'193","last_deep_scrub_stamp":"2024-05-07T11:17:45.025873+0000","last_clean_scrub_stamp":"2024-05-07T11:17:45.025873+0000","objects_scrubbed":56,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:49:13.481745+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:59.348178+0000","last_change":"2024-05-07T11:17:59.348204+0000","last_active":"2024-05-07T11:17:59.348178+0000","last_peered":"2024-05-07T11:17:59.348178+0000","last_clean":"2024-05-07T11:17:59.348178+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:59.348178+0000","last_undegraded":"2024-05-07T11:17:59.348178+0000","last_fullsized":"2024-05-07T11:17:59.348178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'1","last_scrub_stamp":"2024-05-07T11:17:59.348087+0000","last_deep_scrub":"58'1","last_deep_scrub_stamp":"2024-05-07T11:17:59.348087+0000","last_clean_scrub_stamp":"2024-05-07T11:17:59.348087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:59.008231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"83'194","reported_seq":539,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:51.378119+0000","last_change":"2024-05-07T11:17:51.378147+0000","last_active":"2024-05-07T11:17:51.378119+0000","last_peered":"2024-05-07T11:17:51.378119+0000","last_clean":"2024-05-07T11:17:51.378119+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:51.378119+0000","last_undegraded":"2024-05-07T11:17:51.378119+0000","last_fullsized":"2024-05-07T11:17:51.378119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'194","last_scrub_stamp":"2024-05-07T11:17:51.378022+0000","last_deep_scrub":"83'194","last_deep_scrub_stamp":"2024-05-07T11:17:51.378022+0000","last_clean_scrub_stamp":"2024-05-07T11:17:51.378022+0000","objects_scrubbed":53,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:55.523756+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"83'159","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:50.980974+0000","last_change":"2024-05-07T11:17:50.981010+0000","last_active":"2024-05-07T11:17:50.980974+0000","last_peered":"2024-05-07T11:17:50.980974+0000","last_clean":"2024-05-07T11:17:50.980974+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:50.980974+0000","last_undegraded":"2024-05-07T11:17:50.980974+0000","last_fullsized":"2024-05-07T11:17:50.980974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'159","last_scrub_stamp":"2024-05-07T11:17:50.980889+0000","last_deep_scrub":"83'159","last_deep_scrub_stamp":"2024-05-07T11:17:50.980889+0000","last_clean_scrub_stamp":"2024-05-07T11:17:50.980889+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:11:04.996284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:59.021406+0000","last_change":"2024-05-07T11:17:59.021427+0000","last_active":"2024-05-07T11:17:59.021406+0000","last_peered":"2024-05-07T11:17:59.021406+0000","last_clean":"2024-05-07T11:17:59.021406+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:59.021406+0000","last_undegraded":"2024-05-07T11:17:59.021406+0000","last_fullsized":"2024-05-07T11:17:59.021406+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:59.021302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:59.021302+0000","last_clean_scrub_stamp":"2024-05-07T11:17:59.021302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:24.430757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:00.266003+0000","last_change":"2024-05-07T11:18:00.266033+0000","last_active":"2024-05-07T11:18:00.266003+0000","last_peered":"2024-05-07T11:18:00.266003+0000","last_clean":"2024-05-07T11:18:00.266003+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:18:00.266003+0000","last_undegraded":"2024-05-07T11:18:00.266003+0000","last_fullsized":"2024-05-07T11:18:00.266003+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-05-07T11:18:00.265915+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-05-07T11:18:00.265915+0000","last_clean_scrub_stamp":"2024-05-07T11:18:00.265915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:31:32.771541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"83'206","reported_seq":542,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:13.082009+0000","last_change":"2024-05-07T11:18:13.082043+0000","last_active":"2024-05-07T11:18:13.082009+0000","last_peered":"2024-05-07T11:18:13.082009+0000","last_clean":"2024-05-07T11:18:13.082009+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:18:13.082009+0000","last_undegraded":"2024-05-07T11:18:13.082009+0000","last_fullsized":"2024-05-07T11:18:13.082009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'206","last_scrub_stamp":"2024-05-07T11:18:13.081930+0000","last_deep_scrub":"83'206","last_deep_scrub_stamp":"2024-05-07T11:18:13.081930+0000","last_clean_scrub_stamp":"2024-05-07T11:18:13.081930+0000","objects_scrubbed":59,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:46.660661+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":138308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.962154+0000","last_change":"2024-05-07T11:17:52.962179+0000","last_active":"2024-05-07T11:17:52.962154+0000","last_peered":"2024-05-07T11:17:52.962154+0000","last_clean":"2024-05-07T11:17:52.962154+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:52.962154+0000","last_undegraded":"2024-05-07T11:17:52.962154+0000","last_fullsized":"2024-05-07T11:17:52.962154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:52.962063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:52.962063+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.962063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:32:03.113448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"83'36","reported_seq":230,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:53.329701+0000","last_change":"2024-05-07T11:17:53.329728+0000","last_active":"2024-05-07T11:17:53.329701+0000","last_peered":"2024-05-07T11:17:53.329701+0000","last_clean":"2024-05-07T11:17:53.329701+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:53.329701+0000","last_undegraded":"2024-05-07T11:17:53.329701+0000","last_fullsized":"2024-05-07T11:17:53.329701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'36","last_scrub_stamp":"2024-05-07T11:17:53.329615+0000","last_deep_scrub":"83'36","last_deep_scrub_stamp":"2024-05-07T11:17:53.329615+0000","last_clean_scrub_stamp":"2024-05-07T11:17:53.329615+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:38.387178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"83'216","reported_seq":380,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:54.342114+0000","last_change":"2024-05-07T11:17:54.342148+0000","last_active":"2024-05-07T11:17:54.342114+0000","last_peered":"2024-05-07T11:17:54.342114+0000","last_clean":"2024-05-07T11:17:54.342114+0000","last_became_active":"2024-05-07T11:17:24.406306+0000","last_became_peered":"2024-05-07T11:17:24.406306+0000","last_unstale":"2024-05-07T11:17:54.342114+0000","last_undegraded":"2024-05-07T11:17:54.342114+0000","last_fullsized":"2024-05-07T11:17:54.342114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'216","last_scrub_stamp":"2024-05-07T11:17:54.342032+0000","last_deep_scrub":"83'216","last_deep_scrub_stamp":"2024-05-07T11:17:54.342032+0000","last_clean_scrub_stamp":"2024-05-07T11:17:54.342032+0000","objects_scrubbed":56,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:16:33.674063+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":402414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:59.282756+0000","last_change":"2024-05-07T11:17:59.282780+0000","last_active":"2024-05-07T11:17:59.282756+0000","last_peered":"2024-05-07T11:17:59.282756+0000","last_clean":"2024-05-07T11:17:59.282756+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:59.282756+0000","last_undegraded":"2024-05-07T11:17:59.282756+0000","last_fullsized":"2024-05-07T11:17:59.282756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:59.282634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:59.282634+0000","last_clean_scrub_stamp":"2024-05-07T11:17:59.282634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:35:39.844340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"83'57","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:53.253743+0000","last_change":"2024-05-07T11:17:53.253838+0000","last_active":"2024-05-07T11:17:53.253743+0000","last_peered":"2024-05-07T11:17:53.253743+0000","last_clean":"2024-05-07T11:17:53.253743+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:53.253743+0000","last_undegraded":"2024-05-07T11:17:53.253743+0000","last_fullsized":"2024-05-07T11:17:53.253743+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'57","last_scrub_stamp":"2024-05-07T11:17:53.253612+0000","last_deep_scrub":"83'57","last_deep_scrub_stamp":"2024-05-07T11:17:53.253612+0000","last_clean_scrub_stamp":"2024-05-07T11:17:53.253612+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:47.846273+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"83'225","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:06.265502+0000","last_change":"2024-05-07T11:18:06.265534+0000","last_active":"2024-05-07T11:18:06.265502+0000","last_peered":"2024-05-07T11:18:06.265502+0000","last_clean":"2024-05-07T11:18:06.265502+0000","last_became_active":"2024-05-07T11:17:26.407203+0000","last_became_peered":"2024-05-07T11:17:26.407203+0000","last_unstale":"2024-05-07T11:18:06.265502+0000","last_undegraded":"2024-05-07T11:18:06.265502+0000","last_fullsized":"2024-05-07T11:18:06.265502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'225","last_scrub_stamp":"2024-05-07T11:18:06.265425+0000","last_deep_scrub":"83'225","last_deep_scrub_stamp":"2024-05-07T11:18:06.265425+0000","last_clean_scrub_stamp":"2024-05-07T11:18:06.265425+0000","objects_scrubbed":56,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:31:04.468855+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":384377,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:04.129785+0000","last_change":"2024-05-07T11:18:04.129809+0000","last_active":"2024-05-07T11:18:04.129785+0000","last_peered":"2024-05-07T11:18:04.129785+0000","last_clean":"2024-05-07T11:18:04.129785+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:18:04.129785+0000","last_undegraded":"2024-05-07T11:18:04.129785+0000","last_fullsized":"2024-05-07T11:18:04.129785+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:18:04.129696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:18:04.129696+0000","last_clean_scrub_stamp":"2024-05-07T11:18:04.129696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:28:30.154123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":171,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:57.010295+0000","last_change":"2024-05-07T11:17:57.010321+0000","last_active":"2024-05-07T11:17:57.010295+0000","last_peered":"2024-05-07T11:17:57.010295+0000","last_clean":"2024-05-07T11:17:57.010295+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:57.010295+0000","last_undegraded":"2024-05-07T11:17:57.010295+0000","last_fullsized":"2024-05-07T11:17:57.010295+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:57.010202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:57.010202+0000","last_clean_scrub_stamp":"2024-05-07T11:17:57.010202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:14.384618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"83'212","reported_seq":305,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:04.270602+0000","last_change":"2024-05-07T11:18:04.270667+0000","last_active":"2024-05-07T11:18:04.270602+0000","last_peered":"2024-05-07T11:18:04.270602+0000","last_clean":"2024-05-07T11:18:04.270602+0000","last_became_active":"2024-05-07T11:17:25.412026+0000","last_became_peered":"2024-05-07T11:17:25.412026+0000","last_unstale":"2024-05-07T11:18:04.270602+0000","last_undegraded":"2024-05-07T11:18:04.270602+0000","last_fullsized":"2024-05-07T11:18:04.270602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'212","last_scrub_stamp":"2024-05-07T11:18:04.270520+0000","last_deep_scrub":"83'212","last_deep_scrub_stamp":"2024-05-07T11:18:04.270520+0000","last_clean_scrub_stamp":"2024-05-07T11:18:04.270520+0000","objects_scrubbed":61,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:58.078343+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":174891,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:56.036277+0000","last_change":"2024-05-07T11:17:56.036303+0000","last_active":"2024-05-07T11:17:56.036277+0000","last_peered":"2024-05-07T11:17:56.036277+0000","last_clean":"2024-05-07T11:17:56.036277+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:56.036277+0000","last_undegraded":"2024-05-07T11:17:56.036277+0000","last_fullsized":"2024-05-07T11:17:56.036277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-05-07T11:17:56.036184+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-05-07T11:17:56.036184+0000","last_clean_scrub_stamp":"2024-05-07T11:17:56.036184+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:56:59.214039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:44.239921+0000","last_change":"2024-05-07T11:17:44.239945+0000","last_active":"2024-05-07T11:17:44.239921+0000","last_peered":"2024-05-07T11:17:44.239921+0000","last_clean":"2024-05-07T11:17:44.239921+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:44.239921+0000","last_undegraded":"2024-05-07T11:17:44.239921+0000","last_fullsized":"2024-05-07T11:17:44.239921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:44.239834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:44.239834+0000","last_clean_scrub_stamp":"2024-05-07T11:17:44.239834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:25:18.735065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"83'199","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:10.518882+0000","last_change":"2024-05-07T11:18:10.518921+0000","last_active":"2024-05-07T11:18:10.518882+0000","last_peered":"2024-05-07T11:18:10.518882+0000","last_clean":"2024-05-07T11:18:10.518882+0000","last_became_active":"2024-05-07T11:17:29.407296+0000","last_became_peered":"2024-05-07T11:17:29.407296+0000","last_unstale":"2024-05-07T11:18:10.518882+0000","last_undegraded":"2024-05-07T11:18:10.518882+0000","last_fullsized":"2024-05-07T11:18:10.518882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'199","last_scrub_stamp":"2024-05-07T11:18:10.518795+0000","last_deep_scrub":"83'199","last_deep_scrub_stamp":"2024-05-07T11:18:10.518795+0000","last_clean_scrub_stamp":"2024-05-07T11:18:10.518795+0000","objects_scrubbed":41,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:18:01.224824+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":74509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:48.258915+0000","last_change":"2024-05-07T11:17:48.258940+0000","last_active":"2024-05-07T11:17:48.258915+0000","last_peered":"2024-05-07T11:17:48.258915+0000","last_clean":"2024-05-07T11:17:48.258915+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:48.258915+0000","last_undegraded":"2024-05-07T11:17:48.258915+0000","last_fullsized":"2024-05-07T11:17:48.258915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:48.258794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:48.258794+0000","last_clean_scrub_stamp":"2024-05-07T11:17:48.258794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:23.353531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:58.354492+0000","last_change":"2024-05-07T11:17:58.354533+0000","last_active":"2024-05-07T11:17:58.354492+0000","last_peered":"2024-05-07T11:17:58.354492+0000","last_clean":"2024-05-07T11:17:58.354492+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:58.354492+0000","last_undegraded":"2024-05-07T11:17:58.354492+0000","last_fullsized":"2024-05-07T11:17:58.354492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:58.354388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:58.354388+0000","last_clean_scrub_stamp":"2024-05-07T11:17:58.354388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:38.614551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"83'233","reported_seq":395,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.293237+0000","last_change":"2024-05-07T11:17:52.293267+0000","last_active":"2024-05-07T11:17:52.293237+0000","last_peered":"2024-05-07T11:17:52.293237+0000","last_clean":"2024-05-07T11:17:52.293237+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:52.293237+0000","last_undegraded":"2024-05-07T11:17:52.293237+0000","last_fullsized":"2024-05-07T11:17:52.293237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'233","last_scrub_stamp":"2024-05-07T11:17:52.293156+0000","last_deep_scrub":"83'233","last_deep_scrub_stamp":"2024-05-07T11:17:52.293156+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.293156+0000","objects_scrubbed":52,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:41:46.740290+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"83'3","reported_seq":110,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:09.117806+0000","last_change":"2024-05-07T11:18:09.117849+0000","last_active":"2024-05-07T11:18:09.117806+0000","last_peered":"2024-05-07T11:18:09.117806+0000","last_clean":"2024-05-07T11:18:09.117806+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:18:09.117806+0000","last_undegraded":"2024-05-07T11:18:09.117806+0000","last_fullsized":"2024-05-07T11:18:09.117806+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'3","last_scrub_stamp":"2024-05-07T11:18:09.117718+0000","last_deep_scrub":"83'3","last_deep_scrub_stamp":"2024-05-07T11:18:09.117718+0000","last_clean_scrub_stamp":"2024-05-07T11:18:09.117718+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:15.322000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:46.241049+0000","last_change":"2024-05-07T11:17:46.241075+0000","last_active":"2024-05-07T11:17:46.241049+0000","last_peered":"2024-05-07T11:17:46.241049+0000","last_clean":"2024-05-07T11:17:46.241049+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:46.241049+0000","last_undegraded":"2024-05-07T11:17:46.241049+0000","last_fullsized":"2024-05-07T11:17:46.241049+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:46.240900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:46.240900+0000","last_clean_scrub_stamp":"2024-05-07T11:17:46.240900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:37.866026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"83'233","reported_seq":354,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:54.033859+0000","last_change":"2024-05-07T11:17:54.033895+0000","last_active":"2024-05-07T11:17:54.033859+0000","last_peered":"2024-05-07T11:17:54.033859+0000","last_clean":"2024-05-07T11:17:54.033859+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:54.033859+0000","last_undegraded":"2024-05-07T11:17:54.033859+0000","last_fullsized":"2024-05-07T11:17:54.033859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'233","last_scrub_stamp":"2024-05-07T11:17:54.033780+0000","last_deep_scrub":"83'233","last_deep_scrub_stamp":"2024-05-07T11:17:54.033780+0000","last_clean_scrub_stamp":"2024-05-07T11:17:54.033780+0000","objects_scrubbed":58,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:47.910390+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"83'39","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:40.262548+0000","last_change":"2024-05-07T11:17:40.262573+0000","last_active":"2024-05-07T11:17:40.262548+0000","last_peered":"2024-05-07T11:17:40.262548+0000","last_clean":"2024-05-07T11:17:40.262548+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:40.262548+0000","last_undegraded":"2024-05-07T11:17:40.262548+0000","last_fullsized":"2024-05-07T11:17:40.262548+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'39","last_scrub_stamp":"2024-05-07T11:17:40.262463+0000","last_deep_scrub":"83'39","last_deep_scrub_stamp":"2024-05-07T11:17:40.262463+0000","last_clean_scrub_stamp":"2024-05-07T11:17:40.262463+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:30:27.064631+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:10.068300+0000","last_change":"2024-05-07T11:18:10.068325+0000","last_active":"2024-05-07T11:18:10.068300+0000","last_peered":"2024-05-07T11:18:10.068300+0000","last_clean":"2024-05-07T11:18:10.068300+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:18:10.068300+0000","last_undegraded":"2024-05-07T11:18:10.068300+0000","last_fullsized":"2024-05-07T11:18:10.068300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:18:10.068213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:18:10.068213+0000","last_clean_scrub_stamp":"2024-05-07T11:18:10.068213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:36:44.911021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"83'190","reported_seq":353,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:46.276900+0000","last_change":"2024-05-07T11:17:46.276956+0000","last_active":"2024-05-07T11:17:46.276900+0000","last_peered":"2024-05-07T11:17:46.276900+0000","last_clean":"2024-05-07T11:17:46.276900+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:46.276900+0000","last_undegraded":"2024-05-07T11:17:46.276900+0000","last_fullsized":"2024-05-07T11:17:46.276900+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'190","last_scrub_stamp":"2024-05-07T11:17:46.276811+0000","last_deep_scrub":"83'190","last_deep_scrub_stamp":"2024-05-07T11:17:46.276811+0000","last_clean_scrub_stamp":"2024-05-07T11:17:46.276811+0000","objects_scrubbed":52,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:04:11.845008+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"83'224","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.030675+0000","last_change":"2024-05-07T11:17:47.030735+0000","last_active":"2024-05-07T11:17:47.030675+0000","last_peered":"2024-05-07T11:17:47.030675+0000","last_clean":"2024-05-07T11:17:47.030675+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:47.030675+0000","last_undegraded":"2024-05-07T11:17:47.030675+0000","last_fullsized":"2024-05-07T11:17:47.030675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'224","last_scrub_stamp":"2024-05-07T11:17:47.030564+0000","last_deep_scrub":"83'224","last_deep_scrub_stamp":"2024-05-07T11:17:47.030564+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.030564+0000","objects_scrubbed":60,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:52:51.327322+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"83'48","reported_seq":221,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:01.091214+0000","last_change":"2024-05-07T11:18:01.091265+0000","last_active":"2024-05-07T11:18:01.091214+0000","last_peered":"2024-05-07T11:18:01.091214+0000","last_clean":"2024-05-07T11:18:01.091214+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:18:01.091214+0000","last_undegraded":"2024-05-07T11:18:01.091214+0000","last_fullsized":"2024-05-07T11:18:01.091214+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'48","last_scrub_stamp":"2024-05-07T11:18:01.091102+0000","last_deep_scrub":"83'48","last_deep_scrub_stamp":"2024-05-07T11:18:01.091102+0000","last_clean_scrub_stamp":"2024-05-07T11:18:01.091102+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:12.588665+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"83'198","reported_seq":291,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:05.281472+0000","last_change":"2024-05-07T11:18:05.281500+0000","last_active":"2024-05-07T11:18:05.281472+0000","last_peered":"2024-05-07T11:18:05.281472+0000","last_clean":"2024-05-07T11:18:05.281472+0000","last_became_active":"2024-05-07T11:17:25.412149+0000","last_became_peered":"2024-05-07T11:17:25.412149+0000","last_unstale":"2024-05-07T11:18:05.281472+0000","last_undegraded":"2024-05-07T11:18:05.281472+0000","last_fullsized":"2024-05-07T11:18:05.281472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'198","last_scrub_stamp":"2024-05-07T11:18:05.281384+0000","last_deep_scrub":"83'198","last_deep_scrub_stamp":"2024-05-07T11:18:05.281384+0000","last_clean_scrub_stamp":"2024-05-07T11:18:05.281384+0000","objects_scrubbed":52,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:44.146749+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"83'24","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:01.347635+0000","last_change":"2024-05-07T11:18:01.347664+0000","last_active":"2024-05-07T11:18:01.347635+0000","last_peered":"2024-05-07T11:18:01.347635+0000","last_clean":"2024-05-07T11:18:01.347635+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:18:01.347635+0000","last_undegraded":"2024-05-07T11:18:01.347635+0000","last_fullsized":"2024-05-07T11:18:01.347635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'24","last_scrub_stamp":"2024-05-07T11:18:01.347549+0000","last_deep_scrub":"83'24","last_deep_scrub_stamp":"2024-05-07T11:18:01.347549+0000","last_clean_scrub_stamp":"2024-05-07T11:18:01.347549+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:27.731409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:58.043182+0000","last_change":"2024-05-07T11:17:58.043208+0000","last_active":"2024-05-07T11:17:58.043182+0000","last_peered":"2024-05-07T11:17:58.043182+0000","last_clean":"2024-05-07T11:17:58.043182+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:58.043182+0000","last_undegraded":"2024-05-07T11:17:58.043182+0000","last_fullsized":"2024-05-07T11:17:58.043182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1","last_scrub_stamp":"2024-05-07T11:17:58.043088+0000","last_deep_scrub":"56'1","last_deep_scrub_stamp":"2024-05-07T11:17:58.043088+0000","last_clean_scrub_stamp":"2024-05-07T11:17:58.043088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:21:58.397347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"83'236","reported_seq":336,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:45.288243+0000","last_change":"2024-05-07T11:17:45.288277+0000","last_active":"2024-05-07T11:17:45.288243+0000","last_peered":"2024-05-07T11:17:45.288243+0000","last_clean":"2024-05-07T11:17:45.288243+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:45.288243+0000","last_undegraded":"2024-05-07T11:17:45.288243+0000","last_fullsized":"2024-05-07T11:17:45.288243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'236","last_scrub_stamp":"2024-05-07T11:17:45.288150+0000","last_deep_scrub":"83'236","last_deep_scrub_stamp":"2024-05-07T11:17:45.288150+0000","last_clean_scrub_stamp":"2024-05-07T11:17:45.288150+0000","objects_scrubbed":64,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:33.054850+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:57.328603+0000","last_change":"2024-05-07T11:17:57.328633+0000","last_active":"2024-05-07T11:17:57.328603+0000","last_peered":"2024-05-07T11:17:57.328603+0000","last_clean":"2024-05-07T11:17:57.328603+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:57.328603+0000","last_undegraded":"2024-05-07T11:17:57.328603+0000","last_fullsized":"2024-05-07T11:17:57.328603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-05-07T11:17:57.328510+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-05-07T11:17:57.328510+0000","last_clean_scrub_stamp":"2024-05-07T11:17:57.328510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:03.798077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"83'208","reported_seq":297,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:07.246062+0000","last_change":"2024-05-07T11:18:07.246109+0000","last_active":"2024-05-07T11:18:07.246062+0000","last_peered":"2024-05-07T11:18:07.246062+0000","last_clean":"2024-05-07T11:18:07.246062+0000","last_became_active":"2024-05-07T11:17:27.407792+0000","last_became_peered":"2024-05-07T11:17:27.407792+0000","last_unstale":"2024-05-07T11:18:07.246062+0000","last_undegraded":"2024-05-07T11:18:07.246062+0000","last_fullsized":"2024-05-07T11:18:07.246062+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'208","last_scrub_stamp":"2024-05-07T11:18:07.245952+0000","last_deep_scrub":"83'208","last_deep_scrub_stamp":"2024-05-07T11:18:07.245952+0000","last_clean_scrub_stamp":"2024-05-07T11:18:07.245952+0000","objects_scrubbed":52,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:18:14.297538+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"83'222","reported_seq":376,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:05.490346+0000","last_change":"2024-05-07T11:18:05.490431+0000","last_active":"2024-05-07T11:18:05.490346+0000","last_peered":"2024-05-07T11:18:05.490346+0000","last_clean":"2024-05-07T11:18:05.490346+0000","last_became_active":"2024-05-07T11:17:26.407230+0000","last_became_peered":"2024-05-07T11:17:26.407230+0000","last_unstale":"2024-05-07T11:18:05.490346+0000","last_undegraded":"2024-05-07T11:18:05.490346+0000","last_fullsized":"2024-05-07T11:18:05.490346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'222","last_scrub_stamp":"2024-05-07T11:18:05.490255+0000","last_deep_scrub":"83'222","last_deep_scrub_stamp":"2024-05-07T11:18:05.490255+0000","last_clean_scrub_stamp":"2024-05-07T11:18:05.490255+0000","objects_scrubbed":47,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:33:45.752707+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":91096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:50.321128+0000","last_change":"2024-05-07T11:17:50.321169+0000","last_active":"2024-05-07T11:17:50.321128+0000","last_peered":"2024-05-07T11:17:50.321128+0000","last_clean":"2024-05-07T11:17:50.321128+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:50.321128+0000","last_undegraded":"2024-05-07T11:17:50.321128+0000","last_fullsized":"2024-05-07T11:17:50.321128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'1","last_scrub_stamp":"2024-05-07T11:17:50.321000+0000","last_deep_scrub":"57'1","last_deep_scrub_stamp":"2024-05-07T11:17:50.321000+0000","last_clean_scrub_stamp":"2024-05-07T11:17:50.321000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:37:51.352461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"83'201","reported_seq":291,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:03.280942+0000","last_change":"2024-05-07T11:18:03.280988+0000","last_active":"2024-05-07T11:18:03.280942+0000","last_peered":"2024-05-07T11:18:03.280942+0000","last_clean":"2024-05-07T11:18:03.280942+0000","last_became_active":"2024-05-07T11:17:25.402661+0000","last_became_peered":"2024-05-07T11:17:25.402661+0000","last_unstale":"2024-05-07T11:18:03.280942+0000","last_undegraded":"2024-05-07T11:18:03.280942+0000","last_fullsized":"2024-05-07T11:18:03.280942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:18:03.280855+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:18:03.280855+0000","last_clean_scrub_stamp":"2024-05-07T11:18:03.280855+0000","objects_scrubbed":48,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:41:12.470372+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:56.295373+0000","last_change":"2024-05-07T11:17:56.295430+0000","last_active":"2024-05-07T11:17:56.295373+0000","last_peered":"2024-05-07T11:17:56.295373+0000","last_clean":"2024-05-07T11:17:56.295373+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:56.295373+0000","last_undegraded":"2024-05-07T11:17:56.295373+0000","last_fullsized":"2024-05-07T11:17:56.295373+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:56.295277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:56.295277+0000","last_clean_scrub_stamp":"2024-05-07T11:17:56.295277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:56:10.919183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"83'261","reported_seq":424,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:48.319698+0000","last_change":"2024-05-07T11:17:48.319731+0000","last_active":"2024-05-07T11:17:48.319698+0000","last_peered":"2024-05-07T11:17:48.319698+0000","last_clean":"2024-05-07T11:17:48.319698+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:48.319698+0000","last_undegraded":"2024-05-07T11:17:48.319698+0000","last_fullsized":"2024-05-07T11:17:48.319698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'261","last_scrub_stamp":"2024-05-07T11:17:48.319595+0000","last_deep_scrub":"83'261","last_deep_scrub_stamp":"2024-05-07T11:17:48.319595+0000","last_clean_scrub_stamp":"2024-05-07T11:17:48.319595+0000","objects_scrubbed":56,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:16.806230+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"83'5","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:03.383093+0000","last_change":"2024-05-07T11:18:03.383165+0000","last_active":"2024-05-07T11:18:03.383093+0000","last_peered":"2024-05-07T11:18:03.383093+0000","last_clean":"2024-05-07T11:18:03.383093+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:18:03.383093+0000","last_undegraded":"2024-05-07T11:18:03.383093+0000","last_fullsized":"2024-05-07T11:18:03.383093+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'5","last_scrub_stamp":"2024-05-07T11:18:03.382988+0000","last_deep_scrub":"83'5","last_deep_scrub_stamp":"2024-05-07T11:18:03.382988+0000","last_clean_scrub_stamp":"2024-05-07T11:18:03.382988+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:55:45.890232+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"83'224","reported_seq":388,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:39.284980+0000","last_change":"2024-05-07T11:17:39.285014+0000","last_active":"2024-05-07T11:17:39.284980+0000","last_peered":"2024-05-07T11:17:39.284980+0000","last_clean":"2024-05-07T11:17:39.284980+0000","last_became_active":"2024-05-07T11:17:24.406337+0000","last_became_peered":"2024-05-07T11:17:24.406337+0000","last_unstale":"2024-05-07T11:17:39.284980+0000","last_undegraded":"2024-05-07T11:17:39.284980+0000","last_fullsized":"2024-05-07T11:17:39.284980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'224","last_scrub_stamp":"2024-05-07T11:17:39.284895+0000","last_deep_scrub":"83'224","last_deep_scrub_stamp":"2024-05-07T11:17:39.284895+0000","last_clean_scrub_stamp":"2024-05-07T11:17:39.284895+0000","objects_scrubbed":61,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:44.019329+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":280772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"83'6","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:55.293380+0000","last_change":"2024-05-07T11:17:55.293412+0000","last_active":"2024-05-07T11:17:55.293380+0000","last_peered":"2024-05-07T11:17:55.293380+0000","last_clean":"2024-05-07T11:17:55.293380+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:55.293380+0000","last_undegraded":"2024-05-07T11:17:55.293380+0000","last_fullsized":"2024-05-07T11:17:55.293380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'6","last_scrub_stamp":"2024-05-07T11:17:55.293289+0000","last_deep_scrub":"83'6","last_deep_scrub_stamp":"2024-05-07T11:17:55.293289+0000","last_clean_scrub_stamp":"2024-05-07T11:17:55.293289+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:58:33.636177+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"83'215","reported_seq":593,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:48.982412+0000","last_change":"2024-05-07T11:17:48.982459+0000","last_active":"2024-05-07T11:17:48.982412+0000","last_peered":"2024-05-07T11:17:48.982412+0000","last_clean":"2024-05-07T11:17:48.982412+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:48.982412+0000","last_undegraded":"2024-05-07T11:17:48.982412+0000","last_fullsized":"2024-05-07T11:17:48.982412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'215","last_scrub_stamp":"2024-05-07T11:17:48.982300+0000","last_deep_scrub":"83'215","last_deep_scrub_stamp":"2024-05-07T11:17:48.982300+0000","last_clean_scrub_stamp":"2024-05-07T11:17:48.982300+0000","objects_scrubbed":49,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:40.894671+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"83'3","reported_seq":182,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:03.162011+0000","last_change":"2024-05-07T11:18:03.162041+0000","last_active":"2024-05-07T11:18:03.162011+0000","last_peered":"2024-05-07T11:18:03.162011+0000","last_clean":"2024-05-07T11:18:03.162011+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:18:03.162011+0000","last_undegraded":"2024-05-07T11:18:03.162011+0000","last_fullsized":"2024-05-07T11:18:03.162011+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'3","last_scrub_stamp":"2024-05-07T11:18:03.161915+0000","last_deep_scrub":"83'3","last_deep_scrub_stamp":"2024-05-07T11:18:03.161915+0000","last_clean_scrub_stamp":"2024-05-07T11:18:03.161915+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:11:46.470205+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"63'158","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:38.943451+0000","last_change":"2024-05-07T11:17:30.407286+0000","last_active":"2024-05-07T11:17:38.943451+0000","last_peered":"2024-05-07T11:17:38.943451+0000","last_clean":"2024-05-07T11:17:38.943451+0000","last_became_active":"2024-05-07T11:17:30.406353+0000","last_became_peered":"2024-05-07T11:17:30.406353+0000","last_unstale":"2024-05-07T11:17:38.943451+0000","last_undegraded":"2024-05-07T11:17:38.943451+0000","last_fullsized":"2024-05-07T11:17:38.943451+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:12:43.030504+0000","last_clean_scrub_stamp":"2024-05-07T11:12:43.030504+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":124612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"83'48","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:02.373280+0000","last_change":"2024-05-07T11:18:02.373307+0000","last_active":"2024-05-07T11:18:02.373280+0000","last_peered":"2024-05-07T11:18:02.373280+0000","last_clean":"2024-05-07T11:18:02.373280+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:18:02.373280+0000","last_undegraded":"2024-05-07T11:18:02.373280+0000","last_fullsized":"2024-05-07T11:18:02.373280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'48","last_scrub_stamp":"2024-05-07T11:18:02.373192+0000","last_deep_scrub":"83'48","last_deep_scrub_stamp":"2024-05-07T11:18:02.373192+0000","last_clean_scrub_stamp":"2024-05-07T11:18:02.373192+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:26:47.268773+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"83'232","reported_seq":395,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:40.266779+0000","last_change":"2024-05-07T11:17:40.266832+0000","last_active":"2024-05-07T11:17:40.266779+0000","last_peered":"2024-05-07T11:17:40.266779+0000","last_clean":"2024-05-07T11:17:40.266779+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:40.266779+0000","last_undegraded":"2024-05-07T11:17:40.266779+0000","last_fullsized":"2024-05-07T11:17:40.266779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'232","last_scrub_stamp":"2024-05-07T11:17:40.266666+0000","last_deep_scrub":"83'232","last_deep_scrub_stamp":"2024-05-07T11:17:40.266666+0000","last_clean_scrub_stamp":"2024-05-07T11:17:40.266666+0000","objects_scrubbed":63,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:36:06.762972+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"83'3","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:38.308033+0000","last_change":"2024-05-07T11:17:38.308072+0000","last_active":"2024-05-07T11:17:38.308033+0000","last_peered":"2024-05-07T11:17:38.308033+0000","last_clean":"2024-05-07T11:17:38.308033+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:38.308033+0000","last_undegraded":"2024-05-07T11:17:38.308033+0000","last_fullsized":"2024-05-07T11:17:38.308033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'3","last_scrub_stamp":"2024-05-07T11:17:38.307946+0000","last_deep_scrub":"83'3","last_deep_scrub_stamp":"2024-05-07T11:17:38.307946+0000","last_clean_scrub_stamp":"2024-05-07T11:17:38.307946+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:09:02.258964+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"83'261","reported_seq":688,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:44.054506+0000","last_change":"2024-05-07T11:17:44.054545+0000","last_active":"2024-05-07T11:17:44.054506+0000","last_peered":"2024-05-07T11:17:44.054506+0000","last_clean":"2024-05-07T11:17:44.054506+0000","last_became_active":"2024-05-07T11:17:25.401850+0000","last_became_peered":"2024-05-07T11:17:25.401850+0000","last_unstale":"2024-05-07T11:17:44.054506+0000","last_undegraded":"2024-05-07T11:17:44.054506+0000","last_fullsized":"2024-05-07T11:17:44.054506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'261","last_scrub_stamp":"2024-05-07T11:17:44.054428+0000","last_deep_scrub":"83'261","last_deep_scrub_stamp":"2024-05-07T11:17:44.054428+0000","last_clean_scrub_stamp":"2024-05-07T11:17:44.054428+0000","objects_scrubbed":62,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:40.345114+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"83'10","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.315142+0000","last_change":"2024-05-07T11:17:52.315175+0000","last_active":"2024-05-07T11:17:52.315142+0000","last_peered":"2024-05-07T11:17:52.315142+0000","last_clean":"2024-05-07T11:17:52.315142+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:52.315142+0000","last_undegraded":"2024-05-07T11:17:52.315142+0000","last_fullsized":"2024-05-07T11:17:52.315142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'10","last_scrub_stamp":"2024-05-07T11:17:52.315033+0000","last_deep_scrub":"83'10","last_deep_scrub_stamp":"2024-05-07T11:17:52.315033+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.315033+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:36:16.621480+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5805,"num_bytes_recovered":19428989,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64405504,"data_stored":53099596,"data_compressed":4611280,"data_compressed_allocated":5402624,"data_compressed_original":14118912,"omap_allocated":0,"internal_metadata":0},"log_size":13702,"ondisk_log_size":13702,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":460,"ondisk_log_size":460,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88320,"kb_used_data":30776,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94283520,"statfs":{"total":96636764160,"available":96546324480,"internally_reserved":0,"allocated":31514624,"data_stored":54276063,"data_compressed":6326260,"data_compressed_allocated":7593984,"data_compressed_original":37191680,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710734,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63132,"kb_used_data":23060,"kb_used_omap":10,"kb_used_meta":40053,"kb_avail":94308708,"statfs":{"total":96636764160,"available":96572116992,"internally_reserved":0,"allocated":23613440,"data_stored":43695842,"data_compressed":5536379,"data_compressed_allocated":6516736,"data_compressed_original":33533952,"omap_allocated":10404,"internal_metadata":41015132},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76332,"kb_used_data":27108,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94295508,"statfs":{"total":96636764160,"available":96558600192,"internally_reserved":0,"allocated":27758592,"data_stored":40411961,"data_compressed":4972494,"data_compressed_allocated":5840896,"data_compressed_original":25952256,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22953984,"data_stored":19509974,"data_compressed":1953035,"data_compressed_allocated":2265088,"data_compressed_original":5890048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17506304,"data_stored":13389680,"data_compressed":1088810,"data_compressed_allocated":1314816,"data_compressed_original":3727360,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23945216,"data_stored":20199942,"data_compressed":1569435,"data_compressed_allocated":1822720,"data_compressed_original":4501504,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:18:19.982 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:18:19.982 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:18:19.983 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-07T11:12:43.030504+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=12, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=11, tm_min=17, tm_sec=36, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T11:18:19.984 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T11:18:39.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T11:18:40.300 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:18:40.302 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-07T11:18:40.311 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-05-07T11:18:39.031437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68828561,"num_objects":3483,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3483,"num_whiteouts":0,"num_read":169,"num_read_kb":460,"num_write":11268,"num_write_kb":83749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5827,"num_bytes_recovered":56847285,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14484,"ondisk_log_size":14484,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":227784,"kb_used_data":80944,"kb_used_omap":13,"kb_used_meta":146802,"kb_avail":282887736,"statfs":{"total":289910292480,"available":289677041664,"internally_reserved":0,"allocated":82886656,"data_stored":138383866,"data_compressed":16835133,"data_compressed_allocated":19951616,"data_compressed_original":96677888,"omap_allocated":13594,"internal_metadata":150325990},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003455"},"pg_stats":[{"pgid":"4.3f","version":"83'217","reported_seq":375,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:06.514131+0000","last_change":"2024-05-07T11:18:06.514160+0000","last_active":"2024-05-07T11:18:06.514131+0000","last_peered":"2024-05-07T11:18:06.514131+0000","last_clean":"2024-05-07T11:18:06.514131+0000","last_became_active":"2024-05-07T11:17:27.407668+0000","last_became_peered":"2024-05-07T11:17:27.407668+0000","last_unstale":"2024-05-07T11:18:06.514131+0000","last_undegraded":"2024-05-07T11:18:06.514131+0000","last_fullsized":"2024-05-07T11:18:06.514131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'217","last_scrub_stamp":"2024-05-07T11:18:06.514052+0000","last_deep_scrub":"83'217","last_deep_scrub_stamp":"2024-05-07T11:18:06.514052+0000","last_clean_scrub_stamp":"2024-05-07T11:18:06.514052+0000","objects_scrubbed":54,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:47.984157+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":85925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"83'201","reported_seq":365,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:41.201485+0000","last_change":"2024-05-07T11:17:41.201530+0000","last_active":"2024-05-07T11:17:41.201485+0000","last_peered":"2024-05-07T11:17:41.201485+0000","last_clean":"2024-05-07T11:17:41.201485+0000","last_became_active":"2024-05-07T11:17:21.418151+0000","last_became_peered":"2024-05-07T11:17:21.418151+0000","last_unstale":"2024-05-07T11:17:41.201485+0000","last_undegraded":"2024-05-07T11:17:41.201485+0000","last_fullsized":"2024-05-07T11:17:41.201485+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:41.201407+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:41.201407+0000","last_clean_scrub_stamp":"2024-05-07T11:17:41.201407+0000","objects_scrubbed":46,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:10.995764+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182190,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":173039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"83'214","reported_seq":572,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:41.066480+0000","last_change":"2024-05-07T11:17:41.066533+0000","last_active":"2024-05-07T11:17:41.066480+0000","last_peered":"2024-05-07T11:17:41.066480+0000","last_clean":"2024-05-07T11:17:41.066480+0000","last_became_active":"2024-05-07T11:17:26.407269+0000","last_became_peered":"2024-05-07T11:17:26.407269+0000","last_unstale":"2024-05-07T11:17:41.066480+0000","last_undegraded":"2024-05-07T11:17:41.066480+0000","last_fullsized":"2024-05-07T11:17:41.066480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'214","last_scrub_stamp":"2024-05-07T11:17:41.066386+0000","last_deep_scrub":"83'214","last_deep_scrub_stamp":"2024-05-07T11:17:41.066386+0000","last_clean_scrub_stamp":"2024-05-07T11:17:41.066386+0000","objects_scrubbed":45,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:36:14.974872+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":75254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"83'175","reported_seq":333,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:07.178837+0000","last_change":"2024-05-07T11:18:07.178895+0000","last_active":"2024-05-07T11:18:07.178837+0000","last_peered":"2024-05-07T11:18:07.178837+0000","last_clean":"2024-05-07T11:18:07.178837+0000","last_became_active":"2024-05-07T11:12:44.054395+0000","last_became_peered":"2024-05-07T11:12:44.054395+0000","last_unstale":"2024-05-07T11:18:07.178837+0000","last_undegraded":"2024-05-07T11:18:07.178837+0000","last_fullsized":"2024-05-07T11:18:07.178837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'175","last_scrub_stamp":"2024-05-07T11:18:07.178757+0000","last_deep_scrub":"83'175","last_deep_scrub_stamp":"2024-05-07T11:18:07.178757+0000","last_clean_scrub_stamp":"2024-05-07T11:18:07.178757+0000","objects_scrubbed":49,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:46:56.545274+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248181,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"83'247","reported_seq":412,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:45.223435+0000","last_change":"2024-05-07T11:17:45.223468+0000","last_active":"2024-05-07T11:17:45.223435+0000","last_peered":"2024-05-07T11:17:45.223435+0000","last_clean":"2024-05-07T11:17:45.223435+0000","last_became_active":"2024-05-07T11:17:21.417780+0000","last_became_peered":"2024-05-07T11:17:21.417780+0000","last_unstale":"2024-05-07T11:17:45.223435+0000","last_undegraded":"2024-05-07T11:17:45.223435+0000","last_fullsized":"2024-05-07T11:17:45.223435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'247","last_scrub_stamp":"2024-05-07T11:17:45.223358+0000","last_deep_scrub":"83'247","last_deep_scrub_stamp":"2024-05-07T11:17:45.223358+0000","last_clean_scrub_stamp":"2024-05-07T11:17:45.223358+0000","objects_scrubbed":61,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:00:54.386592+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578732,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":561499,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"83'222","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:17.159128+0000","last_change":"2024-05-07T11:18:17.159173+0000","last_active":"2024-05-07T11:18:17.159128+0000","last_peered":"2024-05-07T11:18:17.159128+0000","last_clean":"2024-05-07T11:18:17.159128+0000","last_became_active":"2024-05-07T11:17:30.405536+0000","last_became_peered":"2024-05-07T11:17:30.405536+0000","last_unstale":"2024-05-07T11:18:17.159128+0000","last_undegraded":"2024-05-07T11:18:17.159128+0000","last_fullsized":"2024-05-07T11:18:17.159128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'222","last_scrub_stamp":"2024-05-07T11:18:17.159025+0000","last_deep_scrub":"83'222","last_deep_scrub_stamp":"2024-05-07T11:18:17.159025+0000","last_clean_scrub_stamp":"2024-05-07T11:18:17.159025+0000","objects_scrubbed":46,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:07.617675+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529421,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":529421,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"83'228","reported_seq":342,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.985885+0000","last_change":"2024-05-07T11:17:47.985926+0000","last_active":"2024-05-07T11:17:47.985885+0000","last_peered":"2024-05-07T11:17:47.985885+0000","last_clean":"2024-05-07T11:17:47.985885+0000","last_became_active":"2024-05-07T11:17:22.416988+0000","last_became_peered":"2024-05-07T11:17:22.416988+0000","last_unstale":"2024-05-07T11:17:47.985885+0000","last_undegraded":"2024-05-07T11:17:47.985885+0000","last_fullsized":"2024-05-07T11:17:47.985885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'228","last_scrub_stamp":"2024-05-07T11:17:47.985809+0000","last_deep_scrub":"83'228","last_deep_scrub_stamp":"2024-05-07T11:17:47.985809+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.985809+0000","objects_scrubbed":62,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:36:21.119192+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"83'178","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:02.156070+0000","last_change":"2024-05-07T11:18:02.156144+0000","last_active":"2024-05-07T11:18:02.156070+0000","last_peered":"2024-05-07T11:18:02.156070+0000","last_clean":"2024-05-07T11:18:02.156070+0000","last_became_active":"2024-05-07T11:17:23.397950+0000","last_became_peered":"2024-05-07T11:17:23.397950+0000","last_unstale":"2024-05-07T11:18:02.156070+0000","last_undegraded":"2024-05-07T11:18:02.156070+0000","last_fullsized":"2024-05-07T11:18:02.156070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'178","last_scrub_stamp":"2024-05-07T11:18:02.155981+0000","last_deep_scrub":"83'178","last_deep_scrub_stamp":"2024-05-07T11:18:02.155981+0000","last_clean_scrub_stamp":"2024-05-07T11:18:02.155981+0000","objects_scrubbed":46,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:50.815606+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215206,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":215206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"83'226","reported_seq":315,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:08.254460+0000","last_change":"2024-05-07T11:18:08.254487+0000","last_active":"2024-05-07T11:18:08.254460+0000","last_peered":"2024-05-07T11:18:08.254460+0000","last_clean":"2024-05-07T11:18:08.254460+0000","last_became_active":"2024-05-07T11:17:27.408650+0000","last_became_peered":"2024-05-07T11:17:27.408650+0000","last_unstale":"2024-05-07T11:18:08.254460+0000","last_undegraded":"2024-05-07T11:18:08.254460+0000","last_fullsized":"2024-05-07T11:18:08.254460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'226","last_scrub_stamp":"2024-05-07T11:18:08.254384+0000","last_deep_scrub":"83'226","last_deep_scrub_stamp":"2024-05-07T11:18:08.254384+0000","last_clean_scrub_stamp":"2024-05-07T11:18:08.254384+0000","objects_scrubbed":55,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:29.929876+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631133,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":631133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"83'201","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:44.203197+0000","last_change":"2024-05-07T11:17:44.203242+0000","last_active":"2024-05-07T11:17:44.203197+0000","last_peered":"2024-05-07T11:17:44.203197+0000","last_clean":"2024-05-07T11:17:44.203197+0000","last_became_active":"2024-05-07T11:17:22.415864+0000","last_became_peered":"2024-05-07T11:17:22.415864+0000","last_unstale":"2024-05-07T11:17:44.203197+0000","last_undegraded":"2024-05-07T11:17:44.203197+0000","last_fullsized":"2024-05-07T11:17:44.203197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:44.203102+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:44.203102+0000","last_clean_scrub_stamp":"2024-05-07T11:17:44.203102+0000","objects_scrubbed":45,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:39:20.413250+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116281,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":109224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"83'213","reported_seq":522,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.053940+0000","last_change":"2024-05-07T11:17:52.053975+0000","last_active":"2024-05-07T11:17:52.053940+0000","last_peered":"2024-05-07T11:17:52.053940+0000","last_clean":"2024-05-07T11:17:52.053940+0000","last_became_active":"2024-05-07T11:17:22.417902+0000","last_became_peered":"2024-05-07T11:17:22.417902+0000","last_unstale":"2024-05-07T11:17:52.053940+0000","last_undegraded":"2024-05-07T11:17:52.053940+0000","last_fullsized":"2024-05-07T11:17:52.053940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'213","last_scrub_stamp":"2024-05-07T11:17:52.053862+0000","last_deep_scrub":"83'213","last_deep_scrub_stamp":"2024-05-07T11:17:52.053862+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.053862+0000","objects_scrubbed":59,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:34:34.769997+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229979,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":229979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"83'193","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:08.613240+0000","last_change":"2024-05-07T11:18:08.613267+0000","last_active":"2024-05-07T11:18:08.613240+0000","last_peered":"2024-05-07T11:18:08.613240+0000","last_clean":"2024-05-07T11:18:08.613240+0000","last_became_active":"2024-05-07T11:17:28.403770+0000","last_became_peered":"2024-05-07T11:17:28.403770+0000","last_unstale":"2024-05-07T11:18:08.613240+0000","last_undegraded":"2024-05-07T11:18:08.613240+0000","last_fullsized":"2024-05-07T11:18:08.613240+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'193","last_scrub_stamp":"2024-05-07T11:18:08.613153+0000","last_deep_scrub":"83'193","last_deep_scrub_stamp":"2024-05-07T11:18:08.613153+0000","last_clean_scrub_stamp":"2024-05-07T11:18:08.613153+0000","objects_scrubbed":53,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:03.299333+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103389,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":89602,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"83'187","reported_seq":353,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:50.303808+0000","last_change":"2024-05-07T11:17:50.303836+0000","last_active":"2024-05-07T11:17:50.303808+0000","last_peered":"2024-05-07T11:17:50.303808+0000","last_clean":"2024-05-07T11:17:50.303808+0000","last_became_active":"2024-05-07T11:17:23.398230+0000","last_became_peered":"2024-05-07T11:17:23.398230+0000","last_unstale":"2024-05-07T11:17:50.303808+0000","last_undegraded":"2024-05-07T11:17:50.303808+0000","last_fullsized":"2024-05-07T11:17:50.303808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'187","last_scrub_stamp":"2024-05-07T11:17:50.303719+0000","last_deep_scrub":"83'187","last_deep_scrub_stamp":"2024-05-07T11:17:50.303719+0000","last_clean_scrub_stamp":"2024-05-07T11:17:50.303719+0000","objects_scrubbed":51,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:14:41.226878+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298441,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":298441,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"83'222","reported_seq":590,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:43.081883+0000","last_change":"2024-05-07T11:17:43.081932+0000","last_active":"2024-05-07T11:17:43.081883+0000","last_peered":"2024-05-07T11:17:43.081883+0000","last_clean":"2024-05-07T11:17:43.081883+0000","last_became_active":"2024-05-07T11:17:26.407342+0000","last_became_peered":"2024-05-07T11:17:26.407342+0000","last_unstale":"2024-05-07T11:17:43.081883+0000","last_undegraded":"2024-05-07T11:17:43.081883+0000","last_fullsized":"2024-05-07T11:17:43.081883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'222","last_scrub_stamp":"2024-05-07T11:17:43.081787+0000","last_deep_scrub":"83'222","last_deep_scrub_stamp":"2024-05-07T11:17:43.081787+0000","last_clean_scrub_stamp":"2024-05-07T11:17:43.081787+0000","objects_scrubbed":47,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:36.906648+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211594,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":196945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"83'214","reported_seq":585,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:12.069461+0000","last_change":"2024-05-07T11:18:12.069503+0000","last_active":"2024-05-07T11:18:12.069461+0000","last_peered":"2024-05-07T11:18:12.069461+0000","last_clean":"2024-05-07T11:18:12.069461+0000","last_became_active":"2024-05-07T11:17:23.398084+0000","last_became_peered":"2024-05-07T11:17:23.398084+0000","last_unstale":"2024-05-07T11:18:12.069461+0000","last_undegraded":"2024-05-07T11:18:12.069461+0000","last_fullsized":"2024-05-07T11:18:12.069461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'214","last_scrub_stamp":"2024-05-07T11:18:12.069380+0000","last_deep_scrub":"83'214","last_deep_scrub_stamp":"2024-05-07T11:18:12.069380+0000","last_clean_scrub_stamp":"2024-05-07T11:18:12.069380+0000","objects_scrubbed":43,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:37:07.947475+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277380,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":82965,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"83'238","reported_seq":572,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:18.165244+0000","last_change":"2024-05-07T11:18:18.165290+0000","last_active":"2024-05-07T11:18:18.165244+0000","last_peered":"2024-05-07T11:18:18.165244+0000","last_clean":"2024-05-07T11:18:18.165244+0000","last_became_active":"2024-05-07T11:17:30.405896+0000","last_became_peered":"2024-05-07T11:17:30.405896+0000","last_unstale":"2024-05-07T11:18:18.165244+0000","last_undegraded":"2024-05-07T11:18:18.165244+0000","last_fullsized":"2024-05-07T11:18:18.165244+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'238","last_scrub_stamp":"2024-05-07T11:18:18.165158+0000","last_deep_scrub":"83'238","last_deep_scrub_stamp":"2024-05-07T11:18:18.165158+0000","last_clean_scrub_stamp":"2024-05-07T11:18:18.165158+0000","objects_scrubbed":60,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:04:54.657875+0000","scrub_duration":60,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4349416,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4343464,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"83'210","reported_seq":574,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:49.314556+0000","last_change":"2024-05-07T11:17:49.314602+0000","last_active":"2024-05-07T11:17:49.314556+0000","last_peered":"2024-05-07T11:17:49.314556+0000","last_clean":"2024-05-07T11:17:49.314556+0000","last_became_active":"2024-05-07T11:17:22.415967+0000","last_became_peered":"2024-05-07T11:17:22.415967+0000","last_unstale":"2024-05-07T11:17:49.314556+0000","last_undegraded":"2024-05-07T11:17:49.314556+0000","last_fullsized":"2024-05-07T11:17:49.314556+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'210","last_scrub_stamp":"2024-05-07T11:17:49.314458+0000","last_deep_scrub":"83'210","last_deep_scrub_stamp":"2024-05-07T11:17:49.314458+0000","last_clean_scrub_stamp":"2024-05-07T11:17:49.314458+0000","objects_scrubbed":49,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:02.141295+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127287,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":109338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"83'202","reported_seq":367,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:49.285042+0000","last_change":"2024-05-07T11:17:49.285099+0000","last_active":"2024-05-07T11:17:49.285042+0000","last_peered":"2024-05-07T11:17:49.285042+0000","last_clean":"2024-05-07T11:17:49.285042+0000","last_became_active":"2024-05-07T11:17:21.417688+0000","last_became_peered":"2024-05-07T11:17:21.417688+0000","last_unstale":"2024-05-07T11:17:49.285042+0000","last_undegraded":"2024-05-07T11:17:49.285042+0000","last_fullsized":"2024-05-07T11:17:49.285042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'202","last_scrub_stamp":"2024-05-07T11:17:49.284941+0000","last_deep_scrub":"83'202","last_deep_scrub_stamp":"2024-05-07T11:17:49.284941+0000","last_clean_scrub_stamp":"2024-05-07T11:17:49.284941+0000","objects_scrubbed":54,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:06:24.534977+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422010,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":77915,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"83'201","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:39.333162+0000","last_change":"2024-05-07T11:17:39.333214+0000","last_active":"2024-05-07T11:17:39.333162+0000","last_peered":"2024-05-07T11:17:39.333162+0000","last_clean":"2024-05-07T11:17:39.333162+0000","last_became_active":"2024-05-07T11:17:21.417256+0000","last_became_peered":"2024-05-07T11:17:21.417256+0000","last_unstale":"2024-05-07T11:17:39.333162+0000","last_undegraded":"2024-05-07T11:17:39.333162+0000","last_fullsized":"2024-05-07T11:17:39.333162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:39.333074+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:39.333074+0000","last_clean_scrub_stamp":"2024-05-07T11:17:39.333074+0000","objects_scrubbed":54,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:32.756865+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222853,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":222830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"83'235","reported_seq":634,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:14.124646+0000","last_change":"2024-05-07T11:18:14.124673+0000","last_active":"2024-05-07T11:18:14.124646+0000","last_peered":"2024-05-07T11:18:14.124646+0000","last_clean":"2024-05-07T11:18:14.124646+0000","last_became_active":"2024-05-07T11:17:29.407032+0000","last_became_peered":"2024-05-07T11:17:29.407032+0000","last_unstale":"2024-05-07T11:18:14.124646+0000","last_undegraded":"2024-05-07T11:18:14.124646+0000","last_fullsized":"2024-05-07T11:18:14.124646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'235","last_scrub_stamp":"2024-05-07T11:18:14.124569+0000","last_deep_scrub":"83'235","last_deep_scrub_stamp":"2024-05-07T11:18:14.124569+0000","last_clean_scrub_stamp":"2024-05-07T11:18:14.124569+0000","objects_scrubbed":50,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:55:30.521564+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98139,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":98139,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"83'211","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:08.136289+0000","last_change":"2024-05-07T11:18:08.136345+0000","last_active":"2024-05-07T11:18:08.136289+0000","last_peered":"2024-05-07T11:18:08.136289+0000","last_clean":"2024-05-07T11:18:08.136289+0000","last_became_active":"2024-05-07T11:12:44.055409+0000","last_became_peered":"2024-05-07T11:12:44.055409+0000","last_unstale":"2024-05-07T11:18:08.136289+0000","last_undegraded":"2024-05-07T11:18:08.136289+0000","last_fullsized":"2024-05-07T11:18:08.136289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'211","last_scrub_stamp":"2024-05-07T11:18:08.136181+0000","last_deep_scrub":"83'211","last_deep_scrub_stamp":"2024-05-07T11:18:08.136181+0000","last_clean_scrub_stamp":"2024-05-07T11:18:08.136181+0000","objects_scrubbed":54,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:58:53.256733+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"83'229","reported_seq":378,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:09.573333+0000","last_change":"2024-05-07T11:18:09.573379+0000","last_active":"2024-05-07T11:18:09.573333+0000","last_peered":"2024-05-07T11:18:09.573333+0000","last_clean":"2024-05-07T11:18:09.573333+0000","last_became_active":"2024-05-07T11:17:29.407294+0000","last_became_peered":"2024-05-07T11:17:29.407294+0000","last_unstale":"2024-05-07T11:18:09.573333+0000","last_undegraded":"2024-05-07T11:18:09.573333+0000","last_fullsized":"2024-05-07T11:18:09.573333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'229","last_scrub_stamp":"2024-05-07T11:18:09.573249+0000","last_deep_scrub":"83'229","last_deep_scrub_stamp":"2024-05-07T11:18:09.573249+0000","last_clean_scrub_stamp":"2024-05-07T11:18:09.573249+0000","objects_scrubbed":64,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:56:26.772632+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134833,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":116557,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"83'210","reported_seq":309,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:41.259211+0000","last_change":"2024-05-07T11:17:41.259241+0000","last_active":"2024-05-07T11:17:41.259211+0000","last_peered":"2024-05-07T11:17:41.259211+0000","last_clean":"2024-05-07T11:17:41.259211+0000","last_became_active":"2024-05-07T11:17:21.417379+0000","last_became_peered":"2024-05-07T11:17:21.417379+0000","last_unstale":"2024-05-07T11:17:41.259211+0000","last_undegraded":"2024-05-07T11:17:41.259211+0000","last_fullsized":"2024-05-07T11:17:41.259211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'210","last_scrub_stamp":"2024-05-07T11:17:41.259122+0000","last_deep_scrub":"83'210","last_deep_scrub_stamp":"2024-05-07T11:17:41.259122+0000","last_clean_scrub_stamp":"2024-05-07T11:17:41.259122+0000","objects_scrubbed":51,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:06:52.200929+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554898,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":554898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"83'217","reported_seq":381,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:51.266223+0000","last_change":"2024-05-07T11:17:51.266265+0000","last_active":"2024-05-07T11:17:51.266223+0000","last_peered":"2024-05-07T11:17:51.266223+0000","last_clean":"2024-05-07T11:17:51.266223+0000","last_became_active":"2024-05-07T11:17:21.414144+0000","last_became_peered":"2024-05-07T11:17:21.414144+0000","last_unstale":"2024-05-07T11:17:51.266223+0000","last_undegraded":"2024-05-07T11:17:51.266223+0000","last_fullsized":"2024-05-07T11:17:51.266223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'217","last_scrub_stamp":"2024-05-07T11:17:51.266142+0000","last_deep_scrub":"83'217","last_deep_scrub_stamp":"2024-05-07T11:17:51.266142+0000","last_clean_scrub_stamp":"2024-05-07T11:17:51.266142+0000","objects_scrubbed":48,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:50:26.027402+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123403,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":113070,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"83'218","reported_seq":377,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:04.460342+0000","last_change":"2024-05-07T11:18:04.460378+0000","last_active":"2024-05-07T11:18:04.460342+0000","last_peered":"2024-05-07T11:18:04.460342+0000","last_clean":"2024-05-07T11:18:04.460342+0000","last_became_active":"2024-05-07T11:17:24.406307+0000","last_became_peered":"2024-05-07T11:17:24.406307+0000","last_unstale":"2024-05-07T11:18:04.460342+0000","last_undegraded":"2024-05-07T11:18:04.460342+0000","last_fullsized":"2024-05-07T11:18:04.460342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'218","last_scrub_stamp":"2024-05-07T11:18:04.460265+0000","last_deep_scrub":"83'218","last_deep_scrub_stamp":"2024-05-07T11:18:04.460265+0000","last_clean_scrub_stamp":"2024-05-07T11:18:04.460265+0000","objects_scrubbed":64,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:15:14.365494+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240382,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":230897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"83'250","reported_seq":411,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:54.347620+0000","last_change":"2024-05-07T11:17:54.347648+0000","last_active":"2024-05-07T11:17:54.347620+0000","last_peered":"2024-05-07T11:17:54.347620+0000","last_clean":"2024-05-07T11:17:54.347620+0000","last_became_active":"2024-05-07T11:12:44.049656+0000","last_became_peered":"2024-05-07T11:12:44.049656+0000","last_unstale":"2024-05-07T11:17:54.347620+0000","last_undegraded":"2024-05-07T11:17:54.347620+0000","last_fullsized":"2024-05-07T11:17:54.347620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'250","last_scrub_stamp":"2024-05-07T11:17:54.347547+0000","last_deep_scrub":"83'250","last_deep_scrub_stamp":"2024-05-07T11:17:54.347547+0000","last_clean_scrub_stamp":"2024-05-07T11:17:54.347547+0000","objects_scrubbed":55,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:22:30.438020+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112743,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"83'199","reported_seq":530,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:16.170343+0000","last_change":"2024-05-07T11:18:16.170385+0000","last_active":"2024-05-07T11:18:16.170343+0000","last_peered":"2024-05-07T11:18:16.170343+0000","last_clean":"2024-05-07T11:18:16.170343+0000","last_became_active":"2024-05-07T11:17:23.403141+0000","last_became_peered":"2024-05-07T11:17:23.403141+0000","last_unstale":"2024-05-07T11:18:16.170343+0000","last_undegraded":"2024-05-07T11:18:16.170343+0000","last_fullsized":"2024-05-07T11:18:16.170343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'199","last_scrub_stamp":"2024-05-07T11:18:16.170242+0000","last_deep_scrub":"83'199","last_deep_scrub_stamp":"2024-05-07T11:18:16.170242+0000","last_clean_scrub_stamp":"2024-05-07T11:18:16.170242+0000","objects_scrubbed":47,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:50.569705+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71465,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":67681,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"83'195","reported_seq":345,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:07.555692+0000","last_change":"2024-05-07T11:18:07.555793+0000","last_active":"2024-05-07T11:18:07.555692+0000","last_peered":"2024-05-07T11:18:07.555692+0000","last_clean":"2024-05-07T11:18:07.555692+0000","last_became_active":"2024-05-07T11:17:28.403782+0000","last_became_peered":"2024-05-07T11:17:28.403782+0000","last_unstale":"2024-05-07T11:18:07.555692+0000","last_undegraded":"2024-05-07T11:18:07.555692+0000","last_fullsized":"2024-05-07T11:18:07.555692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'195","last_scrub_stamp":"2024-05-07T11:18:07.555591+0000","last_deep_scrub":"83'195","last_deep_scrub_stamp":"2024-05-07T11:18:07.555591+0000","last_clean_scrub_stamp":"2024-05-07T11:18:07.555591+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:08.558392+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220688,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":211687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"83'221","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:02.318600+0000","last_change":"2024-05-07T11:18:02.318630+0000","last_active":"2024-05-07T11:18:02.318600+0000","last_peered":"2024-05-07T11:18:02.318600+0000","last_clean":"2024-05-07T11:18:02.318600+0000","last_became_active":"2024-05-07T11:17:24.403179+0000","last_became_peered":"2024-05-07T11:17:24.403179+0000","last_unstale":"2024-05-07T11:18:02.318600+0000","last_undegraded":"2024-05-07T11:18:02.318600+0000","last_fullsized":"2024-05-07T11:18:02.318600+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'221","last_scrub_stamp":"2024-05-07T11:18:02.318520+0000","last_deep_scrub":"83'221","last_deep_scrub_stamp":"2024-05-07T11:18:02.318520+0000","last_clean_scrub_stamp":"2024-05-07T11:18:02.318520+0000","objects_scrubbed":58,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:07.362323+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120577,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":120577,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"83'253","reported_seq":402,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:11.519687+0000","last_change":"2024-05-07T11:18:11.519728+0000","last_active":"2024-05-07T11:18:11.519687+0000","last_peered":"2024-05-07T11:18:11.519687+0000","last_clean":"2024-05-07T11:18:11.519687+0000","last_became_active":"2024-05-07T11:17:29.408425+0000","last_became_peered":"2024-05-07T11:17:29.408425+0000","last_unstale":"2024-05-07T11:18:11.519687+0000","last_undegraded":"2024-05-07T11:18:11.519687+0000","last_fullsized":"2024-05-07T11:18:11.519687+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'253","last_scrub_stamp":"2024-05-07T11:18:11.519608+0000","last_deep_scrub":"83'253","last_deep_scrub_stamp":"2024-05-07T11:18:11.519608+0000","last_clean_scrub_stamp":"2024-05-07T11:18:11.519608+0000","objects_scrubbed":68,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:25.920931+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94982,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":86167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"83'258","reported_seq":663,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.332086+0000","last_change":"2024-05-07T11:17:47.332120+0000","last_active":"2024-05-07T11:17:47.332086+0000","last_peered":"2024-05-07T11:17:47.332086+0000","last_clean":"2024-05-07T11:17:47.332086+0000","last_became_active":"2024-05-07T11:17:22.415297+0000","last_became_peered":"2024-05-07T11:17:22.415297+0000","last_unstale":"2024-05-07T11:17:47.332086+0000","last_undegraded":"2024-05-07T11:17:47.332086+0000","last_fullsized":"2024-05-07T11:17:47.332086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'258","last_scrub_stamp":"2024-05-07T11:17:47.331997+0000","last_deep_scrub":"83'258","last_deep_scrub_stamp":"2024-05-07T11:17:47.331997+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.331997+0000","objects_scrubbed":66,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:09:56.524621+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153058,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":121865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"83'241","reported_seq":648,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:42.102161+0000","last_change":"2024-05-07T11:17:42.102193+0000","last_active":"2024-05-07T11:17:42.102161+0000","last_peered":"2024-05-07T11:17:42.102161+0000","last_clean":"2024-05-07T11:17:42.102161+0000","last_became_active":"2024-05-07T11:17:28.398801+0000","last_became_peered":"2024-05-07T11:17:28.398801+0000","last_unstale":"2024-05-07T11:17:42.102161+0000","last_undegraded":"2024-05-07T11:17:42.102161+0000","last_fullsized":"2024-05-07T11:17:42.102161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'241","last_scrub_stamp":"2024-05-07T11:17:42.102072+0000","last_deep_scrub":"83'241","last_deep_scrub_stamp":"2024-05-07T11:17:42.102072+0000","last_clean_scrub_stamp":"2024-05-07T11:17:42.102072+0000","objects_scrubbed":56,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:41:31.485222+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468627,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":459999,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"83'201","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:42.201299+0000","last_change":"2024-05-07T11:17:42.201378+0000","last_active":"2024-05-07T11:17:42.201299+0000","last_peered":"2024-05-07T11:17:42.201299+0000","last_clean":"2024-05-07T11:17:42.201299+0000","last_became_active":"2024-05-07T11:17:22.415180+0000","last_became_peered":"2024-05-07T11:17:22.415180+0000","last_unstale":"2024-05-07T11:17:42.201299+0000","last_undegraded":"2024-05-07T11:17:42.201299+0000","last_fullsized":"2024-05-07T11:17:42.201299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:17:42.201182+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:17:42.201182+0000","last_clean_scrub_stamp":"2024-05-07T11:17:42.201182+0000","objects_scrubbed":45,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:36:38.491438+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87676,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":87676,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"83'130","reported_seq":289,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:05.175847+0000","last_change":"2024-05-07T11:18:05.175908+0000","last_active":"2024-05-07T11:18:05.175847+0000","last_peered":"2024-05-07T11:18:05.175847+0000","last_clean":"2024-05-07T11:18:05.175847+0000","last_became_active":"2024-05-07T11:12:43.052467+0000","last_became_peered":"2024-05-07T11:12:43.052467+0000","last_unstale":"2024-05-07T11:18:05.175847+0000","last_undegraded":"2024-05-07T11:18:05.175847+0000","last_fullsized":"2024-05-07T11:18:05.175847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'130","last_scrub_stamp":"2024-05-07T11:18:05.175737+0000","last_deep_scrub":"83'130","last_deep_scrub_stamp":"2024-05-07T11:18:05.175737+0000","last_clean_scrub_stamp":"2024-05-07T11:18:05.175737+0000","objects_scrubbed":3,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:13:21.691125+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441733,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":3429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"83'186","reported_seq":350,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:43.155008+0000","last_change":"2024-05-07T11:17:43.155072+0000","last_active":"2024-05-07T11:17:43.155008+0000","last_peered":"2024-05-07T11:17:43.155008+0000","last_clean":"2024-05-07T11:17:43.155008+0000","last_became_active":"2024-05-07T11:17:21.418495+0000","last_became_peered":"2024-05-07T11:17:21.418495+0000","last_unstale":"2024-05-07T11:17:43.155008+0000","last_undegraded":"2024-05-07T11:17:43.155008+0000","last_fullsized":"2024-05-07T11:17:43.155008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'186","last_scrub_stamp":"2024-05-07T11:17:43.154922+0000","last_deep_scrub":"83'186","last_deep_scrub_stamp":"2024-05-07T11:17:43.154922+0000","last_clean_scrub_stamp":"2024-05-07T11:17:43.154922+0000","objects_scrubbed":45,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:58:38.318679+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177502,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":165359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:58.311017+0000","last_change":"2024-05-07T11:17:58.311068+0000","last_active":"2024-05-07T11:17:58.311017+0000","last_peered":"2024-05-07T11:17:58.311017+0000","last_clean":"2024-05-07T11:17:58.311017+0000","last_became_active":"2024-05-07T11:17:18.403778+0000","last_became_peered":"2024-05-07T11:17:18.403778+0000","last_unstale":"2024-05-07T11:17:58.311017+0000","last_undegraded":"2024-05-07T11:17:58.311017+0000","last_fullsized":"2024-05-07T11:17:58.311017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:58.310920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:58.310920+0000","last_clean_scrub_stamp":"2024-05-07T11:17:58.310920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:03:48.856280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"83'238","reported_seq":337,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:43.328522+0000","last_change":"2024-05-07T11:17:43.328557+0000","last_active":"2024-05-07T11:17:43.328522+0000","last_peered":"2024-05-07T11:17:43.328522+0000","last_clean":"2024-05-07T11:17:43.328522+0000","last_became_active":"2024-05-07T11:17:21.418115+0000","last_became_peered":"2024-05-07T11:17:21.418115+0000","last_unstale":"2024-05-07T11:17:43.328522+0000","last_undegraded":"2024-05-07T11:17:43.328522+0000","last_fullsized":"2024-05-07T11:17:43.328522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'238","last_scrub_stamp":"2024-05-07T11:17:43.328425+0000","last_deep_scrub":"83'238","last_deep_scrub_stamp":"2024-05-07T11:17:43.328425+0000","last_clean_scrub_stamp":"2024-05-07T11:17:43.328425+0000","objects_scrubbed":59,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:16:14.596154+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159927,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":157704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:56.323986+0000","last_change":"2024-05-07T11:17:56.324016+0000","last_active":"2024-05-07T11:17:56.323986+0000","last_peered":"2024-05-07T11:17:56.323986+0000","last_clean":"2024-05-07T11:17:56.323986+0000","last_became_active":"2024-05-07T11:17:18.422763+0000","last_became_peered":"2024-05-07T11:17:18.422763+0000","last_unstale":"2024-05-07T11:17:56.323986+0000","last_undegraded":"2024-05-07T11:17:56.323986+0000","last_fullsized":"2024-05-07T11:17:56.323986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:56.323896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:56.323896+0000","last_clean_scrub_stamp":"2024-05-07T11:17:56.323896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:32:35.546889+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"83'208","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:01.279143+0000","last_change":"2024-05-07T11:18:01.279189+0000","last_active":"2024-05-07T11:18:01.279143+0000","last_peered":"2024-05-07T11:18:01.279143+0000","last_clean":"2024-05-07T11:18:01.279143+0000","last_became_active":"2024-05-07T11:17:23.399228+0000","last_became_peered":"2024-05-07T11:17:23.399228+0000","last_unstale":"2024-05-07T11:18:01.279143+0000","last_undegraded":"2024-05-07T11:18:01.279143+0000","last_fullsized":"2024-05-07T11:18:01.279143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'208","last_scrub_stamp":"2024-05-07T11:18:01.279059+0000","last_deep_scrub":"83'208","last_deep_scrub_stamp":"2024-05-07T11:18:01.279059+0000","last_clean_scrub_stamp":"2024-05-07T11:18:01.279059+0000","objects_scrubbed":49,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:37.207758+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285094,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":285094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"83'12","reported_seq":178,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:55.005124+0000","last_change":"2024-05-07T11:17:55.005157+0000","last_active":"2024-05-07T11:17:55.005124+0000","last_peered":"2024-05-07T11:17:55.005124+0000","last_clean":"2024-05-07T11:17:55.005124+0000","last_became_active":"2024-05-07T11:17:18.432637+0000","last_became_peered":"2024-05-07T11:17:18.432637+0000","last_unstale":"2024-05-07T11:17:55.005124+0000","last_undegraded":"2024-05-07T11:17:55.005124+0000","last_fullsized":"2024-05-07T11:17:55.005124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'12","last_scrub_stamp":"2024-05-07T11:17:55.005031+0000","last_deep_scrub":"83'12","last_deep_scrub_stamp":"2024-05-07T11:17:55.005031+0000","last_clean_scrub_stamp":"2024-05-07T11:17:55.005031+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:38.264791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"83'3","reported_seq":170,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:11.035873+0000","last_change":"2024-05-07T11:18:11.035899+0000","last_active":"2024-05-07T11:18:11.035873+0000","last_peered":"2024-05-07T11:18:11.035873+0000","last_clean":"2024-05-07T11:18:11.035873+0000","last_became_active":"2024-05-07T11:17:18.433368+0000","last_became_peered":"2024-05-07T11:17:18.433368+0000","last_unstale":"2024-05-07T11:18:11.035873+0000","last_undegraded":"2024-05-07T11:18:11.035873+0000","last_fullsized":"2024-05-07T11:18:11.035873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'3","last_scrub_stamp":"2024-05-07T11:18:11.035779+0000","last_deep_scrub":"83'3","last_deep_scrub_stamp":"2024-05-07T11:18:11.035779+0000","last_clean_scrub_stamp":"2024-05-07T11:18:11.035779+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:32.317126+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"83'212","reported_seq":504,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:40.119960+0000","last_change":"2024-05-07T11:17:40.119960+0000","last_active":"2024-05-07T11:17:40.119960+0000","last_peered":"2024-05-07T11:17:40.119960+0000","last_clean":"2024-05-07T11:17:40.119960+0000","last_became_active":"2024-05-07T11:17:27.403866+0000","last_became_peered":"2024-05-07T11:17:27.403866+0000","last_unstale":"2024-05-07T11:17:40.119960+0000","last_undegraded":"2024-05-07T11:17:40.119960+0000","last_fullsized":"2024-05-07T11:17:40.119960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'212","last_scrub_stamp":"2024-05-07T11:17:40.119827+0000","last_deep_scrub":"83'212","last_deep_scrub_stamp":"2024-05-07T11:17:40.119827+0000","last_clean_scrub_stamp":"2024-05-07T11:17:40.119827+0000","objects_scrubbed":57,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:28:51.573724+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170353,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":166862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"83'4","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:00.330469+0000","last_change":"2024-05-07T11:18:00.330496+0000","last_active":"2024-05-07T11:18:00.330469+0000","last_peered":"2024-05-07T11:18:00.330469+0000","last_clean":"2024-05-07T11:18:00.330469+0000","last_became_active":"2024-05-07T11:17:18.432647+0000","last_became_peered":"2024-05-07T11:17:18.432647+0000","last_unstale":"2024-05-07T11:18:00.330469+0000","last_undegraded":"2024-05-07T11:18:00.330469+0000","last_fullsized":"2024-05-07T11:18:00.330469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'4","last_scrub_stamp":"2024-05-07T11:18:00.330384+0000","last_deep_scrub":"83'4","last_deep_scrub_stamp":"2024-05-07T11:18:00.330384+0000","last_clean_scrub_stamp":"2024-05-07T11:18:00.330384+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:28:20.417675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"83'221","reported_seq":387,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.273587+0000","last_change":"2024-05-07T11:17:47.273619+0000","last_active":"2024-05-07T11:17:47.273587+0000","last_peered":"2024-05-07T11:17:47.273587+0000","last_clean":"2024-05-07T11:17:47.273587+0000","last_became_active":"2024-05-07T11:17:21.417642+0000","last_became_peered":"2024-05-07T11:17:21.417642+0000","last_unstale":"2024-05-07T11:17:47.273587+0000","last_undegraded":"2024-05-07T11:17:47.273587+0000","last_fullsized":"2024-05-07T11:17:47.273587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'221","last_scrub_stamp":"2024-05-07T11:17:47.273504+0000","last_deep_scrub":"83'221","last_deep_scrub_stamp":"2024-05-07T11:17:47.273504+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.273504+0000","objects_scrubbed":54,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:32:07.829004+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315231,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":287595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"83'2","reported_seq":104,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:49.987444+0000","last_change":"2024-05-07T11:17:49.987471+0000","last_active":"2024-05-07T11:17:49.987444+0000","last_peered":"2024-05-07T11:17:49.987444+0000","last_clean":"2024-05-07T11:17:49.987444+0000","last_became_active":"2024-05-07T11:17:22.418134+0000","last_became_peered":"2024-05-07T11:17:22.418134+0000","last_unstale":"2024-05-07T11:17:49.987444+0000","last_undegraded":"2024-05-07T11:17:49.987444+0000","last_fullsized":"2024-05-07T11:17:49.987444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'2","last_scrub_stamp":"2024-05-07T11:17:49.987323+0000","last_deep_scrub":"83'2","last_deep_scrub_stamp":"2024-05-07T11:17:49.987323+0000","last_clean_scrub_stamp":"2024-05-07T11:17:49.987323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:12:22.356303+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"83'209","reported_seq":588,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:15.124379+0000","last_change":"2024-05-07T11:18:15.124404+0000","last_active":"2024-05-07T11:18:15.124379+0000","last_peered":"2024-05-07T11:18:15.124379+0000","last_clean":"2024-05-07T11:18:15.124379+0000","last_became_active":"2024-05-07T11:17:29.407677+0000","last_became_peered":"2024-05-07T11:17:29.407677+0000","last_unstale":"2024-05-07T11:18:15.124379+0000","last_undegraded":"2024-05-07T11:18:15.124379+0000","last_fullsized":"2024-05-07T11:18:15.124379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'209","last_scrub_stamp":"2024-05-07T11:18:15.124301+0000","last_deep_scrub":"83'209","last_deep_scrub_stamp":"2024-05-07T11:18:15.124301+0000","last_clean_scrub_stamp":"2024-05-07T11:18:15.124301+0000","objects_scrubbed":50,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:25.074219+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83349,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":83336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'1","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:00.068911+0000","last_change":"2024-05-07T11:18:00.068952+0000","last_active":"2024-05-07T11:18:00.068911+0000","last_peered":"2024-05-07T11:18:00.068911+0000","last_clean":"2024-05-07T11:18:00.068911+0000","last_became_active":"2024-05-07T11:17:22.424569+0000","last_became_peered":"2024-05-07T11:17:22.424569+0000","last_unstale":"2024-05-07T11:18:00.068911+0000","last_undegraded":"2024-05-07T11:18:00.068911+0000","last_fullsized":"2024-05-07T11:18:00.068911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-05-07T11:18:00.068784+0000","last_deep_scrub":"59'1","last_deep_scrub_stamp":"2024-05-07T11:18:00.068784+0000","last_clean_scrub_stamp":"2024-05-07T11:18:00.068784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:29.774977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"83'215","reported_seq":376,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:55.350485+0000","last_change":"2024-05-07T11:17:55.350512+0000","last_active":"2024-05-07T11:17:55.350485+0000","last_peered":"2024-05-07T11:17:55.350485+0000","last_clean":"2024-05-07T11:17:55.350485+0000","last_became_active":"2024-05-07T11:12:44.052014+0000","last_became_peered":"2024-05-07T11:12:44.052014+0000","last_unstale":"2024-05-07T11:17:55.350485+0000","last_undegraded":"2024-05-07T11:17:55.350485+0000","last_fullsized":"2024-05-07T11:17:55.350485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'215","last_scrub_stamp":"2024-05-07T11:17:55.350399+0000","last_deep_scrub":"83'215","last_deep_scrub_stamp":"2024-05-07T11:17:55.350399+0000","last_clean_scrub_stamp":"2024-05-07T11:17:55.350399+0000","objects_scrubbed":51,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:21:47.599124+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102022,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"83'18","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:42.260730+0000","last_change":"2024-05-07T11:17:42.260756+0000","last_active":"2024-05-07T11:17:42.260730+0000","last_peered":"2024-05-07T11:17:42.260730+0000","last_clean":"2024-05-07T11:17:42.260730+0000","last_became_active":"2024-05-07T11:17:18.403517+0000","last_became_peered":"2024-05-07T11:17:18.403517+0000","last_unstale":"2024-05-07T11:17:42.260730+0000","last_undegraded":"2024-05-07T11:17:42.260730+0000","last_fullsized":"2024-05-07T11:17:42.260730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'18","last_scrub_stamp":"2024-05-07T11:17:42.260615+0000","last_deep_scrub":"83'18","last_deep_scrub_stamp":"2024-05-07T11:17:42.260615+0000","last_clean_scrub_stamp":"2024-05-07T11:17:42.260615+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:52:04.635816+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"83'234","reported_seq":633,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:46.011170+0000","last_change":"2024-05-07T11:17:46.011210+0000","last_active":"2024-05-07T11:17:46.011170+0000","last_peered":"2024-05-07T11:17:46.011170+0000","last_clean":"2024-05-07T11:17:46.011170+0000","last_became_active":"2024-05-07T11:17:28.400673+0000","last_became_peered":"2024-05-07T11:17:28.400673+0000","last_unstale":"2024-05-07T11:17:46.011170+0000","last_undegraded":"2024-05-07T11:17:46.011170+0000","last_fullsized":"2024-05-07T11:17:46.011170+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'234","last_scrub_stamp":"2024-05-07T11:17:46.011079+0000","last_deep_scrub":"83'234","last_deep_scrub_stamp":"2024-05-07T11:17:46.011079+0000","last_clean_scrub_stamp":"2024-05-07T11:17:46.011079+0000","objects_scrubbed":62,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:52.036574+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143885,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":127501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":159,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:06.151855+0000","last_change":"2024-05-07T11:18:06.151884+0000","last_active":"2024-05-07T11:18:06.151855+0000","last_peered":"2024-05-07T11:18:06.151855+0000","last_clean":"2024-05-07T11:18:06.151855+0000","last_became_active":"2024-05-07T11:12:43.052403+0000","last_became_peered":"2024-05-07T11:12:43.052403+0000","last_unstale":"2024-05-07T11:18:06.151855+0000","last_undegraded":"2024-05-07T11:18:06.151855+0000","last_fullsized":"2024-05-07T11:18:06.151855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:18:06.151768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:18:06.151768+0000","last_clean_scrub_stamp":"2024-05-07T11:18:06.151768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:31.959839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"83'217","reported_seq":584,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:39.078656+0000","last_change":"2024-05-07T11:17:39.078687+0000","last_active":"2024-05-07T11:17:39.078656+0000","last_peered":"2024-05-07T11:17:39.078656+0000","last_clean":"2024-05-07T11:17:39.078656+0000","last_became_active":"2024-05-07T11:17:27.404340+0000","last_became_peered":"2024-05-07T11:17:27.404340+0000","last_unstale":"2024-05-07T11:17:39.078656+0000","last_undegraded":"2024-05-07T11:17:39.078656+0000","last_fullsized":"2024-05-07T11:17:39.078656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'217","last_scrub_stamp":"2024-05-07T11:17:39.078562+0000","last_deep_scrub":"83'217","last_deep_scrub_stamp":"2024-05-07T11:17:39.078562+0000","last_clean_scrub_stamp":"2024-05-07T11:17:39.078562+0000","objects_scrubbed":54,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:32:20.273980+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131715,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":119690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:57.312172+0000","last_change":"2024-05-07T11:17:57.312195+0000","last_active":"2024-05-07T11:17:57.312172+0000","last_peered":"2024-05-07T11:17:57.312172+0000","last_clean":"2024-05-07T11:17:57.312172+0000","last_became_active":"2024-05-07T11:17:18.422776+0000","last_became_peered":"2024-05-07T11:17:18.422776+0000","last_unstale":"2024-05-07T11:17:57.312172+0000","last_undegraded":"2024-05-07T11:17:57.312172+0000","last_fullsized":"2024-05-07T11:17:57.312172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:57.312086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:57.312086+0000","last_clean_scrub_stamp":"2024-05-07T11:17:57.312086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:07.100598+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"83'193","reported_seq":540,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:45.025977+0000","last_change":"2024-05-07T11:17:45.026028+0000","last_active":"2024-05-07T11:17:45.025977+0000","last_peered":"2024-05-07T11:17:45.025977+0000","last_clean":"2024-05-07T11:17:45.025977+0000","last_became_active":"2024-05-07T11:17:24.403279+0000","last_became_peered":"2024-05-07T11:17:24.403279+0000","last_unstale":"2024-05-07T11:17:45.025977+0000","last_undegraded":"2024-05-07T11:17:45.025977+0000","last_fullsized":"2024-05-07T11:17:45.025977+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'193","last_scrub_stamp":"2024-05-07T11:17:45.025873+0000","last_deep_scrub":"83'193","last_deep_scrub_stamp":"2024-05-07T11:17:45.025873+0000","last_clean_scrub_stamp":"2024-05-07T11:17:45.025873+0000","objects_scrubbed":56,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:49:13.481745+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200707,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":177957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"58'1","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:59.348178+0000","last_change":"2024-05-07T11:17:59.348204+0000","last_active":"2024-05-07T11:17:59.348178+0000","last_peered":"2024-05-07T11:17:59.348178+0000","last_clean":"2024-05-07T11:17:59.348178+0000","last_became_active":"2024-05-07T11:17:18.431649+0000","last_became_peered":"2024-05-07T11:17:18.431649+0000","last_unstale":"2024-05-07T11:17:59.348178+0000","last_undegraded":"2024-05-07T11:17:59.348178+0000","last_fullsized":"2024-05-07T11:17:59.348178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'1","last_scrub_stamp":"2024-05-07T11:17:59.348087+0000","last_deep_scrub":"58'1","last_deep_scrub_stamp":"2024-05-07T11:17:59.348087+0000","last_clean_scrub_stamp":"2024-05-07T11:17:59.348087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:59.008231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"83'194","reported_seq":539,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:51.378119+0000","last_change":"2024-05-07T11:17:51.378147+0000","last_active":"2024-05-07T11:17:51.378119+0000","last_peered":"2024-05-07T11:17:51.378119+0000","last_clean":"2024-05-07T11:17:51.378119+0000","last_became_active":"2024-05-07T11:17:22.416595+0000","last_became_peered":"2024-05-07T11:17:22.416595+0000","last_unstale":"2024-05-07T11:17:51.378119+0000","last_undegraded":"2024-05-07T11:17:51.378119+0000","last_fullsized":"2024-05-07T11:17:51.378119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'194","last_scrub_stamp":"2024-05-07T11:17:51.378022+0000","last_deep_scrub":"83'194","last_deep_scrub_stamp":"2024-05-07T11:17:51.378022+0000","last_clean_scrub_stamp":"2024-05-07T11:17:51.378022+0000","objects_scrubbed":53,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:55.523756+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144588,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":130920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"83'159","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:50.980974+0000","last_change":"2024-05-07T11:17:50.981010+0000","last_active":"2024-05-07T11:17:50.980974+0000","last_peered":"2024-05-07T11:17:50.980974+0000","last_clean":"2024-05-07T11:17:50.980974+0000","last_became_active":"2024-05-07T11:17:18.433541+0000","last_became_peered":"2024-05-07T11:17:18.433541+0000","last_unstale":"2024-05-07T11:17:50.980974+0000","last_undegraded":"2024-05-07T11:17:50.980974+0000","last_fullsized":"2024-05-07T11:17:50.980974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'159","last_scrub_stamp":"2024-05-07T11:17:50.980889+0000","last_deep_scrub":"83'159","last_deep_scrub_stamp":"2024-05-07T11:17:50.980889+0000","last_clean_scrub_stamp":"2024-05-07T11:17:50.980889+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:11:04.996284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:59.021406+0000","last_change":"2024-05-07T11:17:59.021427+0000","last_active":"2024-05-07T11:17:59.021406+0000","last_peered":"2024-05-07T11:17:59.021406+0000","last_clean":"2024-05-07T11:17:59.021406+0000","last_became_active":"2024-05-07T11:17:18.404739+0000","last_became_peered":"2024-05-07T11:17:18.404739+0000","last_unstale":"2024-05-07T11:17:59.021406+0000","last_undegraded":"2024-05-07T11:17:59.021406+0000","last_fullsized":"2024-05-07T11:17:59.021406+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:59.021302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:59.021302+0000","last_clean_scrub_stamp":"2024-05-07T11:17:59.021302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:24.430757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'2","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:00.266003+0000","last_change":"2024-05-07T11:18:00.266033+0000","last_active":"2024-05-07T11:18:00.266003+0000","last_peered":"2024-05-07T11:18:00.266003+0000","last_clean":"2024-05-07T11:18:00.266003+0000","last_became_active":"2024-05-07T11:17:18.429225+0000","last_became_peered":"2024-05-07T11:17:18.429225+0000","last_unstale":"2024-05-07T11:18:00.266003+0000","last_undegraded":"2024-05-07T11:18:00.266003+0000","last_fullsized":"2024-05-07T11:18:00.266003+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-05-07T11:18:00.265915+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-05-07T11:18:00.265915+0000","last_clean_scrub_stamp":"2024-05-07T11:18:00.265915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:31:32.771541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"83'206","reported_seq":542,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:13.082009+0000","last_change":"2024-05-07T11:18:13.082043+0000","last_active":"2024-05-07T11:18:13.082009+0000","last_peered":"2024-05-07T11:18:13.082009+0000","last_clean":"2024-05-07T11:18:13.082009+0000","last_became_active":"2024-05-07T11:17:23.403081+0000","last_became_peered":"2024-05-07T11:17:23.403081+0000","last_unstale":"2024-05-07T11:18:13.082009+0000","last_undegraded":"2024-05-07T11:18:13.082009+0000","last_fullsized":"2024-05-07T11:18:13.082009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'206","last_scrub_stamp":"2024-05-07T11:18:13.081930+0000","last_deep_scrub":"83'206","last_deep_scrub_stamp":"2024-05-07T11:18:13.081930+0000","last_clean_scrub_stamp":"2024-05-07T11:18:13.081930+0000","objects_scrubbed":59,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:46.660661+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161960,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":138308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.962154+0000","last_change":"2024-05-07T11:17:52.962179+0000","last_active":"2024-05-07T11:17:52.962154+0000","last_peered":"2024-05-07T11:17:52.962154+0000","last_clean":"2024-05-07T11:17:52.962154+0000","last_became_active":"2024-05-07T11:17:18.432770+0000","last_became_peered":"2024-05-07T11:17:18.432770+0000","last_unstale":"2024-05-07T11:17:52.962154+0000","last_undegraded":"2024-05-07T11:17:52.962154+0000","last_fullsized":"2024-05-07T11:17:52.962154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:52.962063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:52.962063+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.962063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:32:03.113448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"83'36","reported_seq":230,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:53.329701+0000","last_change":"2024-05-07T11:17:53.329728+0000","last_active":"2024-05-07T11:17:53.329701+0000","last_peered":"2024-05-07T11:17:53.329701+0000","last_clean":"2024-05-07T11:17:53.329701+0000","last_became_active":"2024-05-07T11:12:43.048116+0000","last_became_peered":"2024-05-07T11:12:43.048116+0000","last_unstale":"2024-05-07T11:17:53.329701+0000","last_undegraded":"2024-05-07T11:17:53.329701+0000","last_fullsized":"2024-05-07T11:17:53.329701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'36","last_scrub_stamp":"2024-05-07T11:17:53.329615+0000","last_deep_scrub":"83'36","last_deep_scrub_stamp":"2024-05-07T11:17:53.329615+0000","last_clean_scrub_stamp":"2024-05-07T11:17:53.329615+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:27:38.387178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":33,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"83'216","reported_seq":380,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:54.342114+0000","last_change":"2024-05-07T11:17:54.342148+0000","last_active":"2024-05-07T11:17:54.342114+0000","last_peered":"2024-05-07T11:17:54.342114+0000","last_clean":"2024-05-07T11:17:54.342114+0000","last_became_active":"2024-05-07T11:17:24.406306+0000","last_became_peered":"2024-05-07T11:17:24.406306+0000","last_unstale":"2024-05-07T11:17:54.342114+0000","last_undegraded":"2024-05-07T11:17:54.342114+0000","last_fullsized":"2024-05-07T11:17:54.342114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'216","last_scrub_stamp":"2024-05-07T11:17:54.342032+0000","last_deep_scrub":"83'216","last_deep_scrub_stamp":"2024-05-07T11:17:54.342032+0000","last_clean_scrub_stamp":"2024-05-07T11:17:54.342032+0000","objects_scrubbed":56,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:16:33.674063+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418176,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":402414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:59.282756+0000","last_change":"2024-05-07T11:17:59.282780+0000","last_active":"2024-05-07T11:17:59.282756+0000","last_peered":"2024-05-07T11:17:59.282756+0000","last_clean":"2024-05-07T11:17:59.282756+0000","last_became_active":"2024-05-07T11:17:18.425833+0000","last_became_peered":"2024-05-07T11:17:18.425833+0000","last_unstale":"2024-05-07T11:17:59.282756+0000","last_undegraded":"2024-05-07T11:17:59.282756+0000","last_fullsized":"2024-05-07T11:17:59.282756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:59.282634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:59.282634+0000","last_clean_scrub_stamp":"2024-05-07T11:17:59.282634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:35:39.844340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"83'57","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:53.253743+0000","last_change":"2024-05-07T11:17:53.253838+0000","last_active":"2024-05-07T11:17:53.253743+0000","last_peered":"2024-05-07T11:17:53.253743+0000","last_clean":"2024-05-07T11:17:53.253743+0000","last_became_active":"2024-05-07T11:17:18.431849+0000","last_became_peered":"2024-05-07T11:17:18.431849+0000","last_unstale":"2024-05-07T11:17:53.253743+0000","last_undegraded":"2024-05-07T11:17:53.253743+0000","last_fullsized":"2024-05-07T11:17:53.253743+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'57","last_scrub_stamp":"2024-05-07T11:17:53.253612+0000","last_deep_scrub":"83'57","last_deep_scrub_stamp":"2024-05-07T11:17:53.253612+0000","last_clean_scrub_stamp":"2024-05-07T11:17:53.253612+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:47.846273+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"83'225","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:06.265502+0000","last_change":"2024-05-07T11:18:06.265534+0000","last_active":"2024-05-07T11:18:06.265502+0000","last_peered":"2024-05-07T11:18:06.265502+0000","last_clean":"2024-05-07T11:18:06.265502+0000","last_became_active":"2024-05-07T11:17:26.407203+0000","last_became_peered":"2024-05-07T11:17:26.407203+0000","last_unstale":"2024-05-07T11:18:06.265502+0000","last_undegraded":"2024-05-07T11:18:06.265502+0000","last_fullsized":"2024-05-07T11:18:06.265502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'225","last_scrub_stamp":"2024-05-07T11:18:06.265425+0000","last_deep_scrub":"83'225","last_deep_scrub_stamp":"2024-05-07T11:18:06.265425+0000","last_clean_scrub_stamp":"2024-05-07T11:18:06.265425+0000","objects_scrubbed":56,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:31:04.468855+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384390,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":384377,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:04.129785+0000","last_change":"2024-05-07T11:18:04.129809+0000","last_active":"2024-05-07T11:18:04.129785+0000","last_peered":"2024-05-07T11:18:04.129785+0000","last_clean":"2024-05-07T11:18:04.129785+0000","last_became_active":"2024-05-07T11:12:38.711954+0000","last_became_peered":"2024-05-07T11:12:38.711954+0000","last_unstale":"2024-05-07T11:18:04.129785+0000","last_undegraded":"2024-05-07T11:18:04.129785+0000","last_fullsized":"2024-05-07T11:18:04.129785+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:18:04.129696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:18:04.129696+0000","last_clean_scrub_stamp":"2024-05-07T11:18:04.129696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:28:30.154123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":171,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:57.010295+0000","last_change":"2024-05-07T11:17:57.010321+0000","last_active":"2024-05-07T11:17:57.010295+0000","last_peered":"2024-05-07T11:17:57.010295+0000","last_clean":"2024-05-07T11:17:57.010295+0000","last_became_active":"2024-05-07T11:17:18.403986+0000","last_became_peered":"2024-05-07T11:17:18.403986+0000","last_unstale":"2024-05-07T11:17:57.010295+0000","last_undegraded":"2024-05-07T11:17:57.010295+0000","last_fullsized":"2024-05-07T11:17:57.010295+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:57.010202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:57.010202+0000","last_clean_scrub_stamp":"2024-05-07T11:17:57.010202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:14.384618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"83'212","reported_seq":305,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:04.270602+0000","last_change":"2024-05-07T11:18:04.270667+0000","last_active":"2024-05-07T11:18:04.270602+0000","last_peered":"2024-05-07T11:18:04.270602+0000","last_clean":"2024-05-07T11:18:04.270602+0000","last_became_active":"2024-05-07T11:17:25.412026+0000","last_became_peered":"2024-05-07T11:17:25.412026+0000","last_unstale":"2024-05-07T11:18:04.270602+0000","last_undegraded":"2024-05-07T11:18:04.270602+0000","last_fullsized":"2024-05-07T11:18:04.270602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'212","last_scrub_stamp":"2024-05-07T11:18:04.270520+0000","last_deep_scrub":"83'212","last_deep_scrub_stamp":"2024-05-07T11:18:04.270520+0000","last_clean_scrub_stamp":"2024-05-07T11:18:04.270520+0000","objects_scrubbed":61,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:29:58.078343+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174891,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":174891,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'1","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:56.036277+0000","last_change":"2024-05-07T11:17:56.036303+0000","last_active":"2024-05-07T11:17:56.036277+0000","last_peered":"2024-05-07T11:17:56.036277+0000","last_clean":"2024-05-07T11:17:56.036277+0000","last_became_active":"2024-05-07T11:17:22.424550+0000","last_became_peered":"2024-05-07T11:17:22.424550+0000","last_unstale":"2024-05-07T11:17:56.036277+0000","last_undegraded":"2024-05-07T11:17:56.036277+0000","last_fullsized":"2024-05-07T11:17:56.036277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-05-07T11:17:56.036184+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-05-07T11:17:56.036184+0000","last_clean_scrub_stamp":"2024-05-07T11:17:56.036184+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:56:59.214039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:44.239921+0000","last_change":"2024-05-07T11:17:44.239945+0000","last_active":"2024-05-07T11:17:44.239921+0000","last_peered":"2024-05-07T11:17:44.239921+0000","last_clean":"2024-05-07T11:17:44.239921+0000","last_became_active":"2024-05-07T11:17:18.432929+0000","last_became_peered":"2024-05-07T11:17:18.432929+0000","last_unstale":"2024-05-07T11:17:44.239921+0000","last_undegraded":"2024-05-07T11:17:44.239921+0000","last_fullsized":"2024-05-07T11:17:44.239921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:44.239834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:44.239834+0000","last_clean_scrub_stamp":"2024-05-07T11:17:44.239834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:25:18.735065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"83'199","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:10.518882+0000","last_change":"2024-05-07T11:18:10.518921+0000","last_active":"2024-05-07T11:18:10.518882+0000","last_peered":"2024-05-07T11:18:10.518882+0000","last_clean":"2024-05-07T11:18:10.518882+0000","last_became_active":"2024-05-07T11:17:29.407296+0000","last_became_peered":"2024-05-07T11:17:29.407296+0000","last_unstale":"2024-05-07T11:18:10.518882+0000","last_undegraded":"2024-05-07T11:18:10.518882+0000","last_fullsized":"2024-05-07T11:18:10.518882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'199","last_scrub_stamp":"2024-05-07T11:18:10.518795+0000","last_deep_scrub":"83'199","last_deep_scrub_stamp":"2024-05-07T11:18:10.518795+0000","last_clean_scrub_stamp":"2024-05-07T11:18:10.518795+0000","objects_scrubbed":41,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:18:01.224824+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74552,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":74509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:48.258915+0000","last_change":"2024-05-07T11:17:48.258940+0000","last_active":"2024-05-07T11:17:48.258915+0000","last_peered":"2024-05-07T11:17:48.258915+0000","last_clean":"2024-05-07T11:17:48.258915+0000","last_became_active":"2024-05-07T11:17:18.431542+0000","last_became_peered":"2024-05-07T11:17:18.431542+0000","last_unstale":"2024-05-07T11:17:48.258915+0000","last_undegraded":"2024-05-07T11:17:48.258915+0000","last_fullsized":"2024-05-07T11:17:48.258915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:48.258794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:48.258794+0000","last_clean_scrub_stamp":"2024-05-07T11:17:48.258794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:58:23.353531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:58.354492+0000","last_change":"2024-05-07T11:17:58.354533+0000","last_active":"2024-05-07T11:17:58.354492+0000","last_peered":"2024-05-07T11:17:58.354492+0000","last_clean":"2024-05-07T11:17:58.354492+0000","last_became_active":"2024-05-07T11:17:18.429866+0000","last_became_peered":"2024-05-07T11:17:18.429866+0000","last_unstale":"2024-05-07T11:17:58.354492+0000","last_undegraded":"2024-05-07T11:17:58.354492+0000","last_fullsized":"2024-05-07T11:17:58.354492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:58.354388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:58.354388+0000","last_clean_scrub_stamp":"2024-05-07T11:17:58.354388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:38.614551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"83'233","reported_seq":395,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.293237+0000","last_change":"2024-05-07T11:17:52.293267+0000","last_active":"2024-05-07T11:17:52.293237+0000","last_peered":"2024-05-07T11:17:52.293237+0000","last_clean":"2024-05-07T11:17:52.293237+0000","last_became_active":"2024-05-07T11:17:23.398265+0000","last_became_peered":"2024-05-07T11:17:23.398265+0000","last_unstale":"2024-05-07T11:17:52.293237+0000","last_undegraded":"2024-05-07T11:17:52.293237+0000","last_fullsized":"2024-05-07T11:17:52.293237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'233","last_scrub_stamp":"2024-05-07T11:17:52.293156+0000","last_deep_scrub":"83'233","last_deep_scrub_stamp":"2024-05-07T11:17:52.293156+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.293156+0000","objects_scrubbed":52,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:41:46.740290+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198182,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":171823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"83'3","reported_seq":111,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:09.117849+0000","last_change":"2024-05-07T11:18:09.117849+0000","last_active":"2024-05-07T11:18:09.117849+0000","last_peered":"2024-05-07T11:18:09.117849+0000","last_clean":"2024-05-07T11:18:09.117849+0000","last_became_active":"2024-05-07T11:17:18.431883+0000","last_became_peered":"2024-05-07T11:17:18.431883+0000","last_unstale":"2024-05-07T11:18:09.117849+0000","last_undegraded":"2024-05-07T11:18:09.117849+0000","last_fullsized":"2024-05-07T11:18:09.117849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'3","last_scrub_stamp":"2024-05-07T11:18:09.117718+0000","last_deep_scrub":"83'3","last_deep_scrub_stamp":"2024-05-07T11:18:09.117718+0000","last_clean_scrub_stamp":"2024-05-07T11:18:09.117718+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:06:15.322000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:46.241049+0000","last_change":"2024-05-07T11:17:46.241075+0000","last_active":"2024-05-07T11:17:46.241049+0000","last_peered":"2024-05-07T11:17:46.241049+0000","last_clean":"2024-05-07T11:17:46.241049+0000","last_became_active":"2024-05-07T11:17:18.432126+0000","last_became_peered":"2024-05-07T11:17:18.432126+0000","last_unstale":"2024-05-07T11:17:46.241049+0000","last_undegraded":"2024-05-07T11:17:46.241049+0000","last_fullsized":"2024-05-07T11:17:46.241049+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:46.240900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:46.240900+0000","last_clean_scrub_stamp":"2024-05-07T11:17:46.240900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:37.866026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"83'233","reported_seq":354,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:54.033859+0000","last_change":"2024-05-07T11:17:54.033895+0000","last_active":"2024-05-07T11:17:54.033859+0000","last_peered":"2024-05-07T11:17:54.033859+0000","last_clean":"2024-05-07T11:17:54.033859+0000","last_became_active":"2024-05-07T11:17:22.419258+0000","last_became_peered":"2024-05-07T11:17:22.419258+0000","last_unstale":"2024-05-07T11:17:54.033859+0000","last_undegraded":"2024-05-07T11:17:54.033859+0000","last_fullsized":"2024-05-07T11:17:54.033859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'233","last_scrub_stamp":"2024-05-07T11:17:54.033780+0000","last_deep_scrub":"83'233","last_deep_scrub_stamp":"2024-05-07T11:17:54.033780+0000","last_clean_scrub_stamp":"2024-05-07T11:17:54.033780+0000","objects_scrubbed":58,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:47.910390+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504756,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"83'39","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:40.262548+0000","last_change":"2024-05-07T11:17:40.262573+0000","last_active":"2024-05-07T11:17:40.262548+0000","last_peered":"2024-05-07T11:17:40.262548+0000","last_clean":"2024-05-07T11:17:40.262548+0000","last_became_active":"2024-05-07T11:17:18.404892+0000","last_became_peered":"2024-05-07T11:17:18.404892+0000","last_unstale":"2024-05-07T11:17:40.262548+0000","last_undegraded":"2024-05-07T11:17:40.262548+0000","last_fullsized":"2024-05-07T11:17:40.262548+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'39","last_scrub_stamp":"2024-05-07T11:17:40.262463+0000","last_deep_scrub":"83'39","last_deep_scrub_stamp":"2024-05-07T11:17:40.262463+0000","last_clean_scrub_stamp":"2024-05-07T11:17:40.262463+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:30:27.064631+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:10.068300+0000","last_change":"2024-05-07T11:18:10.068325+0000","last_active":"2024-05-07T11:18:10.068300+0000","last_peered":"2024-05-07T11:18:10.068300+0000","last_clean":"2024-05-07T11:18:10.068300+0000","last_became_active":"2024-05-07T11:17:18.432841+0000","last_became_peered":"2024-05-07T11:17:18.432841+0000","last_unstale":"2024-05-07T11:18:10.068300+0000","last_undegraded":"2024-05-07T11:18:10.068300+0000","last_fullsized":"2024-05-07T11:18:10.068300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:18:10.068213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:18:10.068213+0000","last_clean_scrub_stamp":"2024-05-07T11:18:10.068213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:36:44.911021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"83'190","reported_seq":353,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:46.276900+0000","last_change":"2024-05-07T11:17:46.276956+0000","last_active":"2024-05-07T11:17:46.276900+0000","last_peered":"2024-05-07T11:17:46.276900+0000","last_clean":"2024-05-07T11:17:46.276900+0000","last_became_active":"2024-05-07T11:17:22.416984+0000","last_became_peered":"2024-05-07T11:17:22.416984+0000","last_unstale":"2024-05-07T11:17:46.276900+0000","last_undegraded":"2024-05-07T11:17:46.276900+0000","last_fullsized":"2024-05-07T11:17:46.276900+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'190","last_scrub_stamp":"2024-05-07T11:17:46.276811+0000","last_deep_scrub":"83'190","last_deep_scrub_stamp":"2024-05-07T11:17:46.276811+0000","last_clean_scrub_stamp":"2024-05-07T11:17:46.276811+0000","objects_scrubbed":52,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:04:11.845008+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139972,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":130810,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"83'224","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:47.030675+0000","last_change":"2024-05-07T11:17:47.030735+0000","last_active":"2024-05-07T11:17:47.030675+0000","last_peered":"2024-05-07T11:17:47.030675+0000","last_clean":"2024-05-07T11:17:47.030675+0000","last_became_active":"2024-05-07T11:17:23.400156+0000","last_became_peered":"2024-05-07T11:17:23.400156+0000","last_unstale":"2024-05-07T11:17:47.030675+0000","last_undegraded":"2024-05-07T11:17:47.030675+0000","last_fullsized":"2024-05-07T11:17:47.030675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'224","last_scrub_stamp":"2024-05-07T11:17:47.030564+0000","last_deep_scrub":"83'224","last_deep_scrub_stamp":"2024-05-07T11:17:47.030564+0000","last_clean_scrub_stamp":"2024-05-07T11:17:47.030564+0000","objects_scrubbed":60,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:52:51.327322+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129621,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":123585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"83'48","reported_seq":221,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:01.091214+0000","last_change":"2024-05-07T11:18:01.091265+0000","last_active":"2024-05-07T11:18:01.091214+0000","last_peered":"2024-05-07T11:18:01.091214+0000","last_clean":"2024-05-07T11:18:01.091214+0000","last_became_active":"2024-05-07T11:17:18.434016+0000","last_became_peered":"2024-05-07T11:17:18.434016+0000","last_unstale":"2024-05-07T11:18:01.091214+0000","last_undegraded":"2024-05-07T11:18:01.091214+0000","last_fullsized":"2024-05-07T11:18:01.091214+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'48","last_scrub_stamp":"2024-05-07T11:18:01.091102+0000","last_deep_scrub":"83'48","last_deep_scrub_stamp":"2024-05-07T11:18:01.091102+0000","last_clean_scrub_stamp":"2024-05-07T11:18:01.091102+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:58:12.588665+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":3862610,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"83'198","reported_seq":291,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:05.281472+0000","last_change":"2024-05-07T11:18:05.281500+0000","last_active":"2024-05-07T11:18:05.281472+0000","last_peered":"2024-05-07T11:18:05.281472+0000","last_clean":"2024-05-07T11:18:05.281472+0000","last_became_active":"2024-05-07T11:17:25.412149+0000","last_became_peered":"2024-05-07T11:17:25.412149+0000","last_unstale":"2024-05-07T11:18:05.281472+0000","last_undegraded":"2024-05-07T11:18:05.281472+0000","last_fullsized":"2024-05-07T11:18:05.281472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'198","last_scrub_stamp":"2024-05-07T11:18:05.281384+0000","last_deep_scrub":"83'198","last_deep_scrub_stamp":"2024-05-07T11:18:05.281384+0000","last_clean_scrub_stamp":"2024-05-07T11:18:05.281384+0000","objects_scrubbed":52,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:44.146749+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97400,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":97400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"83'24","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:01.347635+0000","last_change":"2024-05-07T11:18:01.347664+0000","last_active":"2024-05-07T11:18:01.347635+0000","last_peered":"2024-05-07T11:18:01.347635+0000","last_clean":"2024-05-07T11:18:01.347635+0000","last_became_active":"2024-05-07T11:17:18.427837+0000","last_became_peered":"2024-05-07T11:17:18.427837+0000","last_unstale":"2024-05-07T11:18:01.347635+0000","last_undegraded":"2024-05-07T11:18:01.347635+0000","last_fullsized":"2024-05-07T11:18:01.347635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'24","last_scrub_stamp":"2024-05-07T11:18:01.347549+0000","last_deep_scrub":"83'24","last_deep_scrub_stamp":"2024-05-07T11:18:01.347549+0000","last_clean_scrub_stamp":"2024-05-07T11:18:01.347549+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:27.731409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"56'1","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:58.043182+0000","last_change":"2024-05-07T11:17:58.043208+0000","last_active":"2024-05-07T11:17:58.043182+0000","last_peered":"2024-05-07T11:17:58.043182+0000","last_clean":"2024-05-07T11:17:58.043182+0000","last_became_active":"2024-05-07T11:17:22.424603+0000","last_became_peered":"2024-05-07T11:17:22.424603+0000","last_unstale":"2024-05-07T11:17:58.043182+0000","last_undegraded":"2024-05-07T11:17:58.043182+0000","last_fullsized":"2024-05-07T11:17:58.043182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1","last_scrub_stamp":"2024-05-07T11:17:58.043088+0000","last_deep_scrub":"56'1","last_deep_scrub_stamp":"2024-05-07T11:17:58.043088+0000","last_clean_scrub_stamp":"2024-05-07T11:17:58.043088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:21:58.397347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"83'236","reported_seq":336,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:45.288243+0000","last_change":"2024-05-07T11:17:45.288277+0000","last_active":"2024-05-07T11:17:45.288243+0000","last_peered":"2024-05-07T11:17:45.288243+0000","last_clean":"2024-05-07T11:17:45.288243+0000","last_became_active":"2024-05-07T11:17:21.418814+0000","last_became_peered":"2024-05-07T11:17:21.418814+0000","last_unstale":"2024-05-07T11:17:45.288243+0000","last_undegraded":"2024-05-07T11:17:45.288243+0000","last_fullsized":"2024-05-07T11:17:45.288243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'236","last_scrub_stamp":"2024-05-07T11:17:45.288150+0000","last_deep_scrub":"83'236","last_deep_scrub_stamp":"2024-05-07T11:17:45.288150+0000","last_clean_scrub_stamp":"2024-05-07T11:17:45.288150+0000","objects_scrubbed":64,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:33.054850+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624875,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":622199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'2","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:57.328603+0000","last_change":"2024-05-07T11:17:57.328633+0000","last_active":"2024-05-07T11:17:57.328603+0000","last_peered":"2024-05-07T11:17:57.328603+0000","last_clean":"2024-05-07T11:17:57.328603+0000","last_became_active":"2024-05-07T11:17:18.403423+0000","last_became_peered":"2024-05-07T11:17:18.403423+0000","last_unstale":"2024-05-07T11:17:57.328603+0000","last_undegraded":"2024-05-07T11:17:57.328603+0000","last_fullsized":"2024-05-07T11:17:57.328603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-05-07T11:17:57.328510+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-05-07T11:17:57.328510+0000","last_clean_scrub_stamp":"2024-05-07T11:17:57.328510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:03.798077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"83'208","reported_seq":297,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:07.246062+0000","last_change":"2024-05-07T11:18:07.246109+0000","last_active":"2024-05-07T11:18:07.246062+0000","last_peered":"2024-05-07T11:18:07.246062+0000","last_clean":"2024-05-07T11:18:07.246062+0000","last_became_active":"2024-05-07T11:17:27.407792+0000","last_became_peered":"2024-05-07T11:17:27.407792+0000","last_unstale":"2024-05-07T11:18:07.246062+0000","last_undegraded":"2024-05-07T11:18:07.246062+0000","last_fullsized":"2024-05-07T11:18:07.246062+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'208","last_scrub_stamp":"2024-05-07T11:18:07.245952+0000","last_deep_scrub":"83'208","last_deep_scrub_stamp":"2024-05-07T11:18:07.245952+0000","last_clean_scrub_stamp":"2024-05-07T11:18:07.245952+0000","objects_scrubbed":52,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:18:14.297538+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70099,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"83'222","reported_seq":376,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:05.490346+0000","last_change":"2024-05-07T11:18:05.490431+0000","last_active":"2024-05-07T11:18:05.490346+0000","last_peered":"2024-05-07T11:18:05.490346+0000","last_clean":"2024-05-07T11:18:05.490346+0000","last_became_active":"2024-05-07T11:17:26.407230+0000","last_became_peered":"2024-05-07T11:17:26.407230+0000","last_unstale":"2024-05-07T11:18:05.490346+0000","last_undegraded":"2024-05-07T11:18:05.490346+0000","last_fullsized":"2024-05-07T11:18:05.490346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'222","last_scrub_stamp":"2024-05-07T11:18:05.490255+0000","last_deep_scrub":"83'222","last_deep_scrub_stamp":"2024-05-07T11:18:05.490255+0000","last_clean_scrub_stamp":"2024-05-07T11:18:05.490255+0000","objects_scrubbed":47,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:33:45.752707+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123449,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":91096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'1","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:50.321128+0000","last_change":"2024-05-07T11:17:50.321169+0000","last_active":"2024-05-07T11:17:50.321128+0000","last_peered":"2024-05-07T11:17:50.321128+0000","last_clean":"2024-05-07T11:17:50.321128+0000","last_became_active":"2024-05-07T11:17:18.431029+0000","last_became_peered":"2024-05-07T11:17:18.431029+0000","last_unstale":"2024-05-07T11:17:50.321128+0000","last_undegraded":"2024-05-07T11:17:50.321128+0000","last_fullsized":"2024-05-07T11:17:50.321128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'1","last_scrub_stamp":"2024-05-07T11:17:50.321000+0000","last_deep_scrub":"57'1","last_deep_scrub_stamp":"2024-05-07T11:17:50.321000+0000","last_clean_scrub_stamp":"2024-05-07T11:17:50.321000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:37:51.352461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"83'201","reported_seq":291,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:03.280942+0000","last_change":"2024-05-07T11:18:03.280988+0000","last_active":"2024-05-07T11:18:03.280942+0000","last_peered":"2024-05-07T11:18:03.280942+0000","last_clean":"2024-05-07T11:18:03.280942+0000","last_became_active":"2024-05-07T11:17:25.402661+0000","last_became_peered":"2024-05-07T11:17:25.402661+0000","last_unstale":"2024-05-07T11:18:03.280942+0000","last_undegraded":"2024-05-07T11:18:03.280942+0000","last_fullsized":"2024-05-07T11:18:03.280942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'201","last_scrub_stamp":"2024-05-07T11:18:03.280855+0000","last_deep_scrub":"83'201","last_deep_scrub_stamp":"2024-05-07T11:18:03.280855+0000","last_clean_scrub_stamp":"2024-05-07T11:18:03.280855+0000","objects_scrubbed":48,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T12:41:12.470372+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82583,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":73397,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:56.295373+0000","last_change":"2024-05-07T11:17:56.295430+0000","last_active":"2024-05-07T11:17:56.295373+0000","last_peered":"2024-05-07T11:17:56.295373+0000","last_clean":"2024-05-07T11:17:56.295373+0000","last_became_active":"2024-05-07T11:17:18.402493+0000","last_became_peered":"2024-05-07T11:17:18.402493+0000","last_unstale":"2024-05-07T11:17:56.295373+0000","last_undegraded":"2024-05-07T11:17:56.295373+0000","last_fullsized":"2024-05-07T11:17:56.295373+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T11:17:56.295277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T11:17:56.295277+0000","last_clean_scrub_stamp":"2024-05-07T11:17:56.295277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T11:56:10.919183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"83'261","reported_seq":424,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:48.319698+0000","last_change":"2024-05-07T11:17:48.319731+0000","last_active":"2024-05-07T11:17:48.319698+0000","last_peered":"2024-05-07T11:17:48.319698+0000","last_clean":"2024-05-07T11:17:48.319698+0000","last_became_active":"2024-05-07T11:17:22.420362+0000","last_became_peered":"2024-05-07T11:17:22.420362+0000","last_unstale":"2024-05-07T11:17:48.319698+0000","last_undegraded":"2024-05-07T11:17:48.319698+0000","last_fullsized":"2024-05-07T11:17:48.319698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'261","last_scrub_stamp":"2024-05-07T11:17:48.319595+0000","last_deep_scrub":"83'261","last_deep_scrub_stamp":"2024-05-07T11:17:48.319595+0000","last_clean_scrub_stamp":"2024-05-07T11:17:48.319595+0000","objects_scrubbed":56,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:16.806230+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311400,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":308282,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"83'5","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:03.383093+0000","last_change":"2024-05-07T11:18:03.383165+0000","last_active":"2024-05-07T11:18:03.383093+0000","last_peered":"2024-05-07T11:18:03.383093+0000","last_clean":"2024-05-07T11:18:03.383093+0000","last_became_active":"2024-05-07T11:17:18.427583+0000","last_became_peered":"2024-05-07T11:17:18.427583+0000","last_unstale":"2024-05-07T11:18:03.383093+0000","last_undegraded":"2024-05-07T11:18:03.383093+0000","last_fullsized":"2024-05-07T11:18:03.383093+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'5","last_scrub_stamp":"2024-05-07T11:18:03.382988+0000","last_deep_scrub":"83'5","last_deep_scrub_stamp":"2024-05-07T11:18:03.382988+0000","last_clean_scrub_stamp":"2024-05-07T11:18:03.382988+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:55:45.890232+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"83'224","reported_seq":388,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:39.284980+0000","last_change":"2024-05-07T11:17:39.285014+0000","last_active":"2024-05-07T11:17:39.284980+0000","last_peered":"2024-05-07T11:17:39.284980+0000","last_clean":"2024-05-07T11:17:39.284980+0000","last_became_active":"2024-05-07T11:17:24.406337+0000","last_became_peered":"2024-05-07T11:17:24.406337+0000","last_unstale":"2024-05-07T11:17:39.284980+0000","last_undegraded":"2024-05-07T11:17:39.284980+0000","last_fullsized":"2024-05-07T11:17:39.284980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'224","last_scrub_stamp":"2024-05-07T11:17:39.284895+0000","last_deep_scrub":"83'224","last_deep_scrub_stamp":"2024-05-07T11:17:39.284895+0000","last_clean_scrub_stamp":"2024-05-07T11:17:39.284895+0000","objects_scrubbed":61,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:19:44.019329+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280772,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":280772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"83'6","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:55.293380+0000","last_change":"2024-05-07T11:17:55.293412+0000","last_active":"2024-05-07T11:17:55.293380+0000","last_peered":"2024-05-07T11:17:55.293380+0000","last_clean":"2024-05-07T11:17:55.293380+0000","last_became_active":"2024-05-07T11:17:18.430938+0000","last_became_peered":"2024-05-07T11:17:18.430938+0000","last_unstale":"2024-05-07T11:17:55.293380+0000","last_undegraded":"2024-05-07T11:17:55.293380+0000","last_fullsized":"2024-05-07T11:17:55.293380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'6","last_scrub_stamp":"2024-05-07T11:17:55.293289+0000","last_deep_scrub":"83'6","last_deep_scrub_stamp":"2024-05-07T11:17:55.293289+0000","last_clean_scrub_stamp":"2024-05-07T11:17:55.293289+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:58:33.636177+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"83'215","reported_seq":593,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:48.982412+0000","last_change":"2024-05-07T11:17:48.982459+0000","last_active":"2024-05-07T11:17:48.982412+0000","last_peered":"2024-05-07T11:17:48.982412+0000","last_clean":"2024-05-07T11:17:48.982412+0000","last_became_active":"2024-05-07T11:17:21.417881+0000","last_became_peered":"2024-05-07T11:17:21.417881+0000","last_unstale":"2024-05-07T11:17:48.982412+0000","last_undegraded":"2024-05-07T11:17:48.982412+0000","last_fullsized":"2024-05-07T11:17:48.982412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'215","last_scrub_stamp":"2024-05-07T11:17:48.982300+0000","last_deep_scrub":"83'215","last_deep_scrub_stamp":"2024-05-07T11:17:48.982300+0000","last_clean_scrub_stamp":"2024-05-07T11:17:48.982300+0000","objects_scrubbed":49,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:40.894671+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825179,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3825179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"83'3","reported_seq":182,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:03.162011+0000","last_change":"2024-05-07T11:18:03.162041+0000","last_active":"2024-05-07T11:18:03.162011+0000","last_peered":"2024-05-07T11:18:03.162011+0000","last_clean":"2024-05-07T11:18:03.162011+0000","last_became_active":"2024-05-07T11:17:18.404541+0000","last_became_peered":"2024-05-07T11:17:18.404541+0000","last_unstale":"2024-05-07T11:18:03.162011+0000","last_undegraded":"2024-05-07T11:18:03.162011+0000","last_fullsized":"2024-05-07T11:18:03.162011+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'3","last_scrub_stamp":"2024-05-07T11:18:03.161915+0000","last_deep_scrub":"83'3","last_deep_scrub_stamp":"2024-05-07T11:18:03.161915+0000","last_clean_scrub_stamp":"2024-05-07T11:18:03.161915+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:11:46.470205+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"83'215","reported_seq":594,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:19.160811+0000","last_change":"2024-05-07T11:18:19.160846+0000","last_active":"2024-05-07T11:18:19.160811+0000","last_peered":"2024-05-07T11:18:19.160811+0000","last_clean":"2024-05-07T11:18:19.160811+0000","last_became_active":"2024-05-07T11:17:30.406353+0000","last_became_peered":"2024-05-07T11:17:30.406353+0000","last_unstale":"2024-05-07T11:18:19.160811+0000","last_undegraded":"2024-05-07T11:18:19.160811+0000","last_fullsized":"2024-05-07T11:18:19.160811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'215","last_scrub_stamp":"2024-05-07T11:18:19.160733+0000","last_deep_scrub":"83'215","last_deep_scrub_stamp":"2024-05-07T11:18:19.160733+0000","last_clean_scrub_stamp":"2024-05-07T11:18:19.160733+0000","objects_scrubbed":57,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:00:12.168818+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124612,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":124612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"83'48","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:18:02.373280+0000","last_change":"2024-05-07T11:18:02.373307+0000","last_active":"2024-05-07T11:18:02.373280+0000","last_peered":"2024-05-07T11:18:02.373280+0000","last_clean":"2024-05-07T11:18:02.373280+0000","last_became_active":"2024-05-07T11:17:18.428711+0000","last_became_peered":"2024-05-07T11:17:18.428711+0000","last_unstale":"2024-05-07T11:18:02.373280+0000","last_undegraded":"2024-05-07T11:18:02.373280+0000","last_fullsized":"2024-05-07T11:18:02.373280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'48","last_scrub_stamp":"2024-05-07T11:18:02.373192+0000","last_deep_scrub":"83'48","last_deep_scrub_stamp":"2024-05-07T11:18:02.373192+0000","last_clean_scrub_stamp":"2024-05-07T11:18:02.373192+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T13:26:47.268773+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"83'232","reported_seq":395,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:40.266779+0000","last_change":"2024-05-07T11:17:40.266832+0000","last_active":"2024-05-07T11:17:40.266779+0000","last_peered":"2024-05-07T11:17:40.266779+0000","last_clean":"2024-05-07T11:17:40.266779+0000","last_became_active":"2024-05-07T11:17:22.415272+0000","last_became_peered":"2024-05-07T11:17:22.415272+0000","last_unstale":"2024-05-07T11:17:40.266779+0000","last_undegraded":"2024-05-07T11:17:40.266779+0000","last_fullsized":"2024-05-07T11:17:40.266779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'232","last_scrub_stamp":"2024-05-07T11:17:40.266666+0000","last_deep_scrub":"83'232","last_deep_scrub_stamp":"2024-05-07T11:17:40.266666+0000","last_clean_scrub_stamp":"2024-05-07T11:17:40.266666+0000","objects_scrubbed":63,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:36:06.762972+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190845,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":180914,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"83'3","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:38.308033+0000","last_change":"2024-05-07T11:17:38.308072+0000","last_active":"2024-05-07T11:17:38.308033+0000","last_peered":"2024-05-07T11:17:38.308033+0000","last_clean":"2024-05-07T11:17:38.308033+0000","last_became_active":"2024-05-07T11:17:18.432703+0000","last_became_peered":"2024-05-07T11:17:18.432703+0000","last_unstale":"2024-05-07T11:17:38.308033+0000","last_undegraded":"2024-05-07T11:17:38.308033+0000","last_fullsized":"2024-05-07T11:17:38.308033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'3","last_scrub_stamp":"2024-05-07T11:17:38.307946+0000","last_deep_scrub":"83'3","last_deep_scrub_stamp":"2024-05-07T11:17:38.307946+0000","last_clean_scrub_stamp":"2024-05-07T11:17:38.307946+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:09:02.258964+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"83'261","reported_seq":688,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:44.054506+0000","last_change":"2024-05-07T11:17:44.054545+0000","last_active":"2024-05-07T11:17:44.054506+0000","last_peered":"2024-05-07T11:17:44.054506+0000","last_clean":"2024-05-07T11:17:44.054506+0000","last_became_active":"2024-05-07T11:17:25.401850+0000","last_became_peered":"2024-05-07T11:17:25.401850+0000","last_unstale":"2024-05-07T11:17:44.054506+0000","last_undegraded":"2024-05-07T11:17:44.054506+0000","last_fullsized":"2024-05-07T11:17:44.054506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'261","last_scrub_stamp":"2024-05-07T11:17:44.054428+0000","last_deep_scrub":"83'261","last_deep_scrub_stamp":"2024-05-07T11:17:44.054428+0000","last_clean_scrub_stamp":"2024-05-07T11:17:44.054428+0000","objects_scrubbed":62,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:40.345114+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162204,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":150911,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"83'10","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-07T11:17:52.315142+0000","last_change":"2024-05-07T11:17:52.315175+0000","last_active":"2024-05-07T11:17:52.315142+0000","last_peered":"2024-05-07T11:17:52.315142+0000","last_clean":"2024-05-07T11:17:52.315142+0000","last_became_active":"2024-05-07T11:17:18.403419+0000","last_became_peered":"2024-05-07T11:17:18.403419+0000","last_unstale":"2024-05-07T11:17:52.315142+0000","last_undegraded":"2024-05-07T11:17:52.315142+0000","last_fullsized":"2024-05-07T11:17:52.315142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'10","last_scrub_stamp":"2024-05-07T11:17:52.315033+0000","last_deep_scrub":"83'10","last_deep_scrub_stamp":"2024-05-07T11:17:52.315033+0000","last_clean_scrub_stamp":"2024-05-07T11:17:52.315033+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:36:16.621480+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26718644,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10598,"num_write_kb":39023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5805,"num_bytes_recovered":19428989,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64405504,"data_stored":53099596,"data_compressed":4611280,"data_compressed_allocated":5402624,"data_compressed_original":14118912,"omap_allocated":0,"internal_metadata":0},"log_size":13865,"ondisk_log_size":13865,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41519549,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":342,"num_write":467,"num_write_kb":41266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":37418296,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16166912,"data_stored":83039098,"data_compressed":12203887,"data_compressed_allocated":14475264,"data_compressed_original":81412096,"omap_allocated":8809,"internal_metadata":0},"log_size":460,"ondisk_log_size":460,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19966,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738444,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88320,"kb_used_data":30776,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94283520,"statfs":{"total":96636764160,"available":96546324480,"internally_reserved":0,"allocated":31514624,"data_stored":54276063,"data_compressed":6326260,"data_compressed_allocated":7593984,"data_compressed_original":37191680,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":70,"seq":300647710738,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63132,"kb_used_data":23060,"kb_used_omap":10,"kb_used_meta":40053,"kb_avail":94308708,"statfs":{"total":96636764160,"available":96572116992,"internally_reserved":0,"allocated":23613440,"data_stored":43695842,"data_compressed":5536379,"data_compressed_allocated":6516736,"data_compressed_original":33533952,"omap_allocated":10404,"internal_metadata":41015132},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76332,"kb_used_data":27108,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94295508,"statfs":{"total":96636764160,"available":96558600192,"internally_reserved":0,"allocated":27758592,"data_stored":40411961,"data_compressed":4972494,"data_compressed_allocated":5840896,"data_compressed_original":25952256,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9983,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4071424,"data_stored":20547175,"data_compressed":3019459,"data_compressed_allocated":3575808,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":29360982,"data_compressed":4437586,"data_compressed_allocated":5165056,"data_compressed_original":29233152,"omap_allocated":8809,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6778880,"data_stored":33130941,"data_compressed":4746842,"data_compressed_allocated":5734400,"data_compressed_original":32116736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22953984,"data_stored":19509974,"data_compressed":1953035,"data_compressed_allocated":2265088,"data_compressed_original":5890048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17506304,"data_stored":13389680,"data_compressed":1088810,"data_compressed_allocated":1314816,"data_compressed_original":3727360,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23945216,"data_stored":20199942,"data_compressed":1569435,"data_compressed_allocated":1822720,"data_compressed_original":4501504,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T11:18:40.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-07T11:18:40.666 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-07T11:18:40.666 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-07T11:18:41.001 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:18:41.001 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-07T11:12:43.398023+0000","modified":"2024-05-07T11:12:45.405916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6803/1691847174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1691847174},{"type":"v1","addr":"172.21.15.62:6803","nonce":1691847174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4190,"qdb_cluster":[4190]},"id":1}]} 2024-05-07T11:18:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2024-05-07T11:18:41.015 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-07T11:18:41.354 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:18:41.355 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-07T11:12:43.398023+0000","modified":"2024-05-07T11:12:45.405916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6803/1691847174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1691847174},{"type":"v1","addr":"172.21.15.62:6803","nonce":1691847174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4190,"qdb_cluster":[4190]},"id":1}]} 2024-05-07T11:18:41.355 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2024-05-07T11:18:41.367 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T11:18:41.667 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-07T11:18:41.667 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":83,"fsid":"712a8431-2ac1-4386-a81f-c899bab82549","created":"2024-05-07T11:12:28.567931+0000","modified":"2024-05-07T11:17:30.393939+0000","last_up_change":"2024-05-07T11:17:18.238867+0000","last_in_change":"2024-05-07T11:12:29.411691+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T11:12:36.979175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T11:12:37.110970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-07T11:12:41.627365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-07T11:12:42.384664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd7246e2-0069-4df7-a669-4abe038a28ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6801","nonce":1378788154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6803","nonce":1378788154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6807","nonce":1378788154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1378788154},{"type":"v1","addr":"172.21.15.88:6805","nonce":1378788154}]},"public_addr":"172.21.15.88:6801/1378788154","cluster_addr":"172.21.15.88:6803/1378788154","heartbeat_back_addr":"172.21.15.88:6807/1378788154","heartbeat_front_addr":"172.21.15.88:6805/1378788154","state":["exists","up"]},{"osd":1,"uuid":"7df5bb74-60c0-4a46-a3d1-494f777a4f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":52,"up_from":70,"up_thru":81,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6801","nonce":1252745844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6803","nonce":1252745844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6807","nonce":1252745844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1252745844},{"type":"v1","addr":"172.21.15.149:6805","nonce":1252745844}]},"public_addr":"172.21.15.149:6801/1252745844","cluster_addr":"172.21.15.149:6803/1252745844","heartbeat_back_addr":"172.21.15.149:6807/1252745844","heartbeat_front_addr":"172.21.15.149:6805/1252745844","state":["exists","up"]},{"osd":2,"uuid":"ebed6b16-fba7-4b8a-a78e-1f84a500c31f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6801","nonce":2659225388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6803","nonce":2659225388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6807","nonce":2659225388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2659225388},{"type":"v1","addr":"172.21.15.175:6805","nonce":2659225388}]},"public_addr":"172.21.15.175:6801/2659225388","cluster_addr":"172.21.15.175:6803/2659225388","heartbeat_back_addr":"172.21.15.175:6807/2659225388","heartbeat_front_addr":"172.21.15.175:6805/2659225388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.430581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.433407+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T11:12:34.440186+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.7","osds":[2,1]},{"pgid":"4.0","osds":[2,0]},{"pgid":"4.8","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T11:18:41.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-07T11:18:42.032 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-07T11:18:42.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-07T11:18:42.068 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2024-05-07T11:18:43.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-07T11:18:44.033 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2024-05-07T11:18:44.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-07T11:18:45.035 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2024-05-07T11:18:45.050 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-07T11:18:45.051 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-07T11:18:45.051 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T11:18:45.061 INFO:tasks.ceph.mds.a:Stopped 2024-05-07T11:18:45.061 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-07T11:18:45.061 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-07T11:18:45.061 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T11:18:45.099 INFO:tasks.ceph.osd.0:Stopped 2024-05-07T11:18:45.100 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-07T11:18:45.100 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T11:18:45.132 INFO:tasks.ceph.osd.1:Stopped 2024-05-07T11:18:45.133 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-07T11:18:45.133 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T11:18:45.166 INFO:tasks.ceph.osd.2:Stopped 2024-05-07T11:18:45.167 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-07T11:18:45.167 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-07T11:18:45.168 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T11:18:45.194 INFO:tasks.ceph.mgr.x:Stopped 2024-05-07T11:18:45.194 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-07T11:18:45.194 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T11:18:45.263 INFO:tasks.ceph.mgr.y:Stopped 2024-05-07T11:18:45.264 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-07T11:18:45.264 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-07T11:18:45.264 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T11:18:45.316 INFO:tasks.ceph.mon.a:Stopped 2024-05-07T11:18:45.316 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-07T11:18:45.316 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T11:18:45.368 INFO:tasks.ceph.mon.b:Stopped 2024-05-07T11:18:45.369 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-07T11:18:45.369 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T11:18:45.420 INFO:tasks.ceph.mon.c:Stopped 2024-05-07T11:18:45.420 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-07T11:18:45.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-05-07T11:18:45.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-05-07T11:18:45.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-07T11:18:45.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-07T11:18:45.502 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2024-05-07T11:18:45.503 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-07T11:18:45.601 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-07T11:18:45.601 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-07T11:18:45.688 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi175.front.sepia.ceph.com 2024-05-07T11:18:45.688 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-07T11:18:45.809 INFO:tasks.ceph:Archiving mon data... 2024-05-07T11:18:45.811 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/data/mon.a.tgz 2024-05-07T11:18:45.811 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-05-07T11:18:45.828 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.swqbBHcNBu 2024-05-07T11:18:45.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.swqbBHcNBu 2024-05-07T11:18:45.986 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.swqbBHcNBu 2024-05-07T11:18:46.072 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.swqbBHcNBu is 383KB 2024-05-07T11:18:46.169 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.swqbBHcNBu 2024-05-07T11:18:46.185 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/data/mon.b.tgz 2024-05-07T11:18:46.185 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-05-07T11:18:46.240 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.6xGFpurLSH 2024-05-07T11:18:46.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6xGFpurLSH 2024-05-07T11:18:46.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.6xGFpurLSH 2024-05-07T11:18:46.504 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.6xGFpurLSH is 536KB 2024-05-07T11:18:46.604 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.6xGFpurLSH 2024-05-07T11:18:46.620 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/data/mon.c.tgz 2024-05-07T11:18:46.620 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-05-07T11:18:46.675 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.Gnfr1lQsnK 2024-05-07T11:18:46.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Gnfr1lQsnK 2024-05-07T11:18:46.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.Gnfr1lQsnK 2024-05-07T11:18:46.937 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.Gnfr1lQsnK is 536KB 2024-05-07T11:18:47.038 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.Gnfr1lQsnK 2024-05-07T11:18:47.055 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-07T11:18:47.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-07T11:18:47.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-07T11:18:47.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-07T11:18:47.102 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-07T11:18:47.177 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-07T11:18:47.194 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-07T11:18:47.219 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-07T11:18:47.238 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-07T11:18:47.239 INFO:tasks.ceph:Archiving crash dumps... 2024-05-07T11:18:47.241 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi062/crash 2024-05-07T11:18:47.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-07T11:18:47.268 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi088/crash 2024-05-07T11:18:47.269 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-07T11:18:47.319 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi149/crash 2024-05-07T11:18:47.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-07T11:18:47.363 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi175/crash 2024-05-07T11:18:47.364 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-07T11:18:47.410 INFO:tasks.ceph:Compressing logs... 2024-05-07T11:18:47.411 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-07T11:18:47.414 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-07T11:18:47.417 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-07T11:18:47.420 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-07T11:18:47.449 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-07T11:18:47.450 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-07T11:18:47.450 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.784.log 2024-05-07T11:18:47.451 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.784.log.gz 2024-05-07T11:18:47.454 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-07T11:18:47.457 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29654.log 2024-05-07T11:18:47.458 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29614.log 2024-05-07T11:18:47.458 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.29654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29574.log 2024-05-07T11:18:47.458 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29654.log.gz 2024-05-07T11:18:47.458 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.29614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29614.log.gz 2024-05-07T11:18:47.458 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.29574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29574.log.gz 2024-05-07T11:18:47.541 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30328.log 2024-05-07T11:18:47.541 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30578.log 2024-05-07T11:18:47.541 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31714.log 2024-05-07T11:18:47.541 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30328.log.gz 2024-05-07T11:18:47.542 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34286.log 2024-05-07T11:18:47.542 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30578.log.gz 2024-05-07T11:18:47.542 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37146.log 2024-05-07T11:18:47.542 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31714.log.gz 2024-05-07T11:18:47.542 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34286.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.34286.log.gz -5 2024-05-07T11:18:47.542 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46466.log 2024-05-07T11:18:47.542 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45109.log 2024-05-07T11:18:47.543 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37146.log.gz 2024-05-07T11:18:47.543 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47306.log 2024-05-07T11:18:47.543 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46466.log.gz 2024-05-07T11:18:47.543 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38643.log 2024-05-07T11:18:47.543 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45109.log.gz 2024-05-07T11:18:47.543 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46508.log 2024-05-07T11:18:47.543 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47306.log.gz 2024-05-07T11:18:47.543 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32870.log 2024-05-07T11:18:47.543 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38643.log.gz 2024-05-07T11:18:47.544 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32026.log 2024-05-07T11:18:47.544 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46508.log.gz 2024-05-07T11:18:47.544 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.32870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44985.log 2024-05-07T11:18:47.544 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32870.log.gz 2024-05-07T11:18:47.544 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.32026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35606.log 2024-05-07T11:18:47.544 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32026.log.gz 2024-05-07T11:18:47.544 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36039.log 2024-05-07T11:18:47.544 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44985.log.gz 2024-05-07T11:18:47.545 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45794.log 2024-05-07T11:18:47.545 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35606.log.gz 2024-05-07T11:18:47.545 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31838.log 2024-05-07T11:18:47.545 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36039.log.gz 2024-05-07T11:18:47.545 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47139.log 2024-05-07T11:18:47.545 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45794.log.gz 2024-05-07T11:18:47.545 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36886.log 2024-05-07T11:18:47.545 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31838.log.gz 2024-05-07T11:18:47.545 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30454.log 2024-05-07T11:18:47.546 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47139.log.gz 2024-05-07T11:18:47.546 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33048.log 2024-05-07T11:18:47.546 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36886.log.gz 2024-05-07T11:18:47.546 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31964.log 2024-05-07T11:18:47.546 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30454.log.gz 2024-05-07T11:18:47.546 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32128.log 2024-05-07T11:18:47.546 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33048.log.gz 2024-05-07T11:18:47.546 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46550.log 2024-05-07T11:18:47.547 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31964.log.gz 2024-05-07T11:18:47.547 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.32128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34521.log 2024-05-07T11:18:47.547 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32128.log.gz 2024-05-07T11:18:47.547 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44881.log 2024-05-07T11:18:47.547 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46550.log.gz 2024-05-07T11:18:47.547 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38807.log 2024-05-07T11:18:47.547 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34521.log.gz 2024-05-07T11:18:47.547 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29269.log 2024-05-07T11:18:47.548 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44881.log.gz 2024-05-07T11:18:47.548 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45626.log 2024-05-07T11:18:47.548 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38807.log.gz 2024-05-07T11:18:47.548 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35510.log 2024-05-07T11:18:47.548 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29269.log.gz 2024-05-07T11:18:47.548 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45626.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-07T11:18:47.548 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45626.log.gz 2024-05-07T11:18:47.548 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36929.log 2024-05-07T11:18:47.549 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35510.log.gz 2024-05-07T11:18:47.549 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32127.log 2024-05-07T11:18:47.549 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30202.log 2024-05-07T11:18:47.549 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36929.log.gz 2024-05-07T11:18:47.549 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.32127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32127.log.gz 2024-05-07T11:18:47.549 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37946.log 2024-05-07T11:18:47.549 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.30202.log: /var/log/ceph/ceph-client.admin.46256.log 2024-05-07T11:18:47.549 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30202.log.gz 2024-05-07T11:18:47.549 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41541.log 2024-05-07T11:18:47.550 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37946.log.gz 2024-05-07T11:18:47.550 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35400.log 2024-05-07T11:18:47.550 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46256.log.gz 2024-05-07T11:18:47.550 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29639.log 2024-05-07T11:18:47.550 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41541.log.gz 2024-05-07T11:18:47.550 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44923.log 2024-05-07T11:18:47.550 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35400.log.gz 2024-05-07T11:18:47.550 INFO:teuthology.orchestra.run.smithi062.stderr: 94.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-07T11:18:47.551 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35752.log 2024-05-07T11:18:47.551 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29639.log.gz 2024-05-07T11:18:47.551 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34942.log 2024-05-07T11:18:47.551 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44923.log.gz 2024-05-07T11:18:47.551 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2024-05-07T11:18:47.551 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35752.log.gz 2024-05-07T11:18:47.551 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37105.log 2024-05-07T11:18:47.551 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34942.log.gz 2024-05-07T11:18:47.552 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33401.log 2024-05-07T11:18:47.552 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2024-05-07T11:18:47.552 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47055.log 2024-05-07T11:18:47.552 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37105.log.gz 2024-05-07T11:18:47.552 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47182.log 2024-05-07T11:18:47.552 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33401.log.gz 2024-05-07T11:18:47.552 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35295.log 2024-05-07T11:18:47.552 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47055.log.gz 2024-05-07T11:18:47.552 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35690.log 2024-05-07T11:18:47.553 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47182.log.gz 2024-05-07T11:18:47.553 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34747.log 2024-05-07T11:18:47.553 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35295.log.gz 2024-05-07T11:18:47.553 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35690.log.gz 2024-05-07T11:18:47.553 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46592.log 2024-05-07T11:18:47.553 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34747.log.gz 2024-05-07T11:18:47.553 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32279.log 2024-05-07T11:18:47.553 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44965.log 2024-05-07T11:18:47.553 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46592.log.gz 2024-05-07T11:18:47.554 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.32279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30577.log 2024-05-07T11:18:47.554 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32279.log.gz 2024-05-07T11:18:47.554 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31630.log 2024-05-07T11:18:47.554 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44965.log.gz 2024-05-07T11:18:47.554 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44566.log 2024-05-07T11:18:47.554 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30577.log.gz 2024-05-07T11:18:47.554 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46170.log 2024-05-07T11:18:47.554 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31630.log.gz 2024-05-07T11:18:47.555 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34017.log 2024-05-07T11:18:47.555 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44566.log.gz 2024-05-07T11:18:47.555 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36680.log 2024-05-07T11:18:47.555 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46170.log.gz 2024-05-07T11:18:47.555 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41337.log 2024-05-07T11:18:47.555 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34017.log.gz 2024-05-07T11:18:47.555 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30935.log 2024-05-07T11:18:47.555 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36680.log.gz 2024-05-07T11:18:47.556 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36570.log 2024-05-07T11:18:47.556 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41337.log.gz 2024-05-07T11:18:47.556 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37016.log 2024-05-07T11:18:47.556 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30935.log.gz 2024-05-07T11:18:47.556 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31252.log 2024-05-07T11:18:47.556 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36570.log.gz 2024-05-07T11:18:47.556 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37016.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-07T11:18:47.556 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37016.log.gz 2024-05-07T11:18:47.556 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29555.log 2024-05-07T11:18:47.557 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31252.log.gz 2024-05-07T11:18:47.557 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35337.log 2024-05-07T11:18:47.557 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31880.log 2024-05-07T11:18:47.557 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29555.log.gz 2024-05-07T11:18:47.557 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32232.log 2024-05-07T11:18:47.557 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35337.log.gz 2024-05-07T11:18:47.557 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35115.log 2024-05-07T11:18:47.557 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31880.log.gz 2024-05-07T11:18:47.558 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.32232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32232.log.gz 2024-05-07T11:18:47.558 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29494.log 2024-05-07T11:18:47.558 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2024-05-07T11:18:47.558 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35115.log.gz 2024-05-07T11:18:47.558 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30370.log 2024-05-07T11:18:47.558 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29494.log.gz 2024-05-07T11:18:47.558 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35732.log 2024-05-07T11:18:47.559 INFO:teuthology.orchestra.run.smithi062.stderr: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-07T11:18:47.559 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2024-05-07T11:18:47.559 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27979.log 2024-05-07T11:18:47.559 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30370.log.gz 2024-05-07T11:18:47.559 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30828.log 2024-05-07T11:18:47.559 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35732.log.gz 2024-05-07T11:18:47.559 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.tmp-client.admin.27979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46971.log 2024-05-07T11:18:47.559 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27979.log.gz 2024-05-07T11:18:47.559 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35648.log 2024-05-07T11:18:47.560 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30828.log.gz 2024-05-07T11:18:47.560 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34727.log 2024-05-07T11:18:47.560 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46971.log.gz 2024-05-07T11:18:47.560 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33955.log 2024-05-07T11:18:47.560 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35648.log.gz 2024-05-07T11:18:47.560 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36177.log 2024-05-07T11:18:47.560 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34727.log.gz 2024-05-07T11:18:47.560 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31504.log 2024-05-07T11:18:47.560 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33955.log.gz 2024-05-07T11:18:47.561 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34155.log 2024-05-07T11:18:47.561 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36177.log.gz 2024-05-07T11:18:47.561 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31294.log 2024-05-07T11:18:47.561 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31504.log.gz 2024-05-07T11:18:47.561 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47097.log 2024-05-07T11:18:47.561 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34155.log.gz 2024-05-07T11:18:47.561 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34418.log 2024-05-07T11:18:47.561 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31294.log.gz 2024-05-07T11:18:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31588.log 2024-05-07T11:18:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47097.log.gz 2024-05-07T11:18:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34202.log 2024-05-07T11:18:47.562 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34418.log.gz 2024-05-07T11:18:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44441.log 2024-05-07T11:18:47.562 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31588.log.gz 2024-05-07T11:18:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46845.log 2024-05-07T11:18:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34202.log.gz 2024-05-07T11:18:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45200.log 2024-05-07T11:18:47.563 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44441.log.gz 2024-05-07T11:18:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33269.log 2024-05-07T11:18:47.563 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz 2024-05-07T11:18:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47390.log 2024-05-07T11:18:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45200.log.gz 2024-05-07T11:18:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34111.log 2024-05-07T11:18:47.563 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33269.log.gz 2024-05-07T11:18:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31084.log 2024-05-07T11:18:47.563 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47390.log.gz 2024-05-07T11:18:47.564 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34831.log 2024-05-07T11:18:47.564 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34111.log.gz 2024-05-07T11:18:47.564 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29988.log 2024-05-07T11:18:47.564 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31084.log.gz 2024-05-07T11:18:47.564 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46676.log 2024-05-07T11:18:47.564 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34831.log.gz 2024-05-07T11:18:47.564 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34591.log 2024-05-07T11:18:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29988.log.gz 2024-05-07T11:18:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41792.log 2024-05-07T11:18:47.565 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46676.log.gz 2024-05-07T11:18:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.34591.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34066.log 2024-05-07T11:18:47.565 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34591.log.gz 2024-05-07T11:18:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30412.log 2024-05-07T11:18:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41792.log.gz 2024-05-07T11:18:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30702.log 2024-05-07T11:18:47.565 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34066.log.gz 2024-05-07T11:18:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33489.log 2024-05-07T11:18:47.566 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30412.log.gz 2024-05-07T11:18:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-07T11:18:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30702.log.gz 2024-05-07T11:18:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45710.log 2024-05-07T11:18:47.566 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33489.log.gz 2024-05-07T11:18:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34327.log 2024-05-07T11:18:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46634.log 2024-05-07T11:18:47.567 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45710.log.gz 2024-05-07T11:18:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44524.log 2024-05-07T11:18:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34327.log.gz 2024-05-07T11:18:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30244.log 2024-05-07T11:18:47.567 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46634.log.gz 2024-05-07T11:18:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44524.log.gz 2024-05-07T11:18:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33799.log 2024-05-07T11:18:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42246.log 2024-05-07T11:18:47.568 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30244.log.gz 2024-05-07T11:18:47.568 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34438.log 2024-05-07T11:18:47.568 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33799.log.gz 2024-05-07T11:18:47.568 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.42246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30704.log 2024-05-07T11:18:47.568 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42246.log.gz 2024-05-07T11:18:47.568 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38688.log 2024-05-07T11:18:47.568 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34438.log.gz 2024-05-07T11:18:47.568 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30576.log 2024-05-07T11:18:47.568 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30704.log.gz 2024-05-07T11:18:47.569 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45047.log 2024-05-07T11:18:47.569 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38688.log.gz 2024-05-07T11:18:47.569 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46298.log 2024-05-07T11:18:47.569 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30576.log.gz 2024-05-07T11:18:47.569 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46340.log 2024-05-07T11:18:47.569 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45047.log.gz 2024-05-07T11:18:47.569 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44381.log 2024-05-07T11:18:47.569 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46298.log.gz 2024-05-07T11:18:47.570 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46340.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.35862.log 2024-05-07T11:18:47.570 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46340.log.gz 2024-05-07T11:18:47.570 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33158.log 2024-05-07T11:18:47.570 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44381.log.gz 2024-05-07T11:18:47.570 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45287.log 2024-05-07T11:18:47.570 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35862.log.gz 2024-05-07T11:18:47.570 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36758.log 2024-05-07T11:18:47.570 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33158.log.gz 2024-05-07T11:18:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44484.log 2024-05-07T11:18:47.571 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45287.log.gz 2024-05-07T11:18:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46424.log 2024-05-07T11:18:47.571 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36758.log.gz 2024-05-07T11:18:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44694.log 2024-05-07T11:18:47.571 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44484.log.gz 2024-05-07T11:18:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29681.log 2024-05-07T11:18:47.572 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46424.log.gz 2024-05-07T11:18:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46043.log 2024-05-07T11:18:47.572 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44694.log.gz 2024-05-07T11:18:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29213.log 2024-05-07T11:18:47.572 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29681.log.gz 2024-05-07T11:18:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35999.log 2024-05-07T11:18:47.572 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46043.log.gz 2024-05-07T11:18:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33728.log 2024-05-07T11:18:47.572 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29213.log.gz 2024-05-07T11:18:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31168.log 2024-05-07T11:18:47.573 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35999.log.gz 2024-05-07T11:18:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33728.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-07T11:18:47.573 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33728.log.gz 2024-05-07T11:18:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31168.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-07T11:18:47.573 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31168.log.gz 2024-05-07T11:18:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44651.log 2024-05-07T11:18:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29809.log 2024-05-07T11:18:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44651.log.gz 2024-05-07T11:18:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31378.log 2024-05-07T11:18:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31672.log 2024-05-07T11:18:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29809.log.gz 2024-05-07T11:18:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46169.log 2024-05-07T11:18:47.574 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31378.log.gz 2024-05-07T11:18:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31672.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.31672.log.gz /var/log/ceph/ceph-client.admin.31546.log 2024-05-07T11:18:47.574 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-05-07T11:18:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36839.log 2024-05-07T11:18:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46169.log.gz 2024-05-07T11:18:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31546.log.gz 2024-05-07T11:18:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28841.log 2024-05-07T11:18:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34638.log 2024-05-07T11:18:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36839.log.gz 2024-05-07T11:18:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28841.log.gz 2024-05-07T11:18:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33006.log 2024-05-07T11:18:47.576 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35072.log 2024-05-07T11:18:47.576 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34638.log.gz 2024-05-07T11:18:47.576 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34900.log 2024-05-07T11:18:47.576 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33006.log.gz 2024-05-07T11:18:47.576 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35072.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-07T11:18:47.576 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35072.log.gz 2024-05-07T11:18:47.576 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39985.log 2024-05-07T11:18:47.576 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34900.log.gz 2024-05-07T11:18:47.576 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31210.log 2024-05-07T11:18:47.577 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32129.log 2024-05-07T11:18:47.577 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39985.log.gz 2024-05-07T11:18:47.577 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36088.log 2024-05-07T11:18:47.577 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-07T11:18:47.577 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31210.log.gz 2024-05-07T11:18:47.577 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36308.log 2024-05-07T11:18:47.577 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.32129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32129.log.gz 2024-05-07T11:18:47.577 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45918.log 2024-05-07T11:18:47.577 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36088.log.gz 2024-05-07T11:18:47.578 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46929.log 2024-05-07T11:18:47.578 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36308.log.gz 2024-05-07T11:18:47.578 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45917.log 2024-05-07T11:18:47.578 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45918.log.gz 2024-05-07T11:18:47.578 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46929.log.gz 2024-05-07T11:18:47.578 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46044.log 2024-05-07T11:18:47.578 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45836.log 2024-05-07T11:18:47.578 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45917.log.gz 2024-05-07T11:18:47.579 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46130.log 2024-05-07T11:18:47.579 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46044.log.gz 2024-05-07T11:18:47.579 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30703.log 2024-05-07T11:18:47.579 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45836.log.gz 2024-05-07T11:18:47.579 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30160.log 2024-05-07T11:18:47.579 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46130.log.gz 2024-05-07T11:18:47.579 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31922.log 2024-05-07T11:18:47.579 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30703.log.gz 2024-05-07T11:18:47.579 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37192.log 2024-05-07T11:18:47.580 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30160.log.gz 2024-05-07T11:18:47.580 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30830.log 2024-05-07T11:18:47.580 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31922.log.gz 2024-05-07T11:18:47.580 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37192.log.gz 2024-05-07T11:18:47.580 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30118.log 2024-05-07T11:18:47.580 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45542.log 2024-05-07T11:18:47.580 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30830.log.gz 2024-05-07T11:18:47.580 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31126.log 2024-05-07T11:18:47.580 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30118.log.gz 2024-05-07T11:18:47.581 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46042.log 2024-05-07T11:18:47.581 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45542.log.gz 2024-05-07T11:18:47.581 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35162.log 2024-05-07T11:18:47.581 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31126.log.gz 2024-05-07T11:18:47.581 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29375.log 2024-05-07T11:18:47.581 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46042.log.gz 2024-05-07T11:18:47.581 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35162.log.gz 2024-05-07T11:18:47.581 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30496.log 2024-05-07T11:18:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38538.log 2024-05-07T11:18:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29375.log.gz 2024-05-07T11:18:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46719.log 2024-05-07T11:18:47.582 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30496.log.gz 2024-05-07T11:18:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35910.log 2024-05-07T11:18:47.582 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38538.log.gz 2024-05-07T11:18:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-05-07T11:18:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46719.log.gz 2024-05-07T11:18:47.583 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35910.log.gz 2024-05-07T11:18:47.583 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44323.log 2024-05-07T11:18:47.583 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38440.log 2024-05-07T11:18:47.583 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-05-07T11:18:47.583 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31420.log 2024-05-07T11:18:47.583 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44323.log.gz 2024-05-07T11:18:47.583 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34680.log 2024-05-07T11:18:47.583 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38440.log.gz 2024-05-07T11:18:47.584 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29447.log 2024-05-07T11:18:47.584 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31420.log.gz 2024-05-07T11:18:47.584 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47013.log 2024-05-07T11:18:47.584 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34680.log.gz 2024-05-07T11:18:47.584 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29447.log.gz 2024-05-07T11:18:47.584 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31756.log 2024-05-07T11:18:47.584 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29597.log 2024-05-07T11:18:47.584 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47013.log.gz 2024-05-07T11:18:47.584 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-05-07T11:18:47.585 INFO:teuthology.orchestra.run.smithi062.stderr: 49.1% -- replaced with /var/log/ceph/ceph-client.admin.31756.log.gz 2024-05-07T11:18:47.585 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33448.log 2024-05-07T11:18:47.585 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29597.log.gz 2024-05-07T11:18:47.585 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35208.log 2024-05-07T11:18:47.585 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz 2024-05-07T11:18:47.585 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41431.log 2024-05-07T11:18:47.585 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33448.log.gz 2024-05-07T11:18:47.585 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35208.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.35559.log -- replaced with /var/log/ceph/ceph-client.admin.35208.log.gz 2024-05-07T11:18:47.586 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-05-07T11:18:47.586 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34376.log 2024-05-07T11:18:47.586 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41431.log.gz 2024-05-07T11:18:47.586 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35559.log.gz 2024-05-07T11:18:47.586 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45410.log 2024-05-07T11:18:47.586 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30076.log 2024-05-07T11:18:47.586 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34376.log.gz 2024-05-07T11:18:47.586 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36528.log 2024-05-07T11:18:47.587 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45410.log.gz 2024-05-07T11:18:47.587 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33668.log 2024-05-07T11:18:47.587 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30076.log.gz 2024-05-07T11:18:47.587 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35930.log 2024-05-07T11:18:47.587 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36528.log.gz 2024-05-07T11:18:47.587 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33668.log.gz 2024-05-07T11:18:47.587 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33579.log 2024-05-07T11:18:47.587 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2024-05-07T11:18:47.588 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35930.log.gz 2024-05-07T11:18:47.588 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29765.log 2024-05-07T11:18:47.588 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33579.log.gz 2024-05-07T11:18:47.588 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.42447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34962.log 2024-05-07T11:18:47.588 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2024-05-07T11:18:47.588 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47264.log 2024-05-07T11:18:47.588 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29765.log.gz 2024-05-07T11:18:47.588 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35470.log 2024-05-07T11:18:47.589 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34962.log.gz 2024-05-07T11:18:47.589 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29946.log 2024-05-07T11:18:47.589 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47264.log.gz 2024-05-07T11:18:47.589 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30034.log 2024-05-07T11:18:47.589 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35470.log.gz 2024-05-07T11:18:47.589 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36415.log 2024-05-07T11:18:47.589 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29946.log.gz 2024-05-07T11:18:47.589 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29050.log 2024-05-07T11:18:47.590 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30034.log.gz 2024-05-07T11:18:47.590 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-05-07T11:18:47.590 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36415.log.gz 2024-05-07T11:18:47.590 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29050.log.gz 2024-05-07T11:18:47.590 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45452.log 2024-05-07T11:18:47.590 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45752.log 2024-05-07T11:18:47.590 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz 2024-05-07T11:18:47.590 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33096.log 2024-05-07T11:18:47.591 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45452.log.gz 2024-05-07T11:18:47.591 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32748.log 2024-05-07T11:18:47.591 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45752.log.gz 2024-05-07T11:18:47.591 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31336.log 2024-05-07T11:18:47.591 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33096.log.gz 2024-05-07T11:18:47.591 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.32748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46803.log 2024-05-07T11:18:47.591 INFO:teuthology.orchestra.run.smithi062.stderr: 32.1% -- replaced with /var/log/ceph/ceph-client.0.32748.log.gz 2024-05-07T11:18:47.591 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30956.log 2024-05-07T11:18:47.592 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31336.log.gz 2024-05-07T11:18:47.592 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30286.log 2024-05-07T11:18:47.592 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46803.log.gz 2024-05-07T11:18:47.592 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44839.log 2024-05-07T11:18:47.592 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30956.log.gz 2024-05-07T11:18:47.592 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36266.log 2024-05-07T11:18:47.592 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30286.log.gz 2024-05-07T11:18:47.592 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35022.log 2024-05-07T11:18:47.592 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44839.log.gz 2024-05-07T11:18:47.593 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5/var/log/ceph/ceph-client.admin.36266.log: --verbose -- /var/log/ceph/ceph-client.admin.45584.log 2024-05-07T11:18:47.593 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36266.log.gz 2024-05-07T11:18:47.593 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44752.log 2024-05-07T11:18:47.593 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35022.log.gz 2024-05-07T11:18:47.593 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33708.log 2024-05-07T11:18:47.593 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45584.log.gz 2024-05-07T11:18:47.593 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30936.log 2024-05-07T11:18:47.593 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44752.log.gz 2024-05-07T11:18:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33708.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.29853.log 2024-05-07T11:18:47.594 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33708.log.gz 2024-05-07T11:18:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41848.log 2024-05-07T11:18:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30936.log.gz 2024-05-07T11:18:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36974.log 2024-05-07T11:18:47.594 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29853.log.gz 2024-05-07T11:18:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39535.log 2024-05-07T11:18:47.595 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41848.log.gz 2024-05-07T11:18:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34222.log 2024-05-07T11:18:47.595 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36974.log.gz 2024-05-07T11:18:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37826.log 2024-05-07T11:18:47.595 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39535.log.gz 2024-05-07T11:18:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47535.log 2024-05-07T11:18:47.595 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34222.log.gz 2024-05-07T11:18:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44772.log 2024-05-07T11:18:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37826.log.gz 2024-05-07T11:18:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32406.log 2024-05-07T11:18:47.596 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47535.log.gz 2024-05-07T11:18:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33888.log 2024-05-07T11:18:47.596 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44772.log.gz 2024-05-07T11:18:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33157.log 2024-05-07T11:18:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.32406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32406.log.gz 2024-05-07T11:18:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33888.log.gz 2024-05-07T11:18:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-07T11:18:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44609.log 2024-05-07T11:18:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33157.log.gz 2024-05-07T11:18:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33312.log 2024-05-07T11:18:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46761.log 2024-05-07T11:18:47.597 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44609.log.gz 2024-05-07T11:18:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33352.log 2024-05-07T11:18:47.597 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33312.log.gz 2024-05-07T11:18:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37543.log 2024-05-07T11:18:47.598 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46761.log.gz 2024-05-07T11:18:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47348.log 2024-05-07T11:18:47.598 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33352.log.gz 2024-05-07T11:18:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34520.log 2024-05-07T11:18:47.598 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37543.log.gz 2024-05-07T11:18:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47348.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47348.log.gz 2024-05-07T11:18:47.598 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35255.log 2024-05-07T11:18:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34520.log.gz 2024-05-07T11:18:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34811.log 2024-05-07T11:18:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35255.log.gz 2024-05-07T11:18:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31462.log 2024-05-07T11:18:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34811.log.gz 2024-05-07T11:18:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47222.log 2024-05-07T11:18:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31462.log.gz 2024-05-07T11:18:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33532.log 2024-05-07T11:18:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47222.log.gz 2024-05-07T11:18:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36393.log 2024-05-07T11:18:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33532.log.gz 2024-05-07T11:18:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35401.log 2024-05-07T11:18:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36393.log.gz 2024-05-07T11:18:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29904.log 2024-05-07T11:18:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35401.log.gz 2024-05-07T11:18:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33846.log 2024-05-07T11:18:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29904.log.gz 2024-05-07T11:18:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36130.log 2024-05-07T11:18:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46382.log 2024-05-07T11:18:47.601 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33846.log.gz 2024-05-07T11:18:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30829.log 2024-05-07T11:18:47.601 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36130.log.gz 2024-05-07T11:18:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46382.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-07T11:18:47.601 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46382.log.gz 2024-05-07T11:18:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2024-05-07T11:18:47.601 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30829.log.gz 2024-05-07T11:18:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45916.log 2024-05-07T11:18:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.41920.log: /var/log/ceph/ceph-client.admin.44260.log 2024-05-07T11:18:47.602 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2024-05-07T11:18:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45916.log.gz 2024-05-07T11:18:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35821.log 2024-05-07T11:18:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29723.log 2024-05-07T11:18:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.44260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44260.log.gz 2024-05-07T11:18:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29313.log 2024-05-07T11:18:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35821.log: /var/log/ceph/ceph-client.admin.29723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35821.log.gz 2024-05-07T11:18:47.602 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29723.log.gz 2024-05-07T11:18:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36481.log 2024-05-07T11:18:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29313.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29313.log.gz 2024-05-07T11:18:47.603 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36348.log 2024-05-07T11:18:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36481.log.gz 2024-05-07T11:18:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29095.log 2024-05-07T11:18:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45495.log 2024-05-07T11:18:47.603 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36348.log.gz 2024-05-07T11:18:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31042.log 2024-05-07T11:18:47.603 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29095.log.gz 2024-05-07T11:18:47.604 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33935.log 2024-05-07T11:18:47.604 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45495.log.gz 2024-05-07T11:18:47.604 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45242.log 2024-05-07T11:18:47.604 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31042.log: /var/log/ceph/ceph-client.admin.33935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31042.log.gz 2024-05-07T11:18:47.604 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33935.log.gz 2024-05-07T11:18:47.604 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37237.log 2024-05-07T11:18:47.604 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45242.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45242.log.gz 2024-05-07T11:18:47.604 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47450.log 2024-05-07T11:18:47.605 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37237.log.gz 2024-05-07T11:18:47.605 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45668.log 2024-05-07T11:18:47.605 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47450.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47450.log.gz 2024-05-07T11:18:47.605 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36218.log 2024-05-07T11:18:47.605 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.45668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45668.log.gz 2024-05-07T11:18:47.605 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36218.log.gz 2024-05-07T11:18:47.605 INFO:teuthology.orchestra.run.smithi062.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-07T11:18:47.605 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-07T11:18:47.631 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-07T11:18:47.682 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-07T11:18:47.756 INFO:teuthology.orchestra.run.smithi062.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-07T11:18:47.758 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-05-07T11:18:47.758 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m0.331s 2024-05-07T11:18:47.759 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m0.772s 2024-05-07T11:18:47.759 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.152s 2024-05-07T11:18:48.625 INFO:teuthology.orchestra.run.smithi149.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-07T11:18:48.627 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-05-07T11:18:48.627 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m1.193s 2024-05-07T11:18:48.627 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m1.113s 2024-05-07T11:18:48.627 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m0.058s 2024-05-07T11:18:49.077 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.0.log: 94.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-07T11:18:49.079 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-07T11:18:49.079 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m1.647s 2024-05-07T11:18:49.079 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m1.586s 2024-05-07T11:18:49.080 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m0.069s 2024-05-07T11:18:50.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-05-07T11:18:50.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-07T11:18:50.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-07T11:18:51.375 INFO:teuthology.orchestra.run.smithi175.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-07T11:18:51.377 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-05-07T11:18:51.377 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m3.940s 2024-05-07T11:18:51.377 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m3.810s 2024-05-07T11:18:51.378 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m0.136s 2024-05-07T11:18:51.378 INFO:tasks.ceph:Archiving logs... 2024-05-07T11:18:51.379 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi062/log 2024-05-07T11:18:51.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-07T11:18:51.736 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi088/log 2024-05-07T11:18:51.737 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-07T11:18:52.039 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi149/log 2024-05-07T11:18:52.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-07T11:18:52.227 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi175/log 2024-05-07T11:18:52.228 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-07T11:18:52.853 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-07T11:18:52.864 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-07T11:18:52.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-07T11:18:52.867 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-07T11:18:52.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-07T11:18:52.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-07T11:18:53.016 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-07T11:18:53.027 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-07T11:18:53.028 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T11:18:53.030 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T11:18:53.033 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T11:18:53.035 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T11:18:53.046 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-05-07T11:18:53.048 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-05-07T11:18:53.050 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-05-07T11:18:53.051 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-05-07T11:18:53.051 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T11:18:53.051 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-05-07T11:18:53.052 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +247us[ +258us] +/- 50ms 2024-05-07T11:18:53.052 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -1229us[-1218us] +/- 57ms 2024-05-07T11:18:53.052 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +1412us[+1423us] +/- 80ms 2024-05-07T11:18:53.052 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:18:53.053 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T11:18:53.054 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-05-07T11:18:53.054 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +226us[ +214us] +/- 50ms 2024-05-07T11:18:53.054 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -1251us[-1264us] +/- 57ms 2024-05-07T11:18:53.054 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +1404us[+1392us] +/- 80ms 2024-05-07T11:18:53.054 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:18:53.057 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T11:18:53.057 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-05-07T11:18:53.057 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv01.front.sepia.ceph.com 3 6 37 42 +289us[ +239us] +/- 49ms 2024-05-07T11:18:53.057 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 6 37 41 -1218us[-1218us] +/- 57ms 2024-05-07T11:18:53.057 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 37 41 +1419us[+1419us] +/- 79ms 2024-05-07T11:18:53.057 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:18:53.057 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T11:18:53.058 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-05-07T11:18:53.058 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +218us[ +253us] +/- 50ms 2024-05-07T11:18:53.058 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -1248us[-1214us] +/- 57ms 2024-05-07T11:18:53.059 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +1386us[+1420us] +/- 80ms 2024-05-07T11:18:53.059 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T11:18:53.060 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-07T11:18:53.141 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-07T11:18:53.142 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-07T11:18:53.224 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-07T11:18:53.300 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-07T11:18:53.370 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-07T11:18:53.500 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-07T11:18:53.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T11:18:53.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:18:53.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T11:18:53.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:18:53.632 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T11:18:53.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:18:53.664 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T11:18:53.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:18:53.693 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-07T11:18:53.707 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-07T11:18:53.815 INFO:teuthology.task.internal:Duration was 798.904481 seconds 2024-05-07T11:18:53.816 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-07T11:18:53.900 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-07T11:18:53.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-07T11:18:53.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-07T11:18:53.908 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-07T11:18:53.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-07T11:18:53.949 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T11:18:53.951 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T11:18:53.954 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T11:18:53.967 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T11:18:54.433 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-07T11:18:54.434 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-05-07T11:18:54.434 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-07T11:18:54.460 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-05-07T11:18:54.461 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-07T11:18:54.491 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-05-07T11:18:54.491 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-07T11:18:54.519 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-05-07T11:18:54.520 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-07T11:18:54.543 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-07T11:18:54.543 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-07T11:18:54.546 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-07T11:18:54.549 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-07T11:18:54.563 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-07T11:18:54.612 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-07T11:18:54.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-07T11:18:54.620 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-07T11:18:54.623 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-07T11:18:54.633 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-07T11:18:54.758 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-07T11:18:54.769 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-07T11:18:54.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-07T11:18:54.797 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-07T11:18:54.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-07T11:18:54.850 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-07T11:18:54.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-07T11:18:54.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-07T11:18:54.889 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-07T11:18:54.892 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-07T11:18:54.895 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-07T11:18:54.916 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-05-07T11:18:54.916 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-05-07T11:18:54.925 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-05-07T11:18:54.939 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-05-07T11:18:54.963 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-07T11:18:54.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:18:54.983 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-07T11:18:54.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:18:54.998 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-07T11:18:55.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:18:55.013 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-07T11:18:55.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T11:18:55.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-07T11:18:55.040 INFO:teuthology.task.internal:Transferring archived files... 2024-05-07T11:18:55.040 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi062 2024-05-07T11:18:55.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-07T11:18:55.077 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi088 2024-05-07T11:18:55.077 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-07T11:18:55.110 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi149 2024-05-07T11:18:55.110 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-07T11:18:55.142 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861/remote/smithi175 2024-05-07T11:18:55.143 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-07T11:18:55.176 INFO:teuthology.task.internal:Removing archive directory... 2024-05-07T11:18:55.176 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-07T11:18:55.178 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-07T11:18:55.181 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-07T11:18:55.183 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-07T11:18:55.226 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-07T11:18:55.247 INFO:teuthology.task.internal:Not uploading archives. 2024-05-07T11:18:55.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-07T11:18:55.340 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-07T11:18:55.340 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-07T11:18:55.343 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-07T11:18:55.345 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-07T11:18:55.347 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-07T11:18:55.356 INFO:teuthology.orchestra.run.smithi062.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 7 11:18 /home/ubuntu/cephtest 2024-05-07T11:18:55.358 INFO:teuthology.orchestra.run.smithi088.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 7 11:18 /home/ubuntu/cephtest 2024-05-07T11:18:55.360 INFO:teuthology.orchestra.run.smithi149.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 7 11:18 /home/ubuntu/cephtest 2024-05-07T11:18:55.362 INFO:teuthology.orchestra.run.smithi175.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 7 11:18 /home/ubuntu/cephtest 2024-05-07T11:18:55.363 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-07T11:18:55.459 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-07T11:18:55.607 INFO:teuthology.nuke:Checking targets against current locks 2024-05-07T11:18:55.640 DEBUG:teuthology.nuke:shortname: smithi062 2024-05-07T11:18:55.640 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-07T11:18:55.665 DEBUG:teuthology.nuke:shortname: smithi088 2024-05-07T11:18:55.666 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-07T11:18:55.671 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 10:56:09.086024', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNe3riJAovr1mD7EZKsLr2BKG9M1rS7AtGi+8aZBwYveI+vn3NhpWprR0chamwPBTEsJQcKyBJUr/sQhDjtQUw='} 2024-05-07T11:18:55.691 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 10:56:09.088375', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIXu0uzxb/cVcJHa8ICjt2brwa2gNIApw8TJIEPlNy5ehzJvSE1eoUGiDMs5DYxwxAqekV+dUpw0uB4bWwRo630='} 2024-05-07T11:18:55.697 DEBUG:teuthology.nuke:shortname: smithi149 2024-05-07T11:18:55.697 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-07T11:18:55.731 INFO:teuthology.orchestra.console.smithi062:Power off 2024-05-07T11:18:55.731 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-07T11:18:55.744 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 10:56:09.084449', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAEKd7xti3tEPj+/xoerh7OXC0gHE7S7LVt3AyqJmmzQncEBiREZzUHFxUmyWeP5Uda8n+RPGcD/wJb+n0Bpk0k='} 2024-05-07T11:18:55.747 DEBUG:teuthology.nuke:shortname: smithi175 2024-05-07T11:18:55.748 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-07T11:18:55.756 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2024-05-07T11:18:55.756 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:18:55.789 INFO:teuthology.orchestra.console.smithi088:Power off 2024-05-07T11:18:55.789 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-07T11:18:55.802 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-06_21:32:02-powercycle-squid-distro-default-smithi/7694861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 10:56:09.087215', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkFJFZyYxW4WjMXovFMeaXL96Rttq7VuZkBBGQHAnUf3QT0VN4iH5OhhxhGWJ+y+VakYTlIelr/k5Pij3Y3T9A='} 2024-05-07T11:18:55.808 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-05-07T11:18:55.817 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-05-07T11:18:55.817 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:18:55.838 INFO:teuthology.orchestra.console.smithi149:Power off 2024-05-07T11:18:55.839 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-07T11:18:55.854 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-05-07T11:18:55.862 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2024-05-07T11:18:55.862 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:18:55.881 INFO:teuthology.orchestra.console.smithi175:Power off 2024-05-07T11:18:55.882 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-07T11:18:55.892 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-05-07T11:18:55.905 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-05-07T11:18:55.905 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:18:55.931 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-05-07T11:18:59.809 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:18:59.855 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:18:59.894 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:18:59.920 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-05-07T11:18:59.932 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:18:59.968 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-05-07T11:19:00.007 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-05-07T11:19:00.044 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-05-07T11:19:03.922 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:19:03.969 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:19:04.008 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:19:04.034 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-05-07T11:19:04.045 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:19:04.083 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-05-07T11:19:04.125 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-05-07T11:19:04.136 INFO:teuthology.orchestra.console.smithi062:Power off completed 2024-05-07T11:19:04.156 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-05-07T11:19:04.225 INFO:teuthology.orchestra.console.smithi149:Power off completed 2024-05-07T11:19:04.257 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-05-07T11:19:08.086 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-07T11:19:08.197 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-05-07T11:19:08.298 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-05-07T11:19:08.404 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} duration: 798.9044814109802 failure_reason: 'Command failed (workunit test suites/fsx.sh) on smithi062 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=510b35d4b766757579df5fd9efd2f892309f09e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=633fd6f6766e462bb3d1b595d9f1158a status: fail success: false 2024-05-07T11:19:08.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-07T11:19:08.486 INFO:teuthology.run:FAIL